Brainee Posted October 7, 2023 Posted October 7, 2023 Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics.
exchemist Posted October 7, 2023 Posted October 7, 2023 (edited) 5 minutes ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. You're a mug then, because it isn't. We've already had some threads discussing how unreliable it is for mathematical science. Edited October 7, 2023 by exchemist
swansont Posted October 7, 2023 Posted October 7, 2023 3 hours ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. Why would you use a language model for science or math?
Endy0816 Posted October 8, 2023 Posted October 8, 2023 10 hours ago, Brainee said: Is ChatGPT trustworthy? Is it reliable? I have used it a lot in science and mathematics. It'll write something that sounds believable, but may not be correct. I do think it can give useful insight into a subject.
Brainee Posted October 9, 2023 Author Posted October 9, 2023 On 10/7/2023 at 11:52 PM, swansont said: Why would you use a language model for science or math? On 10/7/2023 at 8:50 PM, exchemist said: You're a mug then, because it isn't. We've already had some threads discussing how unreliable it is for mathematical science. I have used it and it has given what appears to be correct. It gives same answer as Google search.
exchemist Posted October 9, 2023 Posted October 9, 2023 (edited) 58 minutes ago, Brainee said: I have used it and it has given what appears to be correct. It gives same answer as Google search. Sure, it might sometimes, but others on this forum have found instances where it is wrong or nonsensical. As @studiot says, it is language model. As such it is not well adapted for mathematical science. You asked if it is reliable, and the answer is evidently no it isn't. Edited October 9, 2023 by exchemist
studiot Posted October 9, 2023 Posted October 9, 2023 54 minutes ago, exchemist said: Sure, it might sometimes, but others on this forum have found instances where it is wrong or nonsensical. As @studiot says, it is language model. As such it is not well adapted for mathematical science. You asked if it is reliable, and the answer is evidently no it isn't. Thanks and I agree that CHATGPT is a language model. How many know what that means ? However I think @swansont deserves the credit for the quote here.
swansont Posted October 9, 2023 Posted October 9, 2023 It’s not hard to find examples of ChatGPT giving wrong math/science answers. GPT stands for Generative Pre-trained Transformer, which is, as I said, a language model. ChatGPT is designed to generate answers that sound human. https://finance.yahoo.com/news/over-just-few-months-chatgpt-232905189.html “Over the course of the study researchers found that in March GPT-4 was able to correctly identify that the number 17077 is a prime number 97.6% of the times it was asked. But just three months later, its accuracy plummeted a lowly 2.4%.” https://news.asu.edu/20230221-discoveries-do-math-chatgpt-sometimes-cant-expert-says “Our initial tests on ChatGPT, done in early January, indicate that performance is significantly below the 60% accuracy for state-of-the-art algorithm for math word problem-solvers,” Also “It’s designed around a concept called next word prediction, where for when you ask it something, it’s going to predict what the related words are based on a corpus (text and speech) data.” 1
studiot Posted October 9, 2023 Posted October 9, 2023 I posted this excerpt from ellenberg whcih explains the essence of language models.
iNow Posted October 9, 2023 Posted October 9, 2023 It depends on the dataset used to train the model and how the question is asked
exchemist Posted October 10, 2023 Posted October 10, 2023 13 hours ago, studiot said: Thanks and I agree that CHATGPT is a language model. How many know what that means ? However I think @swansont deserves the credit for the quote here. Oops, sorry and sorry to @swansont - I must be getting senile. 😄
Brainee Posted October 10, 2023 Author Posted October 10, 2023 What is a suitable search engine for science and mathematics?
swansont Posted October 10, 2023 Posted October 10, 2023 Wolfram alpha can do computations, including topic-specific applications https://www.wolframalpha.com
Brainee Posted October 11, 2023 Author Posted October 11, 2023 I would like site which explains science and mathematics not one that does computations for you.
Endy0816 Posted October 11, 2023 Posted October 11, 2023 Kahn Academy is good. https://www.khanacademy.org/ Covers a wide range.
iNow Posted November 30, 2023 Posted November 30, 2023 On 10/9/2023 at 5:19 PM, studiot said: I posted this excerpt from ellenberg whcih explains the essence of language models. You might enjoy this if you’ve got an hour free:
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now