I think the article undersells the problems of ChatGPT’s hallucinations. One example from the article where ChatGPT is said to win is a recipe for risotto. However, I wouldn’t follow a risotto recipe for ChatGPT just because I can’t be confident it hasn’t hallucinated some portion of the recipe but would happily follow one from Google, even if the format is a bit more annoying. Same issue with calculating load bearing capacity for a beam only more serious!
Having said that, it does seem like there are definitely specific areas where ChatGPT will be more useful. Coding is a good example as verifying the code is usually straightforward and/or would need to be done anyway. In many cases ChatGPT for an overview followed by Google for more detail/verification is probably a good way to go—I think this would be a good idea for the load bearing wall example.
Recipe, no. Flavoring/seasoning combo or pairing ideas: absolutely. I’ve gotten some good ones for some unusual ingredients I happened to have recently. And yes, GPT-4 is noticeably better at coming up with actually tasty non-traditional recommendations.
However, I wouldn’t follow a risotto recipe for ChatGPT just because I can’t be confident it hasn’t hallucinated some portion of the recipe but would happily follow one from Google, even if the format is a bit more annoying.
I agree. I can also confirm that ChatGPT is indeed making stuff up even in the recipe linked in the article: the traditional risotto recipe used in Italy doesn’t include garlic.
I think the article undersells the problems of ChatGPT’s hallucinations. One example from the article where ChatGPT is said to win is a recipe for risotto. However, I wouldn’t follow a risotto recipe for ChatGPT just because I can’t be confident it hasn’t hallucinated some portion of the recipe but would happily follow one from Google, even if the format is a bit more annoying. Same issue with calculating load bearing capacity for a beam only more serious!
Having said that, it does seem like there are definitely specific areas where ChatGPT will be more useful. Coding is a good example as verifying the code is usually straightforward and/or would need to be done anyway. In many cases ChatGPT for an overview followed by Google for more detail/verification is probably a good way to go—I think this would be a good idea for the load bearing wall example.
Recipe, no. Flavoring/seasoning combo or pairing ideas: absolutely. I’ve gotten some good ones for some unusual ingredients I happened to have recently. And yes, GPT-4 is noticeably better at coming up with actually tasty non-traditional recommendations.
I agree. I can also confirm that ChatGPT is indeed making stuff up even in the recipe linked in the article: the traditional risotto recipe used in Italy doesn’t include garlic.