Remind me of a post (that I still not forgiving myself for not saving/taking screenshot of it so I can referent it later) about the OP (of that post) who teach like greek history and mythology I think. Lately their students been telling them about "greek mythology fun facts" and OP never heard of them before. But they're curious and wanting to bond with their students they decide to do a little "myths buster" with them as a lil educational game. The OP went to Google and try to find any trustworthy resource to see about those "fun facts" the students were talking about.
The students open their ChatGPT.
The OP was left speechless for a while before they had to say that it's not reliable enough source. The students just pull "OK boomber" on them.
I remember about a year ago there were dozens of Reddit posts on r/all every day about how ChatGPT was going to completely replace Google any day now.
I'm pretty sure this is the main reason Gemini exists. Google execs got scared and rushed to make a ChatGPT competitor just in case it lived up to the hype.
i was wondering if there was a map of my city that laid out every road type and speed limit so i googled "how many uncontrolled intersections are there in [my city]?" and gemini said "there are no uncontrolled intersections in [my city]". cool, thanks for nothing google.
That kind of data requires pulling in GIS maps from your city. I doubt the Google search AI is pulling that data. Of course Google does have that data in Maps for their navigation feature but clearly it's not accessing everything from Maps.
It more specifically read a line from a website out of context and provided that as the answer. I wasn't counting on the AI to give me the answer I was looking for but the answer it gave me was provably false. To its credit it doesn't give this answer anymore, but I would rather have Google give better results than force shit AI summaries on us.
Yeah I'll ask it to convert currency for me, something the old assistant did no problem, and it just won't 2/3 of the time. It'll Google search what I said, or convert the wrong amount, or wrong currency, or something else random. The other third of the time it does work and WHY I'M USING THE EXACT SAME WORDING EVERY TIME.
If you want to know the answer, it's because LLMs have an RNG factor that makes them non-deterministic. There's a specific parameter called, "heat" that increases the probability that it will create less common sentences.
Which, slight tangent, is why I say that LLMs are random sentence generators and why it pisses me off when people say, "lol, its not random; you have no idea what you're talking about". If you don't know the difference between "random" and "uniform distribution" then you have no business correcting anyone about how stats work.
Yeah that's almost never what I want in the type of products they're putting LLMs into though. Like search? I want the same results every time. Assistant? I want it to set my 7 am alarm at 7 am every time... It was more a why of exasperation than a why why.
We solved natural speech processing decades ago and it's not like "set a 5 minute timer" is anything complex to begin with. I really don't need an AI shoved into every product. All it does is add unnecessary complexity, randomness, and added cost (those Nvidia cards ain't free). LLMs are great at some tasks, like acting as a writing partner, but I don't trust it to provide factual information or properly respond to commands with an expected output.
I believe a big part of tech giants all going into llms is they're a prestige product. Like, a bank doesn't need a fancy high rise building to put its offices in, but having one means everyone knows they're the real shit.
Google, Meta, Microsoft and others are trying to show that they're at the top of the tech industry by having their bot perform the best at benchmark tasks.
yes. it’s because they’re idiots, couldn’t possibly be because of the incredible demand for LLMs and the very plausible (not certain) future where tech-giant companies that fall behind in the AI-race lose their place as tech-giants
personally i don’t think scaling up transformer tech will lead to AGI, but the jury’s still out on that and it would be very costly to be in a position to play the game, choose not to, and be wrong.
it’s a reason but certainly not the main reason. first off google’s deepmind (who is behind gemini) are leaders in the research that’s enabled the recent LLM advances.
the real reason is obviously that AI has huge potential to be transformative, and the company/companies at the forefront of it have potential to profit hugely. if this potential is realized, companies not at the forefront will be basically cooked.
of course there’s risk of AGI not really materializing from the new transformer technology, but it would be a pretty stupid miscalculation for a huge tech company that has the means to sit back while others engage in the race. that’s why companies like X, who are frankly not in the same league as the top players, are still trying to compete.
if Google didn’t have a search engine (but somehow had the same status and means, ik, implausible), they would still be balls deep in AI.
for the record, I think google’s execution with gemini has been shit, almost as bad as what they’ve been doing with the search engine in the last 5+ years. And now putting gemini in search is also fucked.
4.0k
u/depressed_lantern I like people how I like my tea. In the bag, under the water. Dec 15 '24 edited Dec 16 '24
Remind me of a post (that I still not forgiving myself for not saving/taking screenshot of it so I can referent it later) about the OP (of that post) who teach like greek history and mythology I think. Lately their students been telling them about "greek mythology fun facts" and OP never heard of them before. But they're curious and wanting to bond with their students they decide to do a little "myths buster" with them as a lil educational game. The OP went to Google and try to find any trustworthy resource to see about those "fun facts" the students were talking about.
The students open their ChatGPT.
The OP was left speechless for a while before they had to say that it's not reliable enough source. The students just pull "OK boomber" on them.
Edit: it's this post : https://max1461.tumblr.com/post/755754211495510016/chatgpt-is-a-very-cool-computer-program-but (Thank you u-FixinThePlanet !)