On Wed, Apr 09, 2025 at 01:21:06PM -0500, John Foust via cctalk wrote:
At 12:39 PM 4/9/2025, Bill Gunshannon via cctalk
wrote:
I'll continue to play with it but my initial
reactions still stand.
No sign of intelligence and not ready for prime-time.
What did you ask it to do? Exactly, I mean? When it didn't give you
the answer you wanted, what did you say next?
Because LLMs are - grossly simplified - regexes & Markov chains on
steroids and meth. They are massively scaled up pattern matching
systems and while there are plenty of use cases where this can, in
fact be quite useful (e.g. when the job is, indeed, pattern matching
such as image recognition, feature extraction from still/moving images
etc[0]), they DO NOT THINK.
It would not surprise me if comp-sci departments now offer a major
in writing GPT queries.
Thus making the "You don't need to understand anything, just be able
to bullshit your way along is good enough" approach official. GPT
and friends will cheerfully emit bullshit[1]. Among the more newsworthy
examples are lawyers having LLMs write the papers for cases where
the LLM (aka bullshit generator) happily cited non-existing precedent
cases to support their argument - with the lawyers being scolded by the
very irritated judge and the lawyers (yes, plural, of course this
happened more than once) IIRC facing disbarment for this.
Today's AI wranglers might be writing queries that
range from a few
words to a many pages of text. They're also having a conversation
with it to refine their query. It's more than
google.com circa 2005.
Many of us spent years learning how to get better results from Google
more often, after all.
I don't have a problem with skepticism about it. Call it a parlor trick
all day long, tell me it's not *truly* intelligent, but you should also
examine it enough to get to the point where you'll say "that's truly an
amazing and perhaps sometimes very useful parlor trick."
Yes, right until it tells you to put glue into the spaghetti sauce.
Kind regards,
Alex.
[0] Swiss Railways (SBB) uses an "AI" (read: oversold pattern matcher)
to detect and identify railway carriage wheel damage based on the
noises this damage causes when a train is running over the rails.
They trained it with carefully curated data sets and it apparently
works _very_ well. The alternative would be manual inspection of
these wheels, which due to scale, is just not doable with a useful
level of coverage.
[1] See Harry Frankfurt: On Bullshit
--
"Opportunity is missed by most people because it is dressed in overalls and
looks like work." -- Thomas A. Edison