On Sun, Feb 25, 2024 at 3:15 PM Just Kant via cctalk
<cctalk(a)classiccmp.org> wrote:
So the portions of code belonging to chatgpt which
produce the hallucinations have been isolated?
It's a massive deep neural network, so you can't really isolate
anything. But there are parameters that you can use to tune it, like
how quickly it forgets earlier parts of a conversation, etc. and some
people speculate that they tweaked something like that which resulted
in the recent issues.
Which languages were used to build it?
One could say Python, but that mostly sits on top of C++, which then
invokes CUDA (or TPU or similar) code, but at the bottom it's all just
matrix multiplication.
Polog and other Logic Programming tools aren't applicable to Machine
Learning approaches which is all anyone is interested in for "AI"
these days. If you want to make a rules-based expert system, and you
know what all the rules are, then Prolog might still be a useful tool.
Turbo Pascal is even still available as its originators took it back
from Borland and made it into Visual Prolog for Windows which has a
free personal edition (the commercial license is only 100 euros too).
Also there's GNU Prolog if you just want to futz around with Prolog.