I am an engineer and I have been involved with self learning system almost my entire professional career, from the first professional use of neural networks, over the time we called it machine learning, until now, when the world fell in love with its marketing name.
It is not intelligent, not by far. Most systems in use are just systems trying to “guess” the next word. They are very complex systems and when the model is trained with good data, it can output some cool stuff. But don’t forget, it all comes from data that was fed through its learning algorithms.
I have been testing models for a long time now and I am running more and more into their limitations. Just last week I uploaded an epub book that is still under copywrite protection (I own the book and the model does not store it, just uses the text within the confines of the session). The model was not initially trained on it. Then I started to ask questions about the characters in the book. I did not get any decent answer and I used the professional ChatGPT model to do it.
These systems give you bullshit answers with the confidence of a flat-earther wielding a high school diploma and a YouTube playlist. (Yep I used AI for this sentence as I could not find a good reference so quickly … and if you are a flat-earther, keep going strong my man)
There are now code generating AI platforms that have been trained with the data from GitHub and Stack Overflow. More and more of the code on these platforms is now AI generated, so future models are being trained on code that was not written by humans. And believe me there is some crap floating around there, first written by humans and now by AI.
Like with all complex systems, it is bullshit in, bullshit out. But people seem to trust these systems and its output more and more.
Another one of my pet peeves is context. AI is really bad at context. It takes everything at face value. You know the sayings about assumptions don’t you? And AI is proving that those are not wrong. Just have fun with letting it translate (something I know some of you are doing with whole texts, and that works as there is more context available from the start). But just type in a sentence in your native language, one that can have different meanings and let it translate. Then start to feed it more context, one step at the time. It is so much fun seeing it struggle and in the case of ChatGPT apologising over and over again.
Context is one of the most complex problems in human communication. It is know that it is impossible to formulate a thought and convey this to another person, being 100% sure that the whole message you tried to convey is understood. As humans we ask questions, show our emotions, have a conversation until we are confident the other has understood what we meant to say. A machine tries to do this in one go, and is really bad at it.
Also these systems are using more and more of our resources, they are already in the 1 or 2% of our global energy usage and it is climbing fast. And still, they are outputting a lot of crap. There is a limit on what they can do and we are starting to find out what those limits are.
Back to me. I do use AI and its ability to finish my sentences, or to rewrite some of my texts. I also use it to summarise. But I never use its first version because I have never trusted or even liked its initial output.
But to be clear, AI does not write my stories. I write them. I just use it to organise my thoughts, to rewrite my poorly formulated sentences, and yes sometimes I let it predict what will come next, certainly when I am stuck in a plot line.
I never liked my writing if I am honest, I don’t mean the stuff I am writing about, but more how it flowed on the paper. I could use a professional editor all the time, cleaning up after I formulated all of my ideas. Well AI helps me with that now, it makes my writing look good to me. I now can read them without feeling embarrassed, absolutely not the same level of some of you fine people here. But I am happy with it. Uh, I almost forgot to mention, the image I use as my avatar is AI generated too.

I am just throwing my thoughts out there, just let me know what you think.
p.s. I just made ChatGPT output a rape story without the filters trip, I added it to an other discussion on this board, you can find it here.