LLM’s overuse certain words in their conversations, each model has its favourite, but claude’s favourite one is “load-bearing”. It is as if it wants to be taken seriously or has “pondered” the problem deeply (it may or may not have) but wants to sound useful. It constantly prefixes “load-bearing” when you reframe a conversation or when presenting a conclusion. One wonders from where it got that. Did someone make it say that.
Agentic LLM's have changed what "code" means. It used be the end product of the software engineering lifecycle is "code" 📜 and there are purported arguments claiming that it is no more as LLM's themselves write "code". What remains is the spec as the "code" can be regenerated in N number of ways on demand. 🔨
Does that mean "code" is irrelevant and as long as you have a golden spec to derive "
Read more ...Stupid but confident stall vs the Intelligent but unconfident stall
LLMs are confident bullshitters. They speak “things” with a quite confident voice. But “things” are mostly word salad with looks quite like the answer but not entirely. In order to coax them to be useful you need to constantly refine their context i.e what they have seen recently to pull something more meaningful.
Here by memory I mean “context window size” though they are not equivalent.
And by “Intelligence” I don’t mean human intelligence which jumps into metaphysical debates. Perhaps “cognitive ability” to solve a task at hand is reasonable narrow definition.