AI in the form of LLM's and it their present state that are intended to generate code or assist with writing code allows me to produce garbage code at an unprecedented rate: I've become a 10x developer!! 😂
An incredible amount of editing is still required.
#TheRealityOfAI
Don't we all just enjoy fixing the bugs that were introduced by AI because it suggested code that looked correct. And yet, some subtle difference actually turned out to be a hallucination. Going through a piece of code with a range of bugs created by AI. What a nightmare! #TheRealityOfAI
I just removed 5 empty lines in a file to improve the code layout. Zero functional changes. Commit message suggestion by Copilot: "refactor AccountCommandService to use saveAccount method for persisting domain events and index accounts with SearchServiceAdapter" - #TheRealityOfAI
Tab programming at its finest. AI in a death spiral ..... I'm observing this multiple times a week. Sad! #TheRealityOfAI
How stupid: suggesting a method that is already there, even if it's the minimum. The AI should be aware there is a method of that name already and at best suggest changing it's implementation. #TheRealityOfAI
AI getting into the way with TDD: AI writes a test for the existing (minimal!) implementation which just throws an exception. This test would cast this in concrete instead of driving the correct implementation. This demonstrates that the AI doesn't "understand" the concept of TDD. #TheRealityOfAI
The "loop of death" increasingly becomes a common theme. Typically observed on interfaces, it also struggles to generate correct code for a constructor, despite that constructor being in the code based and imported. It just keeps making stuff up. (Copilot / GPT-4o / Agent Mode). #TheRealityOfAI
Only one way to make a worse suggestion: A function that generates purely random tokens. Here it suggests a non-existing identifier named "mockAlpaca" ... I can add it but expected the generated code to be correct in the first place..
AI forces me to clean up after it ... again.
#TheRealityOfAI
One thing I have learned while using LLM-based development tools: I can now create 10 times as much technical debt in the same time. (I don't take credit for that statement.)
In particular in Agent mode, the AI-based tool produces more code - including tech debt - even faster.
#TheRealityOfAI
Again, why would the AI suggest to call a non-existent method on a type? It has all the information it needs. A classic auto-suggest, auto-complete implementation easily does better.
I'd love for this work better as I want to make the tool work. It's just not that simple, though.
#TheRealityOfAI
Why would it suggest a return type in a typed language if all other functions in the code base have a return type?
Why doesn't it suggest to return a value if all other functions do that?
AI still has a long way ahead of it. #TheRealityOfAI
Mind you: The AI should "know" that I'm trying to update the account so the command should be "new AccountUpdateCommand()" which is already in the code base. The AI has no deeper understanding. Just probabilities of what could be the next token. #TheRealityOfAI
Spot the error .... The type parameter for the generic function call should be ".get<IAccountQueryService>()" not ".get<IAccountCommandService>()". As long as it gets simple things wrong like this, I am not concerned. Progress on the quality side has been flat in the last 6 months. #TheRealityOfAI
Why would it suggest an assertion for it being "defined" if the return type of create() rules out "undefined"? Again, the AI does not "understand" the concept of a type. As a result it makes a suggestion that makes no sense. #TheRealityOfAI
