This is Part 2 of my series on building a Local AI Developer Stack. If you missed the initial setup guide, you can read it here but I warn you that it might be already obsolete: The Local AI Developer (Part 1).
It has been two months since I published that initial guide. The setup in Part 1 looked great and promising on day one, so I decided to use it daily to give it a test in real-world conditions.
Here is a reality check of what works, what doesn't, and the optimizations required to make it truly usable.
Reality Check
I have tried my setup with different agents, LLMs, and combinations, but to be honest, it was hard to make it work as expected right out of the box. These were the main struggles:
