Agree, I have them curated lessons.md anytime they make a mistake and have found that to be highly effective. Every now and then a lesson goes defunct and needs pruned, but I think that’s just part of the new swe skill set.

Some of this does not line up with my lived experience pretty starkly.

Repo level markdown files with architectural guidance not working for example… I’ve found that works quite well.

Not perfectly well, but llms are designed specifically NOT to be perfect deterministic executioners. Still though, pretty well.

I have seen that in a jr engineers hands llms get to bad outcomes fast, and unintuitively (to leaders…) usage of llms in coding does not provide a path for a he engineer to upskill into a sr engineer. A sr engineer with llms though is almost always radically augmented regarding their output speed on task completion.