Ok, wow, consider me impressed. Been using llama.cpp with a quantized model to try and generate code.

The code it generates is generally incomprehensible, but the functions and broad patterns it suggests are generally actually pretty useful.

(Here the code snippet for loop is missing a do, but this was good enough to get me going --- I haven't written elisp in a while, and I had forgotten the idioms myself).

And it generates this soo quickly. What I'd typically do with a web-query, I think I can probably now outsource to just a local one.