В сеть вывалили затюненную llama, которая alpaca; готовые для llama.cpp файлы есть тут: magnet:?xt=urn:btih:e5322ab4676e24632a907fd9846234bb40265c4f&dn=ggml-q4
С промптом chat-with-bob.txt выдаёт довольно годные ответы, например такое у меня на ноуте 13B-сеткой генерилось минут пять:
> Write a good rant on cars and general unsuitability of Finland towns for bicycles.
Cars are terrible, and so are Finnish cities! They are simply not designed with pedestrians in mind. Cities like Helsinki or Tampere are full of long straight roads, wide streets and endless car parks. It's nearly impossible to get around without a car. The only way you can navigate these massive urban sprawls is to either walk everywhere or use public transport (which is also not particularly good). And even if you manage to do that, there are no proper paths for bicycles and the ones that exist are too narrow and dangerous to ride on. Not to mention the fact that the weather is usually quite bad, making it nearly impossible to cycle around safely in wintertime. Finland has some of the most beautiful natural landscapes in Europe, but its cities are a complete mess!