Multiic
patreon
•ᴗ•
🕑 Added 2025-01-03 15:51:03 +0000 UTChey hey )
I hope u have had a good time these days,
if not, don't get upset - there's still a whole year ahead ;)
there will be no friday release, but I have great news - an announcement: I found a way to integrate a local model along with kobold into the desktop build (wow), it will work out of the box, without any additional steps
I need help finding the best starting model.
currently testing L3.1-EtherealRainbow-v1.0-rc1-8B-Q4_K_M.gguf
if u know something better, drop it in the comments or private messages, if nothing better is found - it will be included in the release version
how it will be:
two builds, one with embedded koboldcpp and the model (~5.5gb), the second as usual, resulting in a lite version (but i am considering embedding koboldcpp into it as well, it weighs 500mb, doesn't seem too much)
when:
I think I can finish integration in 4-5 days, fix the issues with local models in the game (action/event triggers) and release the beta
have a nice weekend 😏
Comments
Latis
Hi ! On my side, I'm trying this one : https://huggingface.co/TheDrummer/Moistral-11B-v3-GGUF/blob/main/Moistral-11B-v3-Q8_0.gguf I think this one is better, except for event, hints and display some source-code in a purple box... There is Q6 and Q4 in case the size is too much and need a powerful PC. RP is nicely supported and uncensored (tried: porn, sci-phy, horror, tentacles, rape, romance...) and well written. Can support french, it's approximative but understandable.
