Private LLM - Local AI Chatbot App-Rezensionen

I do think it’s pretty good, but maybe you could make a smarter Chatbot or the option to install 7B models or something similar. But other than that I was waiting for this for a while now. Hopefully it can improve over time… I really recommend the 3b model “RedPajama- chat 3b” it’s a really good one..

But it hallucinates a lot. Or it doesn't answer my question.

This app is more like a proof of concept than a useful assistant, but that’s perfectly fine. Such a small model run locally doesn’t pack much of a punch, but the fact that it is even possible, is awesome. I am really excited for future updates and additional features.

The concept is cool and it works really great. But please add a true uncensored model because both models provided refuse to answer many prompts just like chatgpt does. Otherwise if you could provide uncensored models the app would be a solid 5 Stars. So in v1.5 the 7B Mistral OpenOrca model is still censored. It is ok to have LLMs that are appropriate for all audiences but please put a trully uncensored LLM if one even exists.

Please add an option to add the MoE Mixtral 8x7B.

Doesn't allow to download and install certain modells, because I have the wrong hardware, despite these modells running fine in Jan.ai and FreeChat.