Commit Graph

33 Commits (main)

Author SHA1 Message Date
Jared Van Bortel 7e1e00f331
chat: fix issues with quickly switching between multiple chats (#2343)
* prevent load progress from getting out of sync with the current chat
* fix memory leak on exit if the LLModelStore contains a model
* do not report cancellation as a failure in console/Mixpanel
* show "waiting for model" separately from "switching context" in UI
* do not show lower "reload" button on error
* skip context switch if unload is pending
* skip unnecessary calls to LLModel::saveState

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
3 weeks ago
Jared Van Bortel c622921894
improve mixpanel usage statistics (#2238)
Other changes:
- Always display first start dialog if privacy options are unset (e.g. if the user closed GPT4All without selecting them)
- LocalDocs scanQueue is now always deferred
- Fix a potential crash in magic_match
- LocalDocs indexing is now started after the first start dialog is dismissed so usage stats are included

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
1 month ago
Adam Treat 17dee02287 Fix for issue #2080 where the GUI appears to hang when a chat with a large
model is deleted. There is no reason to save the context for a chat that
is being deleted.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
3 months ago
Jared Van Bortel 44717682a7
chat: implement display of model loading warnings (#2034)
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
3 months ago
Jared Van Bortel a0bd96f75d
chat: join ChatLLM threads without calling destructors (#2043)
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
3 months ago
Adam Treat d948a4f2ee Complete revamp of model loading to allow for more discreet control by
the user of the models loading behavior.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
3 months ago
Adam Treat 4461af35c7 Fix includes.
Signed-off-by: Adam Treat <treat.adam@gmail.com>
4 months ago
Gerhard Stein 3e99b90c0b Some cleanps 5 months ago
Adam Treat 371e2a5cbc LocalDocs version 2 with text embeddings. 7 months ago
Adam Treat f529d55380 Move this logic to QML. 7 months ago
Adam Treat 908aec27fe Always save chats to disk, but save them as text by default. This also changes
the UI behavior to always open a 'New Chat' and setting it as current instead
of setting a restored chat as current. This improves usability by not requiring
the user to wait if they want to immediately start chatting.
8 months ago
Cebtenzzre 2eb83b9f2a chat: report reason for fallback to CPU 8 months ago
Adam Treat 1fa67a585c Report the actual device we're using. 9 months ago
Adam Treat 9dccc96e70 Immediately signal when the model is in a new loading state. 11 months ago
Adam Treat 6d9cdf228c Huge change that completely revamps the settings dialog and implements
per model settings as well as the ability to clone a model into a "character."
This also implements system prompts as well as quite a few bugfixes for
instance this fixes chatgpt.
11 months ago
Adam Treat 64e98b8ea9 Fix bug with model loading on initial load. 11 months ago
Adam Treat 7f01b153b3 Modellist temp 11 months ago
Adam Treat c8a590bc6f Get rid of last blocking operations and make the chat/llm thread safe. 12 months ago
Adam Treat 7d2ce06029 Start working on more thread safety and model load error handling. 12 months ago
Adam Treat a3a6a20146 Don't store db results in ChatLLM. 12 months ago
AT 2b6cc99a31
Show token generation speed in gui. (#1020) 12 months ago
Adam Treat 9f590db98d Better error handling when the model fails to load. 1 year ago
Adam Treat 28944ac01b Fix for stale references after we regenerate. 1 year ago
Adam Treat aea94f756d Better name for database results. 1 year ago
Adam Treat f62e439a2d Make localdocs work with server mode. 1 year ago
Adam Treat b5380c9b7f Adds the collections to serialize and implement references for localdocs. 1 year ago
Adam Treat 01b8c7617f Add more of the UI for selecting collections for chats. 1 year ago
Adam Treat c800291e7f Add prompt processing and localdocs to the busy indicator in UI. 1 year ago
Adam Treat 7e42af5f33 localdocs 1 year ago
Adam Treat ddc24acf33 Much better memory mgmt for multi-threaded model loading/unloading. 1 year ago
Adam Treat 2989b74d43 httpserver 1 year ago
Adam Treat 76675536b0 Cleanup the chatllm properly. 1 year ago
Adam Treat 6015154bef Moving everything to subdir for monorepo merge. 1 year ago