Commit Graph

29 Commits

Author SHA1 Message Date
Sarah Wooders
8260e27ba5
feat: Ollama embeddings api + Ollama tests (#1433)
Co-authored-by: Krishna Mandal <krishna@mandal.us>
2024-06-04 20:49:20 -07:00
Sarah Wooders
8fb2b618b1
feat: split up endpoint tests (#1432)
Co-authored-by: cpacker <packercharles@gmail.com>
2024-06-04 19:03:38 -07:00
Charles Packer
a86374b464
ci: update workflows (add autoflake and isort) (#1300) 2024-04-27 11:54:34 -07:00
Charles Packer
eaed123af8
chore: run autoflake + isort (#1279) 2024-04-20 11:40:22 -07:00
Charles Packer
bd84f7c1dd
ci: patch embedding issue in tests (#1096) 2024-03-05 13:52:54 -08:00
thefux
47b529966c
fix: huggingface embeddings dependency (#1087)
Co-authored-by: Abderrahmen Rakez <a.rakez@envisia.de>
Co-authored-by: sarahwooders <sarahwooders@gmail.com>
Co-authored-by: cpacker <packercharles@gmail.com>
2024-03-04 17:21:07 -08:00
tombedor
9681a60bc9
fix: configure black (#1072) 2024-02-29 15:19:08 -08:00
Sarah Wooders
38c184caf8
feat: refactor loading and attaching data sources, and upgrade to llama-index==0.10.6 (#1016) 2024-02-18 16:57:01 -08:00
Adam
75825c6eb4
fix: Resolved a TypeError preventing documents from loading into storage (#928) 2024-01-24 16:27:27 -08:00
Charles Packer
6f5da1a5c9
fix: resolve fatal attribute errors in pyright (#917) 2024-01-23 20:33:58 -08:00
Sarah Wooders
cca9b38294
feat: Store embeddings padded to size 4096 to allow DB storage of varying size embeddings (#852)
Co-authored-by: cpacker <packercharles@gmail.com>
2024-01-19 16:03:13 -08:00
Charles Packer
e4fab1653e
refactor: remove User LLM/embed. defaults, add credentials file, add authentication option for custom LLM backends (#835) 2024-01-18 16:11:35 -08:00
Sarah Wooders
6376e4fb3b
feat: Add paginated memory queries (#825)
Co-authored-by: cpacker <packercharles@gmail.com>
2024-01-15 21:21:58 -08:00
Jim Lloyd
c8dd1152dc
fix: Fix load bug (#795)
Co-authored-by: Charles Packer <packercharles@gmail.com>
2024-01-11 23:05:43 -08:00
Sarah Wooders
8c06cc4bf7
refactor!: Migrate users + agent information into storage connectors (#785)
Co-authored-by: cpacker <packercharles@gmail.com>
2024-01-08 15:59:49 -08:00
cpacker
d9ed2df772 clean up the error messages stemming from a badly configured endpoint (bad url, url is none, etc) 2024-01-02 13:28:06 -08:00
Charles Packer
d6a56b262e
Merge branch 'main' into cherry-pick-storage-refactor 2023-12-30 21:38:58 -08:00
Charles Packer
a3e94ae19e
fix: patch TEI error in load (#725)
* patch TEI error in load (now get different error)

* more hiding of MOCKLLM

* fix embedding dim

* refactored bandaid patches into custom embedding class return object patch
2023-12-27 22:09:29 -08:00
Sarah Wooders
1c018cc14e Add more compehensive tests, make row ids be strings (not integers) 2023-12-26 17:05:58 +04:00
Charles Packer
b8b375d663
Patch azure embeddings + handle azure deployments properly (#594)
* Fix bug where embeddings endpoint was getting set to deployment, upgraded pinned llama-index to use new version that has azure endpoint

* updated documentation

* added memgpt example for openai

* change wording to match configure
2023-12-08 16:31:43 -08:00
Sarah Wooders
2adc75d10b
Remove usage of BACKEND_TYPE (#539) 2023-11-30 14:18:25 -08:00
Charles Packer
bc0c1e4a37
Remove openai package and migrate to requests (#534) 2023-11-30 13:00:13 -08:00
Sarah Wooders
e24a1a3908
Add user field for vLLM endpoint (#531) 2023-11-29 12:30:42 -08:00
Sarah Wooders
febc7344c7
Add support for HuggingFace Text Embedding Inference endpoint for embeddings (#524) 2023-11-27 16:28:49 -08:00
Sarah Wooders
28514da5df
Refactor config + determine LLM via config.model_endpoint_type (#422)
* mark depricated API section

* CLI bug fixes for azure

* check azure before running

* Update README.md

* Update README.md

* bug fix with persona loading

* remove print

* make errors for cli flags more clear

* format

* fix imports

* fix imports

* add prints

* update lock

* update config fields

* cleanup config loading

* commit

* remove asserts

* refactor configure

* put into different functions

* add embedding default

* pass in config

* fixes

* allow overriding openai embedding endpoint

* black

* trying to patch tests (some circular import errors)

* update flags and docs

* patched support for local llms using endpoint and endpoint type passed via configs, not env vars

* missing files

* fix naming

* fix import

* fix two runtime errors

* patch ollama typo, move ollama model question pre-wrapper, modify question phrasing to include link to readthedocs, also have a default ollama model that has a tag included

* disable debug messages

* made error message for failed load more informative

* don't print dynamic linking function warning unless --debug

* updated tests to work with new cli workflow (disabled openai config test for now)

* added skips for tests when vars are missing

* update bad arg

* revise test to soft pass on empty string too

* don't run configure twice

* extend timeout (try to pass against nltk download)

* update defaults

* typo with endpoint type default

* patch runtime errors for when model is None

* catching another case of 'x in model' when model is None (preemptively)

* allow overrides to local llm related config params

* made model wrapper selection from a list vs raw input

* update test for select instead of input

* Fixed bug in endpoint when using local->openai selection, also added validation loop to manual endpoint entry

* updated error messages to be more informative with links to readthedocs

* add back gpt3.5-turbo

---------

Co-authored-by: cpacker <packercharles@gmail.com>
2023-11-14 15:58:19 -08:00
Sarah Wooders
4f781b4e4c
Always default to local embeddings if not OpenAI or Azure (#387) 2023-11-08 21:35:48 -08:00
Sarah Wooders
e2a685acba
Specify model inference and embedding endpoint separately (#286) 2023-11-06 17:19:45 -08:00
Sarah Wooders
2492db6b59
VectorDB support (pgvector) for archival memory (#226) 2023-11-03 16:19:15 -07:00
Sarah Wooders
b7f9560bef
Refactoring CLI to use config file, connect to Llama Index data sources, and allow for multiple agents (#154)
* Migrate to `memgpt run` and `memgpt configure` 
* Add Llama index data sources via `memgpt load` 
* Save config files for defaults and agents
2023-10-30 16:47:54 -07:00