Commit Graph

115 Commits (main)
 

Author SHA1 Message Date
Laurel Orr bfbe3ef773
chore: update changelog (#119) 4 months ago
Laurel Orr c84b2fd10f
fix: pass do sample generation (#118) 4 months ago
Laurel Orr 637fb147f7
fix: return tokens as string hf api (#117) 4 months ago
Laurel Orr eb7e6faec7
add gpt4 turbo (#115) 4 months ago
Laurel Orr a657bdd2c2
bump pyversions (#116) 4 months ago
shubhaguha 533624f4fe
Added upper limit to pydantic version due to bug in latest version (#112)
* Restricted pydantic version <2.0

* Added OpenAI engine gpt-3.5-turbo-instruct
4 months ago
Laurel Orr a6a774bfb8
fix: handle none connectionstr (#110) 10 months ago
Laurel Orr d94101964f
fix: add gpt 16k (#109) 10 months ago
Laurel Orr 49f51952df
fix: dummy client to output tokens and random responses (#106) 10 months ago
Yuval b775d15f2e
fix: Updated AI21 models from J1 to J2 (#104)
also, added ai21 example to README

Co-authored-by: Yuval Belfer <yuvalb@ai21.com>
10 months ago
Laurel Orr fd7fbc9e35
fix: lru cache HF get model params (#105) 10 months ago
Laurel Orr b745617045
fix: add trust remote code HF models (#102) 11 months ago
Laurel Orr 7285fee140
chore: bump version (#101) 12 months ago
Laurel Orr ceb8676c33
chore: fix comments (#100) 12 months ago
Laurel Orr 6324e0fe43
feat: streaming support completions (#99) 12 months ago
Laurel Orr b52a4d9a4b
Laurel/more models (#98)
* fix: google models

* fix: azure models and refactor
12 months ago
Laurel Orr 4903c7e7e8
chore: bump version (#97) 12 months ago
Laurel Orr fd6e3d965b
Laurel/chatgpt hotfix (#96)
* fix: chatgpt hotfix

* chore: fix retry test
12 months ago
Laurel Orr 93ff2cb3c1
fix: chatgpt hotfix (#95) 12 months ago
Laurel Orr af23272cb5
fix: chatgpt hotfix (#94) 12 months ago
Laurel Orr 63943a5d3e
chore: bump version (#93) 12 months ago
Laurel Orr 147436c9b2
feat: unify run_chat and run (#92) 12 months ago
Laurel Orr 5ad4b017b5
wip: lore huggingface eval (#91) 12 months ago
Laurel Orr 97f3ec557b
chore: bump version (#89) 1 year ago
Laurel Orr 8548329be9
feat: added run_chat for chat models (#88) 1 year ago
Laurel Orr afe0fc5a1d
feat: added run_chat for chat models (#87) 1 year ago
Laurel Orr c0b4644a1c
chore: bump version (#86) 1 year ago
Laurel Orr e559c8fa59
fix: logprobs from openai (#85) 1 year ago
Laurel Orr d7401c6ec5
fix: added pydantic types to response (#84) 1 year ago
Laurel Orr 4602fb919b
chore: update readme (#82) 1 year ago
Laurel Orr db963cf4a7 fix: added client pool support (#81)
* fix: added client pool support

* Added async across client pool
1 year ago
Laurel Orr d375ef0c74 chore: bump version (#80) 1 year ago
Laurel Orr f2e6ec9984 chore: try catch around retry error (#77) 1 year ago
Laurel Orr 0fb192a0a2 feat: add local huggingface embedding models (#76) 1 year ago
Laurel Orr 40de0e7f59 feat: openai embedding support (#75) 1 year ago
Laurel Orr 693d105106 chore: bump version (#74) 1 year ago
Laurel Orr c7906bead5 fix: add retry to client for ratelimit (#73) 1 year ago
Laurel Orr ee9f16688e chore: reformat openaichat (#72) 1 year ago
Sasha Rush d7b83d94bd Update openaichat.py (#70)
Add gpt4 endpoints
1 year ago
Laurel Orr e4d3a57f92 fix: added openai usage back (#69) 1 year ago
Laurel Orr 395ac06a95 feat: async support, openai chatgpt, batch cache fix (#68) 1 year ago
Sabri Eyuboglu bed6773f75 Hash postgres keys to support long documents (#62)
* [WIP] Hash the cache key in postgres

* [WIP] Format
1 year ago
Sabri Eyuboglu e00d285e21 Add PostgreSQL cache (#53)
Add a Cache for PostgreSQL with GCP. 

Co-authored-by: Laurel Orr <lorr1@cs.stanford.edu>
1 year ago
Laurel Orr c4ad007f02 feat: support token_logprobs (#59) 1 year ago
Laurel Orr c6331770d4 chore: bump version (#57) 1 year ago
Laurel Orr ace3ad4324 chore: fix manifest imports (#56) 1 year ago
Laurel Orr 8ced666df8 fix: add dtype to cache (#52) 1 year ago
Laurel Orr e351bd5315 Update README.md citation 1 year ago
Laurel Orr 504e0e6cf1 chore: fix precommit (#51) 1 year ago
Laurel Orr 94b57a6e6f feat: remove choice logits and use prompt scoring (#50) 1 year ago