5 Commits (main)

Author	SHA1	Message	Date
Laurel Orr	8548329be9	feat: added run_chat for chat models (#88)	1 year ago
Laurel Orr	db963cf4a7	fix: added client pool support (#81) ... * fix: added client pool support * Added async across client pool	1 year ago
Laurel Orr	c4ad007f02	feat: support token_logprobs (#59)	1 year ago
Laurel Orr	8ced666df8	fix: add dtype to cache (#52)	1 year ago
Laurel Orr	876d27bd2d	feat: toma diffusers support (#48)	1 year ago