Atinoda
2f8b2fe4bb
Update deployment parameters
...
- Remove compose `version`
- Update folder structure with
- `cache`
- `instruction-templates`
- Add examples for ROCM/AMD deployment
- Add examples for custom embedding configurations
3 weeks ago
Atinoda
0b6b7bc523
Update compose
3 months ago
Atinoda
6562cf0e16
Update config directories and compose example
...
Add `characters` directory to config
Remove softprompts from compose
10 months ago
Atinoda
b6b1ca1391
Implement per-extension initialisation
...
(Plansee)
10 months ago
Atinoda
56f068d4e8
Disable extensions folder mapping by default
12 months ago
Atinoda
19f9c1b1ac
Implement persistent extensions with optional runtime build
...
- Extensions are now explicitly copied from source to named volume
- Optional rebuild at runtime allows for extensions not present during build
- Closes #3
12 months ago
Atinoda
a0137d40b8
Refactor to pull Docker hub images
...
Also fixes `triton` dependency conflict
12 months ago
Atinoda
bd884491e4
Initial commit
1 year ago