binarybeach/bb-plane-fork
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Integrates LiteLLM for Unified Access to Multiple LLM Models (#5925)

Browse source 
* adds litellm gateway

* Fixes repeating code

* Fixes error exposing

* Fixes error for None text

* handles logging exception

* Adds multiple providers support

* handling edge cases

* adds new envs to instance store

* strategy pattern for llm config

---------

Co-authored-by: akash5100 <akashzsh08@gmail.com>
This commit is contained in:
Akash Verma 2024-12-31 13:57:26 +05:30 • committed by GitHub
parent 752a27a175
commit 8833e4e23b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 172 additions and 75 deletions
Download patch file Download diff file Expand all files Collapse all files

2
apiserver/requirements/base.txt
View file

@ -37,7 +37,7 @@ uvicorn==0.29.0
# sockets
channels==4.1.0
# ai
openai==1.25.0
litellm==1.51.0
# slack
slack-sdk==3.27.1
# apm