 JustSong
|
0ba5ff9d42
feat: PaLM support is WIP (#105)
|
3 lat temu |
|
JustSong
|
05de29c830
feat: support channel ai.ls now (close #99)
|
3 lat temu |
 quzard
|
d15ca33175
fix: make the token number calculation more accurate (#101)
|
3 lat temu |
|
JustSong
|
9c5bc5120b
fix: add X-Accel-Buffering header on SSE response
|
3 lat temu |
|
JustSong
|
868a6ced8c
chore: rewrite 429 prompt text (close #96)
|
3 lat temu |
|
JustSong
|
8cd4e3faa4
fix: handel error response from server correctly (close #90)
|
3 lat temu |
|
JustSong
|
14bba55d28
fix: fix error log not recorded (close #83)
|
3 lat temu |
|
JustSong
|
f122a8c53d
fix: fix stream mode checking (#83)
|
3 lat temu |
|
JustSong
|
b77eb0c65d
perf: use max_tokens to reduce token consuming
|
3 lat temu |
|
JustSong
|
4a64fede39
feat: support max_tokens now (#52)
|
3 lat temu |
|
JustSong
|
146ab7d299
feat: able to set pre consumed quota now
|
3 lat temu |
|
JustSong
|
afbf20b5ba
fix: fix quota not consuming
|
3 lat temu |
|
JustSong
|
f43a810e8d
feat: automatically disable channel when error occurred (#59)
|
3 lat temu |
|
JustSong
|
4f1f170fb9
fix: remove version suffix for Azure (close #67)
|
3 lat temu |
|
JustSong
|
d0d3142edb
feat: able to test channels now (#59)
|
3 lat temu |
|
JustSong
|
511cbc117e
perf: use slice to improve efficiency (#57)
|
3 lat temu |
|
JustSong
|
05e460d9f8
fix: fix "[DONE is not valid JSON" (#57)
|
3 lat temu |
 JustSong
|
1507dd0104
fix: fix Azure channel not working in stream mode (#57)
|
3 lat temu |
|
JustSong
|
9ed9eaa65f
feat: support specific default api version now (#57)
|
3 lat temu |
|
JustSong
|
b4bfc95297
fix: remove the dot in model name (#57)
|
3 lat temu |
|
JustSong
|
479ccebedb
fix: provide a default value for api-version if not given (#57)
|
3 lat temu |
|
JustSong
|
d97d50b14c
feat: Azure API supported without verification (#48, #57)
|
3 lat temu |
|
JustSong
|
049a6def02
feat: able to configure ratio for more models now (close #53)
|
3 lat temu |
|
JustSong
|
7bd4c0e490
fix: return quota to user when delete token (close #37)
|
3 lat temu |
|
JustSong
|
36605cf095
fix: shouldn't close c.Request.Body too soon (close #35)
|
3 lat temu |
|
JustSong
|
033e832cae
feat: able to configure ratio for different models (close #26)
|
3 lat temu |
|
JustSong
|
84c7ae8ad1
refactor: use tiktoken-go to calculate token number
|
3 lat temu |
|
JustSong
|
52877f99e8
fix: relay bug fix
|
3 lat temu |
|
JustSong
|
0760dcf6cc
feat: support configuring ratio when estimating token number in stream mode
|
3 lat temu |
|
JustSong
|
52e92554ac
refactor: improve relay's implementation
|
3 lat temu |
