 JustSong
|
3711f4a741
feat: support channel ai.ls now (close #99)
|
il y a 2 ans |
 quzard
|
7c6bf3e97b
fix: make the token number calculation more accurate (#101)
|
il y a 2 ans |
|
JustSong
|
2779d6629c
fix: add X-Accel-Buffering header on SSE response
|
il y a 2 ans |
|
JustSong
|
ced89398a5
chore: rewrite 429 prompt text (close #96)
|
il y a 2 ans |
|
JustSong
|
ceb289cb4d
fix: handel error response from server correctly (close #90)
|
il y a 2 ans |
|
JustSong
|
ad01e1f3b3
fix: fix error log not recorded (close #83)
|
il y a 2 ans |
|
JustSong
|
cc1ef2ffd5
fix: fix stream mode checking (#83)
|
il y a 2 ans |
|
JustSong
|
58fe923c85
perf: use max_tokens to reduce token consuming
|
il y a 2 ans |
|
JustSong
|
c9ac5e391f
feat: support max_tokens now (#52)
|
il y a 2 ans |
|
JustSong
|
4d6172a242
feat: able to set pre consumed quota now
|
il y a 2 ans |
|
JustSong
|
8afdc56b11
fix: fix quota not consuming
|
il y a 2 ans |
|
JustSong
|
a1f61384c5
feat: automatically disable channel when error occurred (#59)
|
il y a 2 ans |
|
JustSong
|
cc3072c4df
fix: remove version suffix for Azure (close #67)
|
il y a 2 ans |
|
JustSong
|
443a22b75d
feat: able to test channels now (#59)
|
il y a 2 ans |
|
JustSong
|
cf6883778e
perf: use slice to improve efficiency (#57)
|
il y a 2 ans |
|
JustSong
|
246b981e23
fix: fix "[DONE is not valid JSON" (#57)
|
il y a 2 ans |
 JustSong
|
2edd52e851
fix: fix Azure channel not working in stream mode (#57)
|
il y a 2 ans |
|
JustSong
|
83e86b9f8a
feat: support specific default api version now (#57)
|
il y a 2 ans |
|
JustSong
|
73aa53f536
fix: remove the dot in model name (#57)
|
il y a 2 ans |
|
JustSong
|
44729da277
fix: provide a default value for api-version if not given (#57)
|
il y a 2 ans |
|
JustSong
|
7a3378b4b7
feat: Azure API supported without verification (#48, #57)
|
il y a 2 ans |
|
JustSong
|
d9db16e999
feat: able to configure ratio for more models now (close #53)
|
il y a 2 ans |
|
JustSong
|
331177d97e
fix: return quota to user when delete token (close #37)
|
il y a 2 ans |
|
JustSong
|
7c66fc6c21
fix: shouldn't close c.Request.Body too soon (close #35)
|
il y a 2 ans |
|
JustSong
|
d93cb8f645
feat: able to configure ratio for different models (close #26)
|
il y a 2 ans |
|
JustSong
|
b08cd7e104
refactor: use tiktoken-go to calculate token number
|
il y a 2 ans |
|
JustSong
|
aea6c859e7
fix: relay bug fix
|
il y a 2 ans |
|
JustSong
|
480e789cd8
feat: support configuring ratio when estimating token number in stream mode
|
il y a 2 ans |
|
JustSong
|
23ec541ba6
refactor: improve relay's implementation
|
il y a 2 ans |
|
JustSong
|
053bb85a1c
feat: now use token as the unit of quota (close #33)
|
il y a 2 ans |
