 JustSong
|
511cbc117e
perf: use slice to improve efficiency (#57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
05e460d9f8
fix: fix "[DONE is not valid JSON" (#57)
|
%!s(int64=3) %!d(string=hai) anos |
 JustSong
|
1507dd0104
fix: fix Azure channel not working in stream mode (#57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
9ed9eaa65f
feat: support specific default api version now (#57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
b4bfc95297
fix: remove the dot in model name (#57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
479ccebedb
fix: provide a default value for api-version if not given (#57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
d97d50b14c
feat: Azure API supported without verification (#48, #57)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
049a6def02
feat: able to configure ratio for more models now (close #53)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
7bd4c0e490
fix: return quota to user when delete token (close #37)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
36605cf095
fix: shouldn't close c.Request.Body too soon (close #35)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
033e832cae
feat: able to configure ratio for different models (close #26)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
84c7ae8ad1
refactor: use tiktoken-go to calculate token number
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
52877f99e8
fix: relay bug fix
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
0760dcf6cc
feat: support configuring ratio when estimating token number in stream mode
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
52e92554ac
refactor: improve relay's implementation
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
bcdfb7d0d9
feat: now use token as the unit of quota (close #33)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
aa18ac4864
refactor: use quota instead of times
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
b612efe349
fix: only reduce remain times when request `/v1/chat/completions` (close #15)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
541b9f2ed6
fix: fully support stream mode now (close #3)
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
2ed58bb0c0
fix: improve the implementation of sse
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
796cb86b58
fix: fixing SSE support
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
a8eacd331b
fix: relay more headers
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
7c0124451d
fix: only keep header Authorization & Content-Type
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
9001415948
fix: fix http2: invalid Connection request header: ["upgrade"]
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
32755d875a
Support custom channel now
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
d00968d0cd
Fix "HTTP decompression failed"
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
039301324f
Bug fix
|
%!s(int64=3) %!d(string=hai) anos |
|
JustSong
|
12aa6c352b
Relay done but not working
|
%!s(int64=3) %!d(string=hai) anos |
