 JustSong
|
cf6883778e
perf: use slice to improve efficiency (#57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
246b981e23
fix: fix "[DONE is not valid JSON" (#57)
|
%!s(int64=2) %!d(string=hai) anos |
 JustSong
|
2edd52e851
fix: fix Azure channel not working in stream mode (#57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
83e86b9f8a
feat: support specific default api version now (#57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
73aa53f536
fix: remove the dot in model name (#57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
44729da277
fix: provide a default value for api-version if not given (#57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
7a3378b4b7
feat: Azure API supported without verification (#48, #57)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
d9db16e999
feat: able to configure ratio for more models now (close #53)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
331177d97e
fix: return quota to user when delete token (close #37)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
7c66fc6c21
fix: shouldn't close c.Request.Body too soon (close #35)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
d93cb8f645
feat: able to configure ratio for different models (close #26)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
b08cd7e104
refactor: use tiktoken-go to calculate token number
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
aea6c859e7
fix: relay bug fix
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
480e789cd8
feat: support configuring ratio when estimating token number in stream mode
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
23ec541ba6
refactor: improve relay's implementation
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
053bb85a1c
feat: now use token as the unit of quota (close #33)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
601fa5cea8
refactor: use quota instead of times
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
109736cc05
fix: only reduce remain times when request `/v1/chat/completions` (close #15)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
69ee87c57f
fix: fully support stream mode now (close #3)
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
b74a17c963
fix: improve the implementation of sse
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
5d602e9b57
fix: fixing SSE support
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
16271e7813
fix: relay more headers
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
0198df5962
fix: only keep header Authorization & Content-Type
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
4c0dc50af0
fix: fix http2: invalid Connection request header: ["upgrade"]
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
b3be4d8f85
Support custom channel now
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
b86e1dec64
Fix "HTTP decompression failed"
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
279ae8ad50
Bug fix
|
%!s(int64=2) %!d(string=hai) anos |
|
JustSong
|
852af57c03
Relay done but not working
|
%!s(int64=2) %!d(string=hai) anos |
