Przeglądaj źródła

fix: update PromptTokens assignment logic in relay_responses

CaIon 6 miesięcy temu
rodzic
commit
eef73e3699
1 zmienionych plików z 1 dodań i 1 usunięć
  1. 1 1
      relay/channel/openai/relay_responses.go

+ 1 - 1
relay/channel/openai/relay_responses.go

@@ -109,7 +109,7 @@ func OaiResponsesStreamHandler(c *gin.Context, info *relaycommon.RelayInfo, resp
 	}
 	}
 
 
 	if usage.PromptTokens == 0 && usage.CompletionTokens != 0 {
 	if usage.PromptTokens == 0 && usage.CompletionTokens != 0 {
-		usage.PromptTokens = usage.CompletionTokens
+		usage.PromptTokens = info.PromptTokens
 	} else {
 	} else {
 		usage.TotalTokens = usage.PromptTokens + usage.CompletionTokens
 		usage.TotalTokens = usage.PromptTokens + usage.CompletionTokens
 	}
 	}