|
|
@@ -26,5 +26,11 @@
|
|
|
- [qwen2_5vl_lora_dpo](https://github.com/hiyouga/LLaMA-Factory/blob/main/examples/README_zh.md#%E5%A4%9A%E6%A8%A1%E6%80%81-dpoorposimpo-%E8%AE%AD%E7%BB%83)
|
|
|
- [qwen2_5vl_full_sft](https://github.com/hiyouga/LLaMA-Factory/blob/main/examples/README_zh.md#%E5%A4%9A%E6%A8%A1%E6%80%81%E6%8C%87%E4%BB%A4%E7%9B%91%E7%9D%A3%E5%BE%AE%E8%B0%83-1)
|
|
|
|
|
|
-## 1.9 API推理
|
|
|
+## 1.9 llamafactory部署
|
|
|
+- [llamafactory仓库](https://github.com/hiyouga/LLaMA-Factory)
|
|
|
+- [llamafactory文档](https://llamafactory.readthedocs.io/zh-cn/latest/)
|
|
|
+- [llamafactory部署](https://llamafactory.readthedocs.io/zh-cn/latest/getting_started/inference.html)
|
|
|
+- API_PORT=8000 CUDA_VISIBLE_DEVICES=0 llamafactory-cli api examples/inference/qwen2_5vl.yaml
|
|
|
+
|
|
|
+## 1.10 api推理
|
|
|
- python src/preprocess/qw_api_url_inference.py --input data/user_info_format_test.csv --output_file eval.csv
|
jch