 PoTaTo
|
781bf1cd7a
Finetune support of OpenAudio-S1 (#1115)
|
hai 5 meses |
|
PoTaTo
|
dbec3212ef
Remove unused code. (#1016)
|
hai 10 meses |
 Lengyue
|
c9209e94d9
support finetuning
|
hai 1 ano |
|
Leng Yue
|
5e7914472f
This PR brings V1.2 inference into main (#300)
|
hai 1 ano |
|
Lengyue
|
467b7beb56
Support lora tuning & update document
|
hai 1 ano |
|
Lengyue
|
39a79a2c98
Optimize loss sync
|
hai 1 ano |
|
Lengyue
|
1d4b7256b3
Optimize pretrain & finetune receipe, apply better logger
|
hai 1 ano |
|
Lengyue
|
26af12b8c6
Make AR and naive decoder configurable
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
0a1986bb14
Fix data leaking
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
cbab5b8ec8
Fix label rotating
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
7a31b4043a
Fix target rotate
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
5bd88b131e
Add additional metrics
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
8f9299673d
Fix weight decay config
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
0e0332396f
optimize dpo behavior
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
8093258065
Optimize lora & add auto dpo training
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
7ac4d4b918
Add neft and save lora only
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
83582d1e89
Update dataloader, loss tracker, and config
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
cdecc2abbc
Add lora support
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
dcc5e80ce2
Add flash attention & gradient checkpointing
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
9ac8edef1e
Support mix codebook training
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
4b22991668
Implement parallel decoding llama
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
895ed8e748
Add new text to semantic model
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
a03b1b2767
Optimize logger & add multilingual data
|
%!s(int64=2) %!d(string=hai) anos |
|
Lengyue
|
f7f2c03282
Support pytorch lightning
|
%!s(int64=2) %!d(string=hai) anos |
