 Lengyue
|
5f01798ab4
Fix non-inf gradient
|
2 éve |
|
Lengyue
|
2a19adb045
Fix grad acc loss
|
2 éve |
|
Lengyue
|
8f75f764ad
Fix incorrect batch time
|
2 éve |
|
Lengyue
|
5f07060c6a
Optimize training loop
|
2 éve |
|
Lengyue
|
5d65ec0bd5
fix typo
|
2 éve |
|
Lengyue
|
b6b478701a
Rename dataloader to add support for valid loader
|
2 éve |
|
Lengyue
|
fb23d5df2d
Better train loop tracking
|
2 éve |
|
Lengyue
|
3fc0a688ca
Update Readme
|
2 éve |
|
Lengyue
|
9beb5981ec
Remove unused ds config
|
2 éve |
|
Lengyue
|
d211a7eac7
Better ETA
|
2 éve |
|
Lengyue
|
2733ed600f
Accelerate training with fsdp
|
2 éve |
|
Lengyue
|
01cf9bbafd
Fix dataset and training loop
|
2 éve |
|
Lengyue
|
712908e673
Support stream reading
|
2 éve |
|
Lengyue
|
e01dd330a1
optimize InterleaveDataset
|
2 éve |
|
Lengyue
|
0282451dff
fix scheduler
|
2 éve |
|
Lengyue
|
7650b2ac43
Update much robust dataloader
|
2 éve |
|
Lengyue
|
60ac11d7fe
Update deps
|
2 éve |
|
Lengyue
|
bce1f85209
Faster schedule
|
2 éve |
|
Lengyue
|
d28ba743d3
Fix quantizer norm
|
2 éve |
|
Lengyue
|
0dae48d2dc
Fix model training mode
|
2 éve |
|
Lengyue
|
0b5216ef0e
Fix hubert config
|
2 éve |
|
Lengyue
|
3297b2dc2c
Add hubert vq training
|
2 éve |
|
Lengyue
|
311a8b64ea
Add hubert dataset and hubert model
|
2 éve |
|
Lengyue
|
c88bf969b1
Update gitignore
|
2 éve |
|
Lengyue
|
70797ef7d5
Add dockerignore
|
2 éve |
|
Lengyue
|
900fc9dec9
Optimize data loading & gradient accumulate
|
2 éve |
|
Lengyue
|
026d419e9a
Fix logger in config
|
2 éve |
|
Lengyue
|
a0a5c3e95c
Update training script
|
2 éve |
|
Lengyue
|
db347ca973
Add llm exp code
|
2 éve |
|
Lengyue
|
9adf687fb1
Update base training code
|
2 éve |
