Commit History

Autor SHA1 Mensaxe Data
  Lengyue 26af12b8c6 Make AR and naive decoder configurable %!s(int64=2) %!d(string=hai) anos
  Lengyue 3d002fd18b Optimize amp training %!s(int64=2) %!d(string=hai) anos
  Lengyue 87ca8cf62e Rollback decoding %!s(int64=2) %!d(string=hai) anos
  Lengyue 6e67ebda73 Optimize training speed by skip unused decode %!s(int64=2) %!d(string=hai) anos
  Lengyue 0a1986bb14 Fix data leaking %!s(int64=2) %!d(string=hai) anos
  Lengyue 362a1a7116 Update dual ar generate & config %!s(int64=2) %!d(string=hai) anos
  Lengyue 9e1a9debfd fix bug & implement generate %!s(int64=2) %!d(string=hai) anos
  Lengyue 7a31b4043a Fix target rotate %!s(int64=2) %!d(string=hai) anos
  Lengyue 0855b454e4 Add VITS vq %!s(int64=2) %!d(string=hai) anos
  Lengyue cecee062c4 Remove flash attn deps as PyTorch ships in 2.2.0 %!s(int64=2) %!d(string=hai) anos
  Lengyue 415c78a7d4 Disable neft on eval %!s(int64=2) %!d(string=hai) anos
  Lengyue f5a2df2d23 Add 4 in 8 out support %!s(int64=2) %!d(string=hai) anos
  Lengyue 8093258065 Optimize lora & add auto dpo training %!s(int64=2) %!d(string=hai) anos
  Lengyue 7ac4d4b918 Add neft and save lora only %!s(int64=2) %!d(string=hai) anos
  Lengyue 39f6902119 Add dropout options to optimize overfitting %!s(int64=2) %!d(string=hai) anos
  Lengyue 2919eafd19 Disable flash attention 2 by default %!s(int64=2) %!d(string=hai) anos
  Lengyue dcc5e80ce2 Add flash attention & gradient checkpointing %!s(int64=2) %!d(string=hai) anos
  spicysama 06a35aef53 add fastapi for inference (#12) %!s(int64=2) %!d(string=hai) anos
  Lengyue c583555995 Add half precision inference and document %!s(int64=2) %!d(string=hai) anos
  Lengyue 9649873532 Update generate examples %!s(int64=2) %!d(string=hai) anos
  Lengyue 9ac8edef1e Support mix codebook training %!s(int64=2) %!d(string=hai) anos
  Lengyue 62710e34a4 Add llama inference tool chain %!s(int64=2) %!d(string=hai) anos
  Lengyue 4b22991668 Implement parallel decoding llama %!s(int64=2) %!d(string=hai) anos
  Lengyue 25fce58cf6 Add llama implementation %!s(int64=2) %!d(string=hai) anos