Server/fish-speech @ 9beb5981ecbf2b964e39dc1809b6d05a94bb9799

Sen descrición

Lengyue 9beb5981ec Remove unused ds config		%!s(int64=2) %!d(string=hai) anos
preparing_data	9adf687fb1 Update base training code	%!s(int64=2) %!d(string=hai) anos
speech_lm	d211a7eac7 Better ETA	%!s(int64=2) %!d(string=hai) anos
.dockerignore	70797ef7d5 Add dockerignore	%!s(int64=2) %!d(string=hai) anos
.gitignore	7650b2ac43 Update much robust dataloader	%!s(int64=2) %!d(string=hai) anos
.pre-commit-config.yaml	e4ce816175 Update deps	%!s(int64=2) %!d(string=hai) anos
.project-root	aa0a6be778 init training code	%!s(int64=2) %!d(string=hai) anos
README.md	e4ce816175 Update deps	%!s(int64=2) %!d(string=hai) anos
dockerfile	7650b2ac43 Update much robust dataloader	%!s(int64=2) %!d(string=hai) anos
requirements.txt	2733ed600f Accelerate training with fsdp	%!s(int64=2) %!d(string=hai) anos
setup.py	7650b2ac43 Update much robust dataloader	%!s(int64=2) %!d(string=hai) anos
train.sh	a0a5c3e95c Update training script	%!s(int64=2) %!d(string=hai) anos

		
				README.md
			
				Speech LLM

Setup

# Basic environment setup
conda create -n speech-llm python=3.10
conda activate speech-llm
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

# Install requirements
pip3 install -r requirements.txt

# Install flash-attn
MAX_JOBS=4 pip install flash-attn --no-build-isolation