Server/fish-speech @ 4cfb62a08af28a62aaafef435a7c3576f653b2b1

Nav apraksta

9 Atzari

Lengyue 4cfb62a08a Fix gradient accumulate logging		2 gadi atpakaļ
preparing_data	a003e5a390 Add utilities & whisper vq model	2 gadi atpakaļ
speech_lm	4cfb62a08a Fix gradient accumulate logging	2 gadi atpakaļ
.dockerignore	70797ef7d5 Add dockerignore	2 gadi atpakaļ
.gitignore	a003e5a390 Add utilities & whisper vq model	2 gadi atpakaļ
.pre-commit-config.yaml	e4ce816175 Update deps	2 gadi atpakaļ
README.md	3fc0a688ca Update Readme	2 gadi atpakaļ
dockerfile	9920873cf2 Optimize schedule	2 gadi atpakaļ
requirements.txt	23109ecb94 Optimize training loop & upgrade transformers	2 gadi atpakaļ
setup.py	7650b2ac43 Update much robust dataloader	2 gadi atpakaļ

		
				README.md
			
				Speech LLM

Setup

# Basic environment setup
conda create -n speech-llm python=3.10
conda activate speech-llm
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

# Install requirements
pip3 install -r requirements.txt

# Install flash-attn
MAX_JOBS=4 pip install flash-attn --no-build-isolation

# Install speech-llm
pip3 install -e .