Нема описа

Lengyue e4839d6e84 Use 4 workers пре 2 година
fish_speech e4839d6e84 Use 4 workers пре 2 година
tools d16c9cb695 Update huggingface dataset builder пре 2 година
.dockerignore 0c084ec779 Apply gradient accumulate to save memory пре 2 година
.gitignore 6d0e669f8c Rename project to fish-speech пре 2 година
.pre-commit-config.yaml e4ce816175 Update deps пре 2 година
README.md 3fc0a688ca Update Readme пре 2 година
dockerfile 9920873cf2 Optimize schedule пре 2 година
pyrightconfig.json f7f2c03282 Support pytorch lightning пре 2 година
requirements.txt 23109ecb94 Optimize training loop & upgrade transformers пре 2 година
setup.py 6d0e669f8c Rename project to fish-speech пре 2 година

README.md

Speech LLM

Setup

# Basic environment setup
conda create -n speech-llm python=3.10
conda activate speech-llm
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

# Install requirements
pip3 install -r requirements.txt

# Install flash-attn
MAX_JOBS=4 pip install flash-attn --no-build-isolation

# Install speech-llm
pip3 install -e .