Sen descrición

Lengyue f4e8633363 Move flash whisper %!s(int64=2) %!d(string=hai) anos
speech_lm f4e8633363 Move flash whisper %!s(int64=2) %!d(string=hai) anos
tools f4e8633363 Move flash whisper %!s(int64=2) %!d(string=hai) anos
.dockerignore 0c084ec779 Apply gradient accumulate to save memory %!s(int64=2) %!d(string=hai) anos
.gitignore a003e5a390 Add utilities & whisper vq model %!s(int64=2) %!d(string=hai) anos
.pre-commit-config.yaml e4ce816175 Update deps %!s(int64=2) %!d(string=hai) anos
README.md 3fc0a688ca Update Readme %!s(int64=2) %!d(string=hai) anos
dockerfile 9920873cf2 Optimize schedule %!s(int64=2) %!d(string=hai) anos
requirements.txt 23109ecb94 Optimize training loop & upgrade transformers %!s(int64=2) %!d(string=hai) anos
setup.py 7650b2ac43 Update much robust dataloader %!s(int64=2) %!d(string=hai) anos

README.md

Speech LLM

Setup

# Basic environment setup
conda create -n speech-llm python=3.10
conda activate speech-llm
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

# Install requirements
pip3 install -r requirements.txt

# Install flash-attn
MAX_JOBS=4 pip install flash-attn --no-build-isolation

# Install speech-llm
pip3 install -e .