Sen descrición

Lengyue db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos
preparing_data 9adf687fb1 Update base training code %!s(int64=2) %!d(string=hai) anos
speech_lm db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos
.gitignore aa0a6be778 init training code %!s(int64=2) %!d(string=hai) anos
.pre-commit-config.yaml e4ce816175 Update deps %!s(int64=2) %!d(string=hai) anos
.project-root aa0a6be778 init training code %!s(int64=2) %!d(string=hai) anos
README.md e4ce816175 Update deps %!s(int64=2) %!d(string=hai) anos
dockerfile db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos
ds_config.json db0aa1a99a Init preprocessing tools %!s(int64=2) %!d(string=hai) anos
requirements.txt db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos
train.py db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos
train.sh db347ca973 Add llm exp code %!s(int64=2) %!d(string=hai) anos

README.md

Speech LLM

Setup

# Basic environment setup
conda create -n speech-llm python=3.10
conda activate speech-llm
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia

# Install requirements
pip3 install -r requirements.txt

# Install flash-attn
MAX_JOBS=4 pip install flash-attn --no-build-isolation