Lengyue 65e646ae31 Support prompt auto truncating codebook 2 years ago
..
build_dataset.py 467353b23a Fix error handling & optimize dataset 2 years ago
generate.py 65e646ae31 Support prompt auto truncating codebook 2 years ago
quantize.py ee7a1beb41 Better quantizer 2 years ago
rebuild_tokenizer.py 9ac8edef1e Support mix codebook training 2 years ago