Просмотр исходного кода

performance optimize (#102)

* perf opt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Stardust·减 2 лет назад
Родитель
Сommit
35a3a8539e
1 измененных файлов с 4 добавлено и 0 удалено
  1. 4 0
      tools/llama/build_dataset.py

+ 4 - 0
tools/llama/build_dataset.py

@@ -14,6 +14,10 @@ from fish_speech.datasets.protos.text_data_stream import pack_pb_stream
 from fish_speech.text import g2p
 from fish_speech.utils.file import load_filelist
 
+# To avoid CPU overload
+os.environ["MKL_NUM_THREADS"] = "1"
+os.environ["OMP_NUM_THREADS"] = "1"
+
 
 def task_generator_yaml(config):
     with open(config, "r") as f: