Bhala umsindo nevidiyo nge OpenAI Whisper ku-NVIDIA Tesla P40 (24 GB VRAM, Pascal architecture), ngesandi esigcinwe kusisebenzisi sakho. Isisebenzisi se-GPU asikwazi ukumiswa; xhumana nathi ukuze sikwazi ukuphawula uma sikhona.
$ pip install openai-whisper && whisper audio.mp3 --model large-v3 --device cuda
# Isibonelo sokufaka umyalo
OpenAI Whisper yimodeli yokwamukela umlayezo ovulekile. Ukuya kuyo ku-GPU kusheshe kakhulu kunakwe-CPU futhi igcina umsindo wakho ku-server yakho.
I-Whisper isebenza ngokushesha kakhulu ku-GPU kune-CPU.
I-Whisper ibhala futhi iguqula amagama ezinhlamvu ezingu-99.
Umsindo uhlala kwiseva yakho.
Usebenzela ama-library amakhulu omsindo nge-batch.
Whisper ingasebenzisa i-NVIDIA GPU ukusheshisa umsebenzi wayo. VPS.org Amaseva we-GPU akhona ukucela; xhumana nathi ukulalela uma bekhona. Whisper yi-audio / ukukhuluma umsebenzi. CPU-side I/O ibaluleke kakhulu njenge-GPU compute, ngakho qiniseka ukuthi ukubuka kwediski yakho kuhamba ngokushesha ngokuqhubekela phambili.
Amaseva we-GPU akhona ukucela okwamanje. Namuhla ungasebenzisa i-Whisper ku-CPU ejwayelekile, lapho isebenza khona ngokucophelela kunakwi-GPU: SSH ngaphakathi bese usebenzisa i-pip install openai-whisper && whisper audio.mp3 --model large-v3 --device cuda.
Amamodeli omsindo avame ukuba yi-VRAM-light. I-Whisper Large ifaka cishe ama-10 GB we-VRAM, namamodeli we-TTS adinga ama-2 kuya ku-8 GB.
Intengo ye-GPU izoshicilelwa uma izisebenzisi ze-GPU zingasatshalaliswa. Xhumana nathi uma ufuna ukulalela uma lokhu kwenzeke.
Yebo. Yonke iseva ye-VPS.org ifika nge-root access egcwele, ngakho ungasebenzisa ezinye izisetshenziswa kanye ne-Whisper ngaphakathi kwe-RAM ne-storage yeseva.
Yonke isisebenzisi se VPS.org sifika sigcwele ukungena kwe-root SSH, ngakho ungafaka ama-driver, ama-library ne Whisper noma ngabe ufuna.
Akukho umsekeli ofika ngesikhathi sokusebenza se-CUDA noma umqhubi we-NVIDIA ofakwe ngaphambili, futhi ama-servers we-GPU atholakalanga ukuthenga okwamanje. Ungafaka izibuyekezo Whisper ezidingayo wena.
Yebo. Amaseva we-VPS.org asebenza ngama-machines aqhubekayo, hhayi izimo ezihambayo: amamodeli we-Whisper, izilungiselelo nedatha zihlala ku-SSD yokugcina yeseva kuze kube ucima.
Gcina idatha esebenza kuseva ye-SSD ukuze ufinyelele ngokushesha ngesikhathi se-Whisper, futhi kopela izinto eziqediwe (izithako, izizukulwane, izingeniso) kugcinwa ngaphandle kwe-VPS.org; ama-snapshots nama-backup ahlala ku-indawo yokugcina efanayo.
Ungakhuphula noma iyiphi iseva ye-VPS.org ibe yi-plan enkulu kusuka kwindawo yokulawula; ukushintsha ubukhulu kuqala kabusha futhi ukufakwa kwe-Whisper kudlulisa. Amaseva we-GPU akhona.
Yebo. Amafayela okugcina akhokhelwa angeza-on (ngesonto +30% yentengo yephrojekthi, igcinwe 7 izinsuku; ngeviki +20%, igcinwe 28 izinsuku) futhi ama-snapshots amahhala, okusiza ngaphambi kokuhamba isikhathi eside Whisper. Kokubili kuhlale ku-indawo yokugcina efanayo njengeseva.
Xhumana nosizo ngaphakathi kwezinsuku ezingama-30 zokuthenga kwakho okukuqala ukuze ucele ukubuyiselwa imali. Amaseva we-GPU athengiswe, ngakho-ke akukho sinqumo se-GPU esihlobene.
Ikhono le-GPU lilinganiselwe. Sitshele ngomsebenzi wakho futhi sizophendula ngokutholakala nokuthengwa.