Kuchita maphunziro a TensorFlow ndi Keras ndi kuzindikira pa NVIDIA Tesla P40 (24 GB VRAM, Pascal architecture). Maseva a GPU sapezekapo; tiuzeni kuti mudziwe pamenepo.
$ pip install tensorflow[and-cuda]
# Mfano wa kukhazikitsa lamulo
TensorFlow ndi chida chophunzira makina chotsegulidwa cha Google. Pa GPU server, TensorFlow imayendetsa ntchito zake pa GPU pogwiritsa ntchito CUDA.
TensorFlow amagwiritsa ntchito GPU mwa CUDA pamene inu kukhazikitsa woyendetsa kugwirizana ndi CUDA mtundu.
Kumanga mafano ndi Keras API pamwamba pa GPU backend.
Kuyang'ana maphunziro ndi TensorBoard pa seva yanu.
Kupereka maphunziro ophunzira ndi TensorFlow Serving.
TensorFlow akhoza kugwiritsa ntchito NVIDIA GPU kuti afulumizitse ntchito yake. VPS.org GPU ma seva si angathe kulandira; tiuzeni kuti mudziwe pamene iwo ndi. TensorFlow ndi maphunziro / fine-tuning workload. Plan for long running jobs: snapshot your VPS regularly and keep a copy of trained weights outside VPS.org.
GPU ma seva si opezeka kuti aperekebe. Tsopano mungagwiritse ntchito TensorFlow pa CPU yachikhalidwe, komwe imagwira ntchito mofulumira kuposa pa GPU: SSH mu ndi kuyendetsa pip install tensorflow[and-cuda].
Kuphunzitsa VRAM kumadziwika ndi lamulo la optimization komanso kuyambitsa. Kuthamanga kwa 7B LLM kumafunikira pafupifupi 24 mpaka 48 GB; LoRA / QLoRA imagwirizana ndi 8 mpaka 16 GB.
Kugulitsa kwa GPU kudzatulutsidwa pamene ma seva a GPU angagwiritsidwe ntchito. Tiuzeni ngati mukufuna kumvetsetsa pamene izi zikuchitika.
Yai. Kawirikawiri VPS.org server amachokera ndi wonse root kulowa, kotero inu mukhoza kuyendetsa ena zipangizo mbali TensorFlow m'ma RAM ndi kusungirako server.
Gawo lililonse VPS.org wothandizira amachokera ndi wonse root SSH kulowa, kotero inu mukhoza kukhazikitsa oyendetsa, mabuku ndi TensorFlow koma inu muyenera.
Sichoncho. Palibe wothandizira amafika ndi CUDA runtime kapena NVIDIA woyendetsa preinstalled, ndi GPU othandizira sizilipo kuti aperekebe. Mumakhazikitsa TensorFlow zojambula zofunikira nokha.
Ndikoyenera. VPS.org ma seva ndi olimba olimba, osati opanda pake: TensorFlow mapangidwe, zosankha ndi deta zimakhazikika pa SSD yosungira server mpaka mutachotsa.
Kusunga ntchito deta pa SSD seva kwa kulowa mosavuta pamene TensorFlow kunyamula, ndi kukopera kumaliza artifacts (mawuwo, chiyambi, embeddings) ku osungirako kunja VPS.org; snapshots ndi zosunga zobwezeretsera azikhala pamodzi osungirako gulu.
Mukhoza kuwonjezera iliyonse VPS.org wothandizira kuti malire lalikulu kuchokera ku gulu la kuwongolera; resize imayambanso ndi TensorFlow kukhazikitsa wanu amapita. GPU othandizira si opezekabe.
Yes. Backups ndi wolipira add-on (tsiku ndi tsiku + 30% ya mtengo wa ndondomeko, anasunga masiku 7; tsiku ndi tsiku + 20%, anasunga masiku 28) ndi snapshots ndi ufulu, amene ndi zothandiza pamaso TensorFlow m'mbuyo m'mbuyo.
Mutha kulumikizana ndi thandizo m'masiku 30 a kugula kwanu koyamba kuti mupemphe kuti mubwezere ndalama. GPU servers sizikugulitsidwabe, chifukwa chake palibe GPU order.
Kutha kwa GPU ndi kocheperako. Tiuzeni za ntchito yanu ndipo tidzakuyankha ndi kuchuluka kwa ndalama zomwe zilipo.