Tallace-tallace da kuma tafiyar da nau'ikan PyTorch akan NVIDIA Tesla P40 (24 GB VRAM, Pascal architecture), tare da cikakkiyar damar shiga mai amfani da shi. Masu saukar da GPU ba su da iyakacin da za'a iya umarnin su ba; tuntuɓi mu don a sanar da mu idan sun kasance.
$ pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124
# Umarnin shigar da misali
PyTorch wani tsarin koyon zurfi ne da ake amfani dashi da yawa. Mai ba da sabis na GPU yana tafiyar da PyTorch da kuma koyon damuwa a kan GPU, wanda yake da sauri fiye da CPU ga mafi yawan ma'aunin.
Ka shigar da mai sarrafa NVIDIA, CUDA da kuma gina PyTorch da kake bukata. Ka tabbatar da gina PyTorch ɗinka na goyon bayan Pascal GPUs (haƙƙin ƙididdiga 6.1).
Ƙaramin wuri don ƙan da matsakaicin girman nau'ikan, LoRA fine-tuning da ƙan girman bangare.
Run Jupyter notebooks on the server for interaction work on the GPU.
Yi daidaita yanayin kamar yadda aikinka yake bukata.
PyTorch can use an NVIDIA GPU to speed up its work. VPS.org GPU servers aren't available to order yet; contact us to hear when they are. PyTorch is a training / fine-tuning workload. Plan for long-running jobs: snapshot your VPS regularly and keep a copy of trained weights outside VPS.org.
An kasa samun masu ba da sabis na GPU don a umarce su. A yau zaka iya tafiyar da PyTorch akan wani shirin CPU na yau da kullum, inda zai yi aiki da sauri fiye da a kan GPU: SSH cikin kuma ka yi tafiyar da pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu124.
Training VRAM an riƙe shi da tsarin mai haɓakawa tare da aikace-aikace. Full fine-tuning na 7B LLM yana buƙatar kusan 24 zuwa 48 GB; LoRA / QLoRA yana da kyau a cikin 8 zuwa 16 GB.
Za'a wallafa farashin GPU idan za'a iya umarnin masu ba da sabis na GPU. Ka tuntuɓi mu idan kana so ka ji lokacin da wannan ya faru.
Yanzu, duk mai ba da sabis na VPS.org yana da damar shiga mai amfani da shi, don haka zaka iya tafiyar da wasu kayan aiki tare da PyTorch cikin RAM da ajiyar mai ba da sabis.
Every VPS.org server comes with full root SSH access, so you can install drivers, libraries and PyTorch however you need.
Ba. Babu mai ba da sabis da ya zo da wani CUDA runtime ko NVIDIA mai sarrafa da aka shigar da shi a gaba, kuma masu ba da sabis na GPU ba su da sauki a umarce su ba har yanzu. Za ka iya shigar da sifofin da PyTorch ke bukata kai tsaye.
Ya. VPS.org servers are persistent virtual machines, not ephemeral instances: PyTorch models, configurations and data stay on the server's SSD storage until you delete them.
Ka riƙe bayanan aiki a kan SSD na mai ba da sabis domin samun damar sauri yayin da ake tafiyar da PyTorch, kuma ka kwafe artifacts da aka gama (matsaloli, shekaru, embeddings) zuwa ajiyar waje VPS.org; snapshots da backups suna zama a kan ƙungiya mai ajiyar guda.
Za ka iya canza kowace masarauta VPS.org zuwa wani shirin da ya fi girma daga fanel na kulawa; sake girman zai sake fara shi kuma shigarwarka ta PyTorch za ta yi ta. Masarautar GPU ba ta da sauki ba har yanzu.
Yes. Backups are a paid add-on (daily +30% of the plan price, kept 7 days; weekly +20%, kept 28 days) and snapshots are free, which is useful before long PyTorch runs. Both stay on the same storage cluster as the server.
Ka tuntubi goyon baya cikin kwanaki 30 na farkon siyarka don neman dawo da kuɗi. Ba a sayar da masu watsa shirye-shiryen GPU ba har yanzu, don haka babu umarnin GPU da aka haɗa.
GPU na da iyakacin ƙarfin aiki. Ka gaya mana game da nauyin aikinka kuma za mu amsa da damar da farashin.