Meta's self-host Llama models on a NVIDIA Tesla P40 (24 GB VRAM, Pascal architecture). Suitable to 8B models at full precision and larger models when quantized. GPU servers are not orderable yet; contact us to be notified when they are.
$ curl -fsSL https://ollama.com/install.sh | sh && ollama run llama3
# Umarnin shigar da misali
Llama ita ce iyali na Meta na manyan nau'ikan harshe masu sauki. Run Llama akan mai ba da sabis na GPU na kanka zai kiyaye tambayoyi da bayanai na sirri.
Runs 8B models on 24 GB of VRAM. 70B models do not fit on a single 24 GB card at common quantification levels.
Kukis ɗinka da bayananka na zaune a kan mai ba da sabis ɗinka. Babu kiran API na ɓangare na uku.
Yi amfani da GGUF tare da lama.cpp ko Ollama, ko kuma nau'in PyTorch na asali.
Yi amfani da siffofin da Ollama ko kuma mai ba da sabis na llama.cpp domin wani maɓallin ƙarshe mai haɗi da OpenAI.
LLaMA zai iya amfani da NVIDIA GPU don saurin aiki. VPS.org GPU servers are not available to order yet; contact us to hear when they are. LLaMA is a general GPU-accelerated workload. Make sure your software has CUDA support and that your driver / runtime versions match the workload requirements for LLaMA.
An kasa samun masu ba da sabis na GPU don a umarce su. A yau zaka iya tafiyar da LLaMA akan wani shirin CPU na yau da kullum, inda zai yi aiki da sauri fiye da a kan GPU: SSH cikin kuma ka yi tafiyar da curl -fsSL https://ollama.com/install.sh | sh && ollama run llama3.
Buƙatun VRAM ga LLaMA suna dogara kan nau'in da girman ƙungiya; duba takardun aikin shirin domin ƙididdiga na yanzu.
Za'a wallafa farashin GPU idan za'a iya umarnin masu ba da sabis na GPU. Ka tuntuɓi mu idan kana so ka ji lokacin da wannan ya faru.
Yanzu, duk mai ba da sabis na VPS.org yana da damar shiga mai amfani da shi, don haka zaka iya tafiyar da wasu kayan aiki tare da LLaMA cikin RAM da ajiyar mai ba da sabis.
Every VPS.org server comes with full root SSH access, so you can install drivers, libraries and LLaMA however you need.
Ba. Babu mai ba da sabis da ya zo da wani CUDA runtime ko NVIDIA mai sarrafa da aka shigar da shi a gaba, kuma masu ba da sabis na GPU ba su da sauki a umarce su ba har yanzu. Za ka iya shigar da sifofin da LLaMA ke bukata kai tsaye.
Ya. VPS.org servers are persistent virtual machines, not ephemeral instances: LLaMA models, configurations and data stay on the server's SSD storage until you delete them.
Ka riƙe bayanan aiki a kan SSD na mai ba da sabis domin samun damar sauri yayin da ake tafiyar da LLaMA, kuma ka kwafe artifacts da aka gama (matsaloli, shekaru, embeddings) zuwa ajiyar waje VPS.org; snapshots da backups suna zama a kan ƙungiya mai ajiyar guda.
Za ka iya canza kowace masarauta VPS.org zuwa wani shirin da ya fi girma daga fanel na kulawa; sake girman zai sake fara shi kuma shigarwarka ta LLaMA za ta yi ta. Masarautar GPU ba ta da sauki ba har yanzu.
Yes. Backups are a paid add-on (daily +30% of the plan price, kept 7 days; weekly +20%, kept 28 days) and snapshots are free, which is useful before long LLaMA runs. Both stay on the same storage cluster as the server.
Ka tuntubi goyon baya cikin kwanaki 30 na farkon siyarka don neman dawo da kuɗi. Ba a sayar da masu watsa shirye-shiryen GPU ba har yanzu, don haka babu umarnin GPU da aka haɗa.
GPU na da iyakacin ƙarfin aiki. Ka gaya mana game da nauyin aikinka kuma za mu amsa da damar da farashin.