We are preparing GPU servers with an NVIDIA Tesla P40 (24 GB VRAM, Pascal architecture) for running open-source LLMs such as Llama, Mistral and Gemma with Ollama. GPU servers are not orderable yet; contact us to be notified when they are.
$ curl -fsSL https://ollama.com/install.sh | sh && ollama run llama3
# Weka amri ya kielelezo
Ollama ni chombo nyepesi cha kutengenezea viigaji vikubwa vya lugha kwenye mashine yako mwenyewe.
Pull Llama, Mistral, Gemma, Phi, Qwen na wengine wengi wa violezo kwa amri moja.
Fits 7B to 13B models comfortably and around 30B models when quantized. 70B models do not fit on one 24 GB card at common quantization levels.
Mabasi na taarifa zinabaki kwenye kampuni yako, bila ya simu ya tatu kwa mwezi.
Ollama anafunua wazi kwamba wateja wengi waliopo wanaweza kutumia njia hiyo.
Ollama can use an NVIDIA GPU to speed up its work. VPS.org GPU servers are not available to order yet; contact us to hear when they are. Ollama is primarily an LLM-inference / chat workload. You will want fast random-access reads from disk to memory and enough VRAM for the model plus context window.
GPU servers are not available to order yet. Today you can run Ollama on a regular CPU plan, where it works far more slowly than on a GPU: SSH in and run curl -fsSL https://ollama.com/install.sh | sh && ollama run llama3.
LLM inference VRAM scales with model parameters: a 7B model needs roughly 5 to 8 GB of VRAM and a 13B model roughly 10 to 14 GB, while 70B-class models need several GPUs or heavy quantization.
Utayarishaji wa mashine ya GPU utachapishwa wakati ambapo watumishi wanaweza kuamriwa.
Yes. Every VPS.org server comes with full root access, so you can run other tools alongside Ollama within the server's RAM and storage.
Every VPS.org server comes with full root SSH access, so you can install drivers, libraries and Ollama however you need.
No. No server comes with a CUDA runtime or NVIDIA driver preinstalled, and GPU servers are not available to order yet. You install the versions Ollama needs yourself.
Yes. VPS.org servers are persistent virtual machines, not ephemeral instances: Ollama models, configs and data stay on the server's SSD storage until you delete them.
Endeleeni kufanya kazi kwenye mtandao wa SSD wa kampuni hiyo kwa ajili ya upatikanaji wa haraka wakati wa Ollama, na kunakili vitu vilivyotengenezwa (vilevile, vizazi, mabeji) ili kuvihifadhi nje ya VPS.org; picha na vifaa vingine vya kuzorea vinabaki kwenye kiji kimoja.
Unaweza kuongeza kzqxxqz kuwa kifaa kikubwa zaidi kutoka kwa jopo la udhibiti; kutengeneza upya VPS.org kwa ajili ya vyombo vya umeme kwa ajili ya matumizi ya umeme; hakuna namna nyingine ya kuirekebisha tena na kuweka Ollama.
Ndiyo. Backup ni nyongeza iliyolipwa (kwa kawaida +30% ya bei ya mpango, iliyowekwa siku 7, kila juma +20%, inayobaki siku 28) na picha zina uhuru, ambazo zina manufaa kabla ya Ollama kukimbia. Zote mbili zinabaki kwenye kisehemu kimoja cha kuhifadhia kama kile cha ser.
Contact support within 30 days of your first purchase to request a refund. GPU servers are not sold yet, so no GPU order is involved.
Tuambie kuhusu kazi unayopakia na tutajibu kwa kupatikana na kupachika vitu.