Tumikieni violezo vya AI kutoka kwenye NSIDIA Tesla P40 (24 GB VRAM, ujenzi wa majengo ya Pascal): LMs, violezo vya mifano na matabiri mengine. GPIFYs bado haiwezi kuamriwa; tuwasiliane nasi ili tujulishwe wakati wa matukio.
$ pip install vllm && vllm serve meta-llama/Llama-3-8B-Instruct
# Weka amri ya kielelezo
Kituo cha kuchunguza mazingira kina wafanyakazi waliozoezwa ili kutokeza matabiri. MWAMA wa Shirika la Uchimbaji wa Vitu vya Angani huandaa vifaa vilivyowekwa wakfu vya NAVIDIA kwa ajili ya kuandaa violezo vyenye kiwango cha chini cha chini na vya hali ya juu.
GPU inapitishwa kwa mtumishi wako peke yake, kwa hiyo kuchelewa hakuathiriwi na kazi za wateja wengine.
Use Ollama, llama.cpp, Triton or your own API. Some frameworks, such as vLLM, need newer GPUs than the Pascal P40.
Kimbia vilinda - mizigo kadhaa nyuma ya kisawazisha - mizigo chako mwenyewe ikiwa GPU moja haitoshi.
Pakua kiolezo kimoja kilichofanyizwa katikati au vile vidogo kadhaa.
AI Inference can use an NVIDIA GPU to speed up its work. VPS.org GPU servers are not available to order yet; contact us to hear when they are. AI Inference is a general GPU-accelerated workload. Make sure your software has CUDA support and that your driver / runtime versions match the workload requirements for AI Inference.
GPU servers are not available to order yet. Today you can run AI Inference on a regular CPU plan, where it works far more slowly than on a GPU: SSH in and run pip install vllm && vllm serve meta-llama/Llama-3-8B-Instruct.
VRAM inahitaji AI Inference ikitegemea muundo na ukubwa wake; chunguza hati za hesabu za sasa.
Utayarishaji wa mashine ya GPU utachapishwa wakati ambapo watumishi wanaweza kuamriwa.
Yes. Every VPS.org server comes with full root access, so you can run other tools alongside AI Inference within the server's RAM and storage.
Every VPS.org server comes with full root SSH access, so you can install drivers, libraries and AI Inference however you need.
No. No server comes with a CUDA runtime or NVIDIA driver preinstalled, and GPU servers are not available to order yet. You install the versions AI Inference needs yourself.
Yes. VPS.org servers are persistent virtual machines, not ephemeral instances: AI Inference models, configs and data stay on the server's SSD storage until you delete them.
Endeleeni kufanya kazi kwenye mtandao wa SSD wa kampuni hiyo kwa ajili ya upatikanaji wa haraka wakati wa AI Inference, na kunakili vitu vilivyotengenezwa (vilevile, vizazi, mabeji) ili kuvihifadhi nje ya VPS.org; picha na vifaa vingine vya kuzorea vinabaki kwenye kiji kimoja.
Unaweza kuongeza kzqxxqz kuwa kifaa kikubwa zaidi kutoka kwa jopo la udhibiti; kutengeneza upya VPS.org kwa ajili ya vyombo vya umeme kwa ajili ya matumizi ya umeme; hakuna namna nyingine ya kuirekebisha tena na kuweka AI Inference.
Ndiyo. Backup ni nyongeza iliyolipwa (kwa kawaida +30% ya bei ya mpango, iliyowekwa siku 7, kila juma +20%, inayobaki siku 28) na picha zina uhuru, ambazo zina manufaa kabla ya AI Inference kukimbia. Zote mbili zinabaki kwenye kisehemu kimoja cha kuhifadhia kama kile cha ser.
Contact support within 30 days of your first purchase to request a refund. GPU servers are not sold yet, so no GPU order is involved.
Tuambie kuhusu kazi unayopakia na tutajibu kwa kupatikana na kupachika vitu.