๐๐ง๐ฒ๐ฐ๐ต๐ฏ๐ฒ๐ฎ๐๐ ๐๐ป๐ฝ๐น๐๐ด๐ด๐ฒ๐ฑ #Episode09 is live !!!๐๐ป
"๐ง๐ต๐ฒ ๐๐ป๐ด๐น๐ผ๐ฟ๐ถ๐ผ๐๐ ๐๐น๐ผ๐๐ฑ ๐ง๐ฟ๐ฎ๐ฝ๐โ๏ธ" With @markboost.com CEO of @civo.com
๐๐ป Listen here: sptfy.bio/TBeats09 ๐๐ป
โ๏ธ ๐๐ ๐๐ต๐ฒ ๐๐น๐ผ๐๐ฑ ๐ฏ๐ฟ๐ผ๐ธ๐ฒ๐ป ...๐ผ๐ฟ ๐ท๐๐๐ ๐๐ป๐ณ๐ฎ๐ถ๐ฟ?
Grab your ๐ง and Tune IN! let's uncover the โ๏ธ#traps!
๐บ One the best ๐ง๐ฒ๐ฐ๐ต๐๐ฒ๐ฎ๐๐ show so far !
Posts by Kosseila (CloudDude)
๐ข ๐ก๐ฒ๐ ๐๐ฒ๐ฟ๐ฟ๐ฎ๐ณ๐ผ๐ฟ๐บ #vLLM ๐ฃ๐ฟ๐ผ๐ฑ๐๐ฐ๐๐ถ๐ผ๐ป ๐ฆ๐๐ฎ๐ฐ๐ธ ๐๐ฐ๐ฟ๐ผ๐๐ ๐๐น๐ผ๐๐ฑ๐ ๐ง๐ผโ๐ | ๐ฃ๐ฎ๐ฟ๐ ๐ฐ: ๐ก๐ฒ๐ฏ๐ถ๐๐ ๐๐น๐ผ๐๐ฑ ๐
๐ ๐ช๐ต๐ฎ๐ ๐๐ผ๐'๐น๐น ๐ฑ๐ฒ๐ฝ๐น๐ผ๐:
โ
Enterprise-grade GPU inference
โ
Secure vllm endpoints (LetsEncrypt)
โ
Full observability: Grafana + vLLM dashboards
โ
Lightning-fast deployment
๐ read the guide: tinyurl.com/Nebiusvllm
๐This week, weโre counted down CloudThrillโs ๐ง๐ผ๐ฝ ๐ฏ ๐บ๐ผ๐๐-๐ฟ๐ฒ๐ฎ๐ฑ blog posts of ๐ฎ๐ฌ๐ฎ๐ฑ๐.
Three posts. Three lessons. First reveal drops this Monday ๐
#CloudThrill #LLM #AIInfrastructure #LLM #OpenSourceAI #AIEngineering
๐๐ง๐ฒ๐ฐ๐ต๐ฏ๐ฒ๐ฎ๐๐ ๐๐ป๐ฝ๐น๐๐ด๐ด๐ฒ๐ฑ is BACK #Episode 08 !!!๐๐ป
"๐ก๐๐๐ฎ๐ป๐ถ๐
๐ถ๐ป ๐๐ต๐ฒ ๐๐ด๐ฒ ๐ผ๐ณ ๐๐ต๐ฒ ๐ฉ๐ถ๐ฟ๐๐๐ฎ๐น๐ถ๐๐ฎ๐๐ถ๐ผ๐ป ๐ฆ๐ต๐ฎ๐ธ๐ฒ-๐จ๐ฝ " ๐ง๐ฅ
๐ฅNew episode out with Michael Webster from Nutanix & I- breaking down the #VMwareโBroadcom chaos, #Nutanix, and real exit strategies.
๐๐ป Listen here: sptfy.com/TBeats08 ๐๐ป
๐ข ๐ก๐ฒ๐ ๐๐ฒ๐ฟ๐ฟ๐ฎ๐ณ๐ผ๐ฟ๐บ #vLLM ๐ฃ๐ฟ๐ผ๐ฑ๐๐ฐ๐๐ถ๐ผ๐ป ๐ฆ๐๐ฎ๐ฐ๐ธ ๐๐ฐ๐ฟ๐ผ๐๐ ๐๐น๐ผ๐๐ฑ๐
๐ฃ๐ฎ๐ฟ๐ ๐ญ: GCP ๐๐๐ ๐ต๐ด๐ข
๐ ๐ช๐ต๐ฎ๐ ๐๐ผ๐'๐น๐น ๐ฑ๐ฒ๐ฝ๐น๐ผ๐:
โ
Enterprise-grade infra
โ
Switch between CPU/ GPU inference with a single flag
โ
Full observability: Grafana + vLLM dashboards
โ
OpenAI-compatible API
๐ read the guide: cloudthrill.ca/vllm-product...
๐ฉต Throwback Thursday from #๐ฅ๐ฎ๐๐ฆ๐๐บ๐บ๐ถ๐ ๐ฆ๐!
I Caught up with ๐ฆ๐ถ๐บ๐ผ๐ป ๐ ๐ผ, lead on #vllm project, to chat about the ๐๐ผ๐ฝ ๐ฑ ๐ป๐ฒ๐ ๐๐๐๐ ๐ณ๐ฒ๐ฎ๐๐๐ฟ๐ฒ๐ and whatโs cooking in their ๐ฎ๐ฌ๐ฎ๐ฒ ๐ฟ๐ผ๐ฎ๐ฑ๐บ๐ฎ๐ฝ straight from the source๐ฅand boy did he deliver!! #vLLM #RaySummit2025 #anyscale @cloudthrill.bsky.social #OpenSourceAI
#Nebius an European-born AI Supercloud with one of the wildest origin stories in the cloud world. ๐
๐ Read the full story: cloudthrill.ca/explore-nebius-ai-cloud
๐History, GPU lineup & presets, network, regions, CLI setup, pricing - all covered
#Nebius #AICloud #LLMOps #AI #NeoCloud #GPU
๐ข ๐ก๐ฒ๐ ๐๐ฒ๐ฟ๐ฟ๐ฎ๐ณ๐ผ๐ฟ๐บ vLLM ๐ฃ๐ฟ๐ผ๐ฑ๐๐ฐ๐๐ถ๐ผ๐ป ๐ฆ๐๐ฎ๐ฐ๐ธ ๐๐ฐ๐ฟ๐ผ๐๐ ๐๐น๐ผ๐๐ฑ๐
๐ฃ๐ฎ๐ฟ๐ ๐ญ: ๐๐บ๐ฎ๐๐ผ๐ป ๐๐๐ฆ
๐ ๐ช๐ต๐ฎ๐ ๐๐ผ๐'๐น๐น ๐ฑ๐ฒ๐ฝ๐น๐ผ๐:
โ
Enterprise-grade infra
โ
Switch between CPU/ GPU inference with a single flag
โ
Full observability: Grafana + vLLM dashboards
โ
OpenAI-compatible API
๐ Check it out: cloudthrill.ca/vllm-product...
Still thinking of hosting your on AI Backend?
our FREE vLLM POC is still live - but not forever.
๐ข๐๐ฝ๐ฝ๐น๐ ๐ป๐ผ๐ โ cloudthrill.ca/ai-poc
Run AI assistants, RAG, or open models privately in the cloud:
โ
No external APIs
โ
No vendor lock-in
โ
Total data control
Your Infra. Your Models. Your rules.๐๐
๐จ๐๐๐ฐ ๐๐๐ฎ๐ง๐๐ก:
๐Today, weโre excited to launch our ๐๐ ๐๐ซ๐ข๐ฏ๐๐ญ๐ ๐๐ง๐๐๐ซ๐๐ง๐๐ ๐๐๐ซ๐ฏ๐ข๐๐: powered by Open source AI stack.
To celebrate we offer a ๐
๐๐๐ ๐๐๐๐ POC in any cloud you choose! Apply Now! Only 5 spots available.๐๐ผ cloudthrill.ca/ai-poc
youtu.be/i_vIrOH8I3E?...
โ๐ป#NewBlog ๐๐๐ ๐๐บ๐ฏ๐ฒ๐ฑ๐ฑ๐ถ๐ป๐ด๐ ๐๐
๐ฝ๐น๐ฎ๐ถ๐ป๐ฒ๐ฑ (Like Iโm 5)
Youโve heard of RAG, vector DBs, and embeddings... ๐ค
But what are ๐๐ฆ๐๐๐๐๐ข๐ง๐ ๐ฌ really, and why do they matter?
learn all about it and how it works in this 5 minute post
๐๐ผ cloudthrill.ca/llm_embeddin...
#LLM #Embeddingmodels #AI #RAG #VectorDB
๐#NewBlog #vLLM
๐ ๐ฏ๐๐๐ ๐ฉ๐ซ๐จ๐๐ฎ๐๐ญ๐ข๐จ๐ง-๐ฌ๐ญ๐๐๐ค: AI inference for enterprises๐ซ
๐ขProduction-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.
๐Start here: cloudthrill.ca/vllm-product...
#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
Love them #Newbalance ๐ ๐
๐ฆ#vLLM for ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐ฎ๐ง๐๐ฅ๐: from basics to deployment! ๐Missed our vLLM series this summer? Hereโs a full recap
Part1๏ธโฃ: ๐
undamentals cloudthrill.ca/what-is-vllm
Part2๏ธโฃ: ๐ey ๐
eatures cloudthrill.ca/what-is-vllm...
part3๏ธโฃ: ๐eployment ๐ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
๐๏ธYou've never heard @kelseyhightower.com discuss this topic before! Zero to do with tech!๐ Enjoy this #HIPHOP deep dive... Thanks Kelsey #FunTimes #ThursdayPods #Breakdance
youtu.be/aAbbSk2F-Xs?...
#NewBlogโ #๐๐๐ก๐๐๐๐๐๐ ๐๐๐๐ ๐ค๐๐๐๐๐ซ
๐๐๐๐๐ฎ๐ซ๐ฌ๐ข๐ฏ๐ ๐๐๐๐๐๐๐๐๐: "๐๐ฉ๐ฆ๐ฏ ๐๐จ๐ฏ๐ฐ๐ณ๐ช๐ฏ๐จ ๐๐ฐ๐ฆ๐ด ๐๐ฐ๐ฐ ๐๐ข๐ณ"
๐Read here: tinyurl.com/gitignorez
โ
The Usual suspects: Broad Wildcards, nested files
โ
Recursive directory matching & Trailing "/"
โ
How to stop recursive chaos before it hits prod
#DevOps #GitHub #GitLab #CICD
๐ #NewBlog @hashicorp.com Vault blog series
๐๐๐ซ๐ญ ๐: ๐๐๐ญ๐ฎ๐ฉ ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ ๐๐ฎ๐ญ๐ก๐๐ง๐ญ๐ข๐๐๐ญ๐ข๐จ๐ง ๐ฐ๐ข๐ญ๐ก ๐๐๐ฎ๐ฅ๐ญ
๐ tinyurl.com/k8sAuthVault
๐กIn this 5 minutes tuto you'll learn:
โ
Diff Vault auth scenarios for k8s
โ
Setup up K8s Vault Auth with SA/Client JWT & OIDC
#k8s #HashiCorp #Vault #SecretsManagement #DevOps
๐ #NewBlog How to ๐๐๐ฌ๐ฌ ๐ญ๐ก๐ ๐๐ข๐ญ๐๐ฎ๐ ๐๐๐ญ๐ข๐จ๐ง๐ฌ ๐๐๐ซ๐ญ๐ข๐๐ข๐๐๐ญ๐ข๐จ๐ง!
๐Complete guide here cloudthrill.ca/how-i-passed...
๐ฏ I included all you need to ace it:
โ
Free exam practice
โ
Most exhaustive Cheat Sheet (all topics covered)
โ
CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
๐#BlogSeries #vllm๐ฅ
๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐ ๐๐๐ฉ๐ฅ๐จ๐ฒ๐ฆ๐๐ง๐ญ ๐๐ฉ๐ญ๐ข๐จ๐ง๐ฌ
Learn to deploy #vLLM everywhere! Even on CPU๐คซ
โ
Platform & model Support Matrix
โ
Install on GPU & CPU
โ
Build Wheel from scratch | Python vLLM package
โ
Docker/Kubernetes Deployment
โ
Running vLLM server (Offline + Online inference)
#NewBlog from ๐๐๐ซ๐จ ๐ญ๐จ @CivoCloud ๐
๐Deploy your full fledged Talos ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ stack with Terraform in one command.
check it out๐: tinyurl.com/CivoK8stf
โ
Includes Grafana, Prometheus, Let's Encrypt & more
๐ My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
๐๏ธ Join our ๐ด๐๐๐๐ก ๐๐๐๐ญ๐ฌ ๐๐ข๐ฏ๐ Show!
๐๏ธ Thursday 17th 11:30 AM EDT
๐ฏ A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.
๐ฅDope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat
๐Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
๐#NewBlog #vllm๐ฅ
๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐๐๐๐ฒ ๐
๐๐๐ญ๐ฎ๐ซ๐๐ฌ & ๐๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐๐ญ๐ข๐จ๐งs
๐ What makes #vLLM the Rolls Royce of inference?
๐check it out: cloudthrill.ca/what-is-vllm...
โ
#PagedAttention #PrefixCaching #ChunkedPrefill
โ
#SpeculativeDecoding #FlashAttention #lmcache
โ
Tensor & #PipelineParallelismโก
๐#NewBlog ๐๐ข๐ญ๐๐ฎ๐ actions Azure deploy with ๐๐๐๐!
๐กOver ๐๐ ๐ฆ๐ข๐ฅ๐ฅ๐ข๐จ๐ง๐ฌ secrets were exposed in #GitHub last year๐ & ๐๐K+ #Huggingface tokens leaks every month!
๐ก๏ธSwitch to ๐ฌ๐๐๐ซ๐๐ญ๐ฅ๐๐ฌ๐ฌ with Pipeline identity now!
๐We show you how: cloudthrill.ca/github-actio...
#Azure #NHI #CICD #Terraform #ManagedIdentity
๐#NewBlogAlert "What is #vLLM ?"
Weโre kicking off our ๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐ก๐ ๐
๐ฎ๐ง๐๐๐ฆ๐๐ง๐ญ๐๐ฅ๐ฌ๐ซ
New to vLLM ? This one's for you๐๐ป: cloudthrill.ca/what-is-vllm
โ
What is vLLM ( vLLM vs Ollama)
โ
Core Architecture (Engine, Sched, Execution, Memory)
โ
Offline and Online inference
๐๐๐๐๐ก ๐๐๐๐ญ๐ฌ ๐๐ง๐ฉ๐ฅ๐ฎ๐ ๐ ๐๐ is BACK #Episode 06 !!!๐๐ป
๐ง๐ฅ"๐๐ข๐ญ๐๐ฎ๐ ๐๐๐๐ฎ๐ซ๐ข๐ญ๐ฒ ๐ก๐จ๐ซ๐ซ๐จ๐ซ ๐ฌ๐ญ๐จ๐ซ๐ข๐๐ฌ with
#SteveGiguere "โข๏ธ...tons of ๐๐ญ๐ญ๐๐๐ค ๐ฏ๐๐๐ญ๐จ๐ซ๐ฌ, best practices, and a lot of laughs๐
. You don't wanna miss this !
Thank you Steve๐๐ป
๐๐ป spoti.fi/4dYicES ๐๐ป
๐๏ธ๐๐๐๐ก ๐๐๐๐ญ๐ฌ ๐๐ง๐ฉ๐ฅ๐ฎ๐ ๐ ๐๐ is back! new episode drops tomorrow!๐ฅ๐Mystery guest. Bold truths. Shocking discoveries youโre not ready to hear๐ฑ ๐งMics are hot, truths are hotter. Stay tunned !!๐
#TechPodcast #GitSecStory
#NewBlog ๐๐ ๐๐ฎ๐ฐ๐ต๐ฒ ๐๐
๐ฝ๐น๐ฎ๐ถ๐ป๐ฒ๐ฑ: like I'm 5๐
๐ง Ever wondered what #KVCache really is in LLM inference? Forget the math-heavy blablaโthis one's made to click !
๐check it out: cloudthrill.ca/kv_cache-exp...
@Cloud_Thrill
#vLLM #AIInfra #lmcache
๐ง First thing to do when using Jules from google and connecting your GitHub..! #GoogleJules
๐ #NewBlogAlert ๐ก๏ธ #HashiCorpVault
I'm kicking off a ๐๐๐ฎ๐ฅ๐ญ ๐๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐จ๐ฐ ๐ญ๐จ ๐๐๐ญ ๐๐ฉ ๐๐๐ฌ๐ก๐ข๐๐จ๐ซ๐ฉ ๐๐๐ฎ๐ฅ๐ญ with ๐๐๐๐ญ & ๐๐๐
๐check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
๐จCatch me live at @AIOUG tomorrow!๐
Pumped to join India Oracle Users Group for a live session #OCIDevOps #Terraform
๐๏ธ May 16 | ๐ 8:30 AM EST / 6:00 PM IST
Save your spot: aioug.org/events/explo...