SaladCloud Blogs
Benchmarks, tutorials, case studies & other helpful resources for generative AI companies looking to serve inference at scale while saving on cloud costs.
AI Batch Transcription Benchmark: Transcribing 1 Million+ Hours of Videos in just 7 days for $1800
AI batch transcription benchmark: Speech-to-text at scale Building upon the inference benchmark of Parakeet TDT 1.1B for YouTube videos on SaladCloud and with our ongoing efforts to enhance the system
AI Transcription Benchmark: 1 Million Hours of Youtube Videos with Parakeet TDT 1.1B for Just $1260, a 1000-fold cost reduction
Building upon the inference benchmark of Parakeet TDT 1.1B on SaladCloud and with our ongoing efforts to enhance the system architecture and implementation for batch jobs, we have achieved a 1000-fold
Text-to-Speech (TTS) API Alternative: Self-Managed OpenVoice vs MetaVoice Comparison
A cost-effective alternative to Text-to-speech APIs In the realm of text-to-speech (TTS) technology, two open-source models have recently garnered everyone's attention: OpenVoice and MetaVoice. Each model has unique capabilities in
MetaVoice AI Text-to-Speech (TTS) Benchmark: Narrate 100,000 words for only $4.29 on Salad
Note: Do not miss out on listening to voice clones of 10 different celebrities reading Harry Potter and the Sorcerer's Stone towards the end of the blog. Introduction to MetaVoice-1B
Parakeet TDT 1.1B Inference Benchmark on SaladCloud: 1,000,000 hours of transcription for Just $1260
Parakeet TDT 1.1B GPU benchmark The Automatic Speech Recognition (ASR) model, Parakeet TDT 1.1B, is the latest addition to NVIDIA's Parakeet family. Parakeet TDT 1.1B boasts unparalleled accuracy and significantly
Have questions about enterprise pricing for SaladCloud?
Book a 15 min call with our team.
Molecular Simulation: GROMACS Benchmark on 30 GPUs on SaladCloud, 90+% Cost Savings
Benchmarking GROMACS for Molecular Simulation on consumer GPUs In this deep dive, we will benchmark GROMACS on SaladCloud, analyzing simulation speed and cost-effectiveness across a spectrum of molecular systems—small, medium,...
Molecular Simulation: OpenMM Benchmark on 25 consumer GPUs, 95% less cost
Benchmarking OpenMM for Molecular Simulation on consumer GPUs OpenMM is one of the most popular toolkits for molecular dynamics simulations, renowned for its high-performance, flexibility and extensibility. It enables users...
Salad drops GPU pricing to become the lowest priced cloud (again)
Salad chops Cloud GPU pricing We are excited to announce that we have reduced the prices on our entire fleet of GPUs, making Salad the lowest priced cloud in the...
Civitai powers 10 Million AI images per day with Salad’s distributed cloud
Civitai: The Home of Open-Source Generative AI “Our mission is rooted in the belief that AI resources should be accessible to all, not monopolized by a few” - Justin Maier,...
How to run cog applications on SaladCloud
Introduction to Cog: Containers for Machine Learning Cog is an open-source tool designed to streamline the creation of inference applications for various AI models. It offers CLI tools, Python modules...
Blend cuts AI inference cost by 85% on Salad while running 3X more scale
Key takeaways: - The team at Blend were facing high inference costs & scalability challenges on major cloud providers & local vendors- Switching to SaladCloud for image generation helped them...
AI Batch Transcription Benchmark: Transcribing 1 Million+ Hours of Videos in just 7 days for $1800
AI batch transcription benchmark: Speech-to-text at scale Building upon the inference benchmark of Parakeet TDT 1.1B for YouTube videos on SaladCloud and with our ongoing efforts to enhance the system...
Introducing SSAP: Migrate to Salad GPU Cloud easily & save up to 80%
AI companies are overpaying for compute today Affordable, accessible compute is the defining challenge for many AI startups today. Recently, we’ve seen many news stories of innovative AI companies struggling...
Text-to-Speech (TTS) API Alternative: Self-Managed OpenVoice vs MetaVoice Comparison
A cost-effective alternative to Text-to-speech APIs In the realm of text-to-speech (TTS) technology, two open-source models have recently garnered everyone's attention: OpenVoice and MetaVoice. Each model has unique capabilities in...
Cost-effective Stable Diffusion fine tuning on Salad
Stable Diffusion XL (SDXL) fine tuning as a service I recently wrote a blog about fine tuning Stable Diffusion XL (SDXL) on interruptible GPUs at low cost, starring my dog...
LLM Comparison Through TGI Benchmark Using SaladCloud
In the field of Artificial Intelligence (AI), Text Generation Inference (TGI) has become a vital toolkit for deploying and serving Large Language Models (LLMs). TGI enables efficient and scalable text...
MetaVoice AI Text-to-Speech (TTS) Benchmark: Narrate 100,000 words for only $4.29 on Salad
Note: Do not miss out on listening to voice clones of 10 different celebrities reading Harry Potter and the Sorcerer's Stone towards the end of the blog. Introduction to MetaVoice-1B...
Fine tuning Stable Diffusion XL (SDXL) with interruptible GPUs and LoRA for low cost
It’s no secret that training image generation models like Stable Diffusion XL (SDXL) doesn’t come cheaply. The original Stable Diffusion model cost $600,000 USD to train using hundreds of enterprise-grade...
Segment Anything Model (SAM) Benchmark: 50K Images/$ on Consumer GPUs
What is the Segment Anything Model (SAM)? The Segment Anything Model (SAM) is a foundational image segmentation model released by Meta AI Research last year, with pre-trained model weights available...
Tag 309K Images/$ with Recognize Anything Model++ (RAM++) On Consumer GPUs
What is the Recognize Anything Model++? The Recognize Anything Model++ (RAM++) is a state of the art image tagging foundational model released last year, with pre-trained model weights available on...
Parakeet TDT 1.1B Inference Benchmark on SaladCloud: 1,000,000 hours of transcription for Just $1260
Parakeet TDT 1.1B GPU benchmark The Automatic Speech Recognition (ASR) model, Parakeet TDT 1.1B, is the latest addition to NVIDIA's Parakeet family. Parakeet TDT 1.1B boasts unparalleled accuracy and significantly...
OpenVoice Text-to-Speech (TTS) Benchmark: 6 Million+ Words/$ Using Salad
What is OpenVoice? OpenVoice is an open-source, instant voice cloning technology that enables the creation of realistic and customizable speech from just a short audio clip of a reference speaker....
Whisper Large V3 Speech Recognition Benchmark: 1 Million hours of audio transcription for just $5110
Save over 99.8% on audio transcription using Whisper Large V3 and consumer GPUs A 99.8% cost-savings for automatic speech recognition sounds unreal. But with the right choice of GPUs and...
Tutorial: How to run your own GPU-accelerated JupyterLab on SaladCloud
In recent times, JupyterLab has gained popularity among data scientists and students because of its ease of use, flexibility, and extensibility. But access to resources and cost remains a hindrance....
Bark Benchmark: Reading 144K Recipes with Text-to-Speech on SaladCloud
Speech Synthesis with suno-ai/bark When you think of speech synthesis, you might think of a very robotic sounding voice, like this one from 1979. Maybe you think of more modern...
Comparing Price-Performance of 22 GPUs for AI Image Tagging (GTX vs RTX)
Older Consumer GPUs: A Perfect-Fit for AI Image Tagging In the current AI boom, there's a palpable excitement around sophisticated image generation models like Stable Diffusion XL (SDXL) and the...
YOLOv8 Benchmark: Object Detection on Salad’s GPUs (73% Cheaper Than Azure)
What is YOLOv8? In the fast-evolving world of AI, object detection has made remarkable strides, epitomized by YOLOv8. YOLO (You Only Look Once) is an object detection and image segmentation...
Training a custom YOLOv8 model on Salad for just $0.25
Click here for a step-by-step guide on training YOLOv8 on Salad Training a Custom YOLOv8 Model for Logo Detection In the dynamic world of AI and machine learning, the ability...
Your own ChatGPT for just $0.04/hr – with Ollama, ChatUI and Salad
Deploy your own LLM with Ollama & Huggingface Chat UI on Salad How much does it cost to build and deploy a ChatGPT-like product today? The cost could be anywhere...
Exploring AI Bias by Turning Faces into Salads – An Experiment
What is AI Bias in Image Generation? Type in ‘An engineer smiling at the camera’ as the prompt into a few AI image generators. What do you see? A collection...
Whisper Large Inference Benchmark: 137 Days of Audio Transcribed in 15 Hours for Just $117
Save Over 99% On Audio Transcription Using Whisper-Large-v2 and Consumer GPUs Harnessing the power of OpenAI's Whisper Large V2, an automatic speech recognition model, we've dramatically reduced audio transcription costs...
Optimizing AI Image Generation: Streamlining Stable Diffusion with ControlNet in Containerized Environments
Implementing Stable Diffusion with ControlNet in any containerized environment comes with a plethora of challenges, mainly due to the sizable amount of additional model weights required to be incorporated in...
Stable Diffusion v1.4 Inference Benchmark – GPUs & Clouds Compared
Stable Diffusion v1.4 GPU Benchmark - Inference Stable Diffusion v1.4 is an impressive text-to-image diffusion model developed by stability.ai. By utilizing the principles of diffusion processes, Stable Diffusion v1.4 produces visually appealing...
Stable Diffusion XL (SDXL) Benchmark – 769 Images Per Dollar on Salad
Stable Diffusion XL (SDXL) Benchmark A couple months back, we showed you how to get almost 5000 images per dollar with Stable Diffusion 1.5. Now, with the release of Stable...
Stable Diffusion v1.5 Benchmark On Consumer GPUs
Benchmarking Stable Diffusion v1.5 across 23 consumer GPUs What’s the best way to run inference at scale for stable diffusion? It depends on many factors. In this Stable Diffusion (SD)...
Stable Diffusion Inference Benchmark
Stable Diffusion Inference Benchmark on consumer-grade GPUs Are high-end consumer-grade GPUs good for Stable Diffusion inference at scale? If so, what would be the daily cost for generating millions of images? Do...
AI Transcription Benchmark: 1 Million Hours of Youtube Videos with Parakeet TDT 1.1B for Just $1260, a 1000-fold cost reduction
Building upon the inference benchmark of Parakeet TDT 1.1B on SaladCloud and with our ongoing efforts to enhance the system architecture and implementation for batch jobs, we have achieved a 1000-fold...
Inference Benchmark on Salad: Distil-Whisper Large V2 vs. Whisper Large V3 for Speech-to-text
Hugging Face Distil-Whisper Large V2 is a distilled version of the OpenAI Whisper model that is 6 times faster, 49% smaller and performs within 1% WER (word error rates) on...
Perfect Device Fingerprinting at Scale
The Idea The Web Scraping Clubs’ recent series on device fingerprinting has been making the rounds here at Salad, and this got the team and I very excited! Pierluigi Vinciguerra, co-founder of databoutique.com,...
SCE Beta Registration Now Open
Salad Container Engine (SCE) is a fully managed orchestration platform designed to distribute stateless container workloads across a massively scalable global network of consumer PCs. Featuring predictable, minute-by-minute fees, our purpose-built...
How the Kitchen Conquered 2021
When you're in the Salad Kitchen, time tastes a little bit different. Treasured gaming hours—those moments spent mercking kids on hot mics, puzzling our way out of dungeons, or exploring...
2022 In Review
It's difficult to measure the importance of a year. Whether you gauge success in lucky headshots or quarterly goals, there are simply too many moments and milestones in anyone's life...
Solving for Cost: Why Innovators Need a Decentralized Cloud
It's easy to see why over half of all cloud customers use containers. Containerization imparts improved portability to packaged software deployment, and adds a vital aspect of immutability that streamlines the progression...
Government Science on Citizen Machines – Why Distributed Cloud is the Way
Every year, private industry overlooks hundreds of potentially groundbreaking scientific computing projects, either due to the upfront cost or uncertain prospects for profitability. One of the most affected areas is...
Exploring Distributed Data Parallel (DDP) Training on Consumer GPUs
Our team is currently developing utility applications for Salad Container Engine (SCE), a fully managed container orchestration platform designed to leverage the heterogeneous hardware that makes up our uniquely decentralized network. It's distributed...
GPU shortage isn’t the problem for Generative AI. GPU selection is.
Are we truly out of GPU compute power or are we just looking in the wrong places for the wrong type of GPUs? Recently, GPU shortage has been in the news everywhere. Just take a...
How to Refactor Public Cloud to Reduce Cloud Cost
Cloud cost is ballooning for everyone. The global cloud market is expected to generate at least $206B in revenue this year, even as customers overwhelmingly fear overprovisioning and estimate that up to 32%...
SaladCast Episode 10: The Salad Business Model With CEO Bob Miles
Welcome to SaladCast! In this podcast series, we introduce you to Salad Chefs from all corners of the Infinite Kitchen. We hope you'll join us as we get to know members...
SaladCast Episode 11: Jared Carpenter on Salad’s Go-to-Market Strategy
Welcome to SaladCast! In this podcast series, we introduce you to Salad Chefs from all corners of the Infinite Kitchen. We hope you'll join us as we get to know members...
SaladCast Episode 12: Our Product Roadmap With Daniel Sarfati
Welcome to SaladCast! In this podcast series, we introduce you to Salad Chefs from all corners of the Infinite Kitchen. We hope you'll join us as we get to know members...
How Dreamup reduces AI image generation cloud cost with Salad
Using AI to reduce cloud costs and fund artists If you've spent any time on the internet in the last few months, two things will be everywhere. ChatGPT and how...
Centralization Is a Systems Design Problem
The opinions and commentary expressed herein are those of the author, and do not necessarily reflect the views of everyone at Salad. We accept a diversity of viewpoints, flavors, and...
SaladCast Episode 13: Kyle Dodson on Containerized Workloads
*Welcome to SaladCast! In this podcast series, we introduce you to Salad Chefs from all corners of the Infinite Kitchen. We hope you'll join us as we get to know members...
Decentralize, or Be Destroyed!
The opinions and commentary expressed herein are those of the author, and do not necessarily reflect the views of everyone at Salad. We accept a diversity of viewpoints, flavors, and...
Salad Launches Kubernetes Support at KubeCon 2023
Salad is excited to announce support for Kubernetes (K8s) through the Virtual Kubelet project. The K8s integration based on the SaladCloud Virtual Kubelet Provider will be showcased at the upcoming...
Salad Raises $17M to Decentralize the Cloud
Left Lane Capital and Origin Ventures co-lead our Series A, alongside existing investors Royal Street Ventures, Carthona Capital, and Kickstart Fund As Salad enters its fourth year, we're proud to have hundreds of thousands of PC...
A New Price-Performance Standard for BERT Transformers.
Engineers from Numenta used Salad Container Engine (SCE) to benchmark a first-of-its-kind intelligent computing platform that optimizes BERT transformer networks. Learn how Numenta attained 10x more inferences per dollar on SCE. Challenge Optimizing AI...
The AI GPU Shortage: How Gaming PCs Offer a Solution and a Challenge
Reliability in Times of AI GPU Shortage In the world of cloud computing, leading providers have traditionally utilized expansive, state-of-the-art data centers to ensure top-tier reliability. These data centers, boasting...
Analyzing the Stunning Realism of GTA6 with YOLOv8 and SaladCloud
Running YOLOv8 on the GTA6 trailer with Salad The gaming community was recently electrified with the release of a new trailer for "Grand Theft Auto VI" (GTA6), a title known...
Data Pipeline Processing with GPUs: Why, How, and Where
You can’t train foundational AI models without good data, and lots of it. Data pipeline processing is a crucial task for any team that is building, or even fine tuning,...
Announcing Salad’s SOC 2 Type 1 Certification
We are pleased to announce that Salad Technologies is now SOC 2 Type I Compliant, reinforcing our commitment to democratize the cloud while ensuring the highest standards of security &...
Don’t miss anything!