Show HN: Salad, a distributed cloud for AI (like Airbnb for GPUs)

{
  "by": "bobjmiles",
  "descendants": 0,
  "id": 40248345,
  "score": 1,
  "text": "Hey HN! Bob here, Founder and CEO of Salad ([www.salad.com](<a href=\"http:&#x2F;&#x2F;www.salad.comwww.salad.com\" rel=\"nofollow\">http:&#x2F;&#x2F;www.salad.comwww.salad.com</a>)), a distributed cloud for AI inference at scale.<p>*Why Salad?* Because there’s 400 Million consumer GPUs in the world (~100 Million AI-enabled RTX GPUS) and most of them lie unused for 18-22 hrs a day.<p>These consumer GPUs offer similar or better cost-performance than high-end AI GPUs for many AI&#x2F;ML use cases (Speech-to-text, batch jobs, text-to-image, computer vision to name a few).<p>With Salad, we have activated this latent compute in everyday PCs to power AI&#x2F;ML workloads.<p>*How big is our network?* More than 1,900,000 individual PC owners on the network. Around 10K+ GPUs (RTX&#x2F;GTX series) are running AI workloads from companies at any given time.<p>*What’s in it for AI companies &amp; data scientists?*<p>Users get GPUs at the lowest market price with high scalability<p>*What’s in it for people sharing GPU time?*<p>GPU owners get rewards ranging $20 - $180 depending on the GPU type (Higher vRAM GPUs earn more). These rewards can be exchanged in our marketplace for gift cards, games and more.<p>*How are our prices?*<p>GPU prices start from $0.02&#x2F;hour and across different consumer GPUs, we have the lowest price and largest scale in the market.<p>For ex, an RTX 3080Ti for AI transcription costs $0.0012&#x2F;hour with a self-managed OS model on Salad. The next best cost in the market is an API ($0.28&#x2F;hr).<p>*Who can run on SaladCloud today?*<p>Here are the best fits for our infra today:<p>(1) Needs &gt;3 GPUs running 24*7<p>(2) AI inference workloads or batch processing<p>(3) No compliance-related workloads (HIPAA, etc) or highly sensitive&#x2F;proprietary data<p>As a distributed cloud, we are workload-agnostic. That being said, with our current features &amp; team, we are best poised to support AI&#x2F;ML workloads. As we grow, we will add more support for other workloads.<p>We’re happy to offer $1000 in free credits if you have a demand for more than 10 GPUs per month running consistently.<p>Just sign up for a demo call and select ‘HackerNews’ in the ‘How did you hear about us?’ field.<p>Book a call to discuss your use case: <a href=\"https:&#x2F;&#x2F;salad.com&#x2F;get-a-demo\" rel=\"nofollow\">https:&#x2F;&#x2F;salad.com&#x2F;get-a-demo</a><p>Signup for SaladCloud here: <a href=\"https:&#x2F;&#x2F;portal.salad.com&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;portal.salad.com&#x2F;</a><p>To earn with your PC, download the Salad app here: <a href=\"https:&#x2F;&#x2F;salad.com&#x2F;download\" rel=\"nofollow\">https:&#x2F;&#x2F;salad.com&#x2F;download</a><p>GitHub Repo: <a href=\"https:&#x2F;&#x2F;github.com&#x2F;SaladTechnologies\">https:&#x2F;&#x2F;github.com&#x2F;SaladTechnologies</a><p>Our mission is to democratize cloud computing with a fully people-powered cloud and helping companies break free from the cloud monopoly!",
  "time": 1714747893,
  "title": "Show HN: Salad, a distributed cloud for AI (like Airbnb for GPUs)",
  "type": "story",
  "url": "https://salad.com/"
}

{
  "author": null,
  "date": null,
  "description": "Save up to 90% on cloud costs compared to hyperscalers. Deploy AI/ML production models easily on the world’s largest distributed cloud. Perfect for AI inference, batch processing, molecular dynamics & more.",
  "image": "https://uploads-ssl.webflow.com/657145f7e647f68f04562685/658075992cdde6c9d1975a1b_image%20106.png",
  "logo": "https://logo.clearbit.com/salad.com",
  "publisher": "Salad",
  "title": "Salad - Distributed GPU Cloud | 11,000+ daily active GPUs from $0.02/hour",
  "url": "https://salad.com/"
}

{
  "url": "https://salad.com/",
  "title": "Salad - Distributed GPU Cloud | 11,000+ daily active GPUs from $0.02/hour",
  "description": "Save up to 90% on cloud costs compared to hyperscalers. Deploy AI/ML production models easily on the world's largest distributed cloud. Perfect for AI inference, batch processing, molecular dynamics & more.",
  "links": [
    "https://salad.com/"
  ],
  "image": "https://uploads-ssl.webflow.com/657145f7e647f68f04562685/658075992cdde6c9d1975a1b_image%20106.png",
  "content": "<div>\n        <div>\n            <div>\n                    <div>\n                        <p><img src=\"https://salad.com/images/Justin-Maier---Circle---Civitai.png\" /></p>\n                        <p>SaladCloud user</p>\n                        <div><p>\"SaladCloud offered us <span><strong>the lowest GPU prices in the market</strong></span> with incredible scalability.\"</p><p><strong>Justin Maier<br />Founder &amp; CEO, Civitai</strong></p></div>\n                      </div>\n                    <div>\n                        <p><img src=\"https://salad.com/images/Kyle-LeProvost.png\" srcset=\"https://salad.com/images/Kyle-LeProvost-p-500.png 500w, https://salad.com/images/Kyle-LeProvost.png 552w\" /></p>\n                        <p>SaladCloud supplier</p>\n                        <div><p>\"As a cybersecurity professional, I appreciate Salad's <span><strong>commitment to platform security</strong> </span>for customers and compute providers alike.\"</p><p><strong>Kyle LePrevost <br />Cybersecurity Architect <br /></strong></p></div>\n                      </div>\n                  </div>\n            <div>\n                <div>\n                  <p>450K+</p>\n                  <p>Worldwide earning nodes</p>\n                </div>\n                <div>\n                  <p>$0.02/hr</p>\n                  <p>GPU starting price</p>\n                </div>\n              </div>\n          </div>\n      <div>\n              <div>\n                  <div>\n                    <p>Cut compute costs by up to 90%</p>\n                  </div>\n                  <div>\n                    <h4>Get in touch with Sales for discounted pricing</h4>\n                    <p>Save even more for high-volume GPU use. </p>\n                  </div>\n                </div>\n              <p><img src=\"https://salad.com/images/saladcloud12.png\" srcset=\"https://salad.com/images/saladcloud12-p-500.png 500w, https://salad.com/images/saladcloud12-p-800.png 800w, https://salad.com/images/saladcloud12-p-1080.png 1080w, https://salad.com/images/saladcloud12.png 1089w\" /></p>\n            </div>\n      <div>\n              <p>\n                </p><h4> <span>100s</span><span> </span>of innovative companies trust SaladCloud</h4>\n              <p></p>\n            </div>\n      <div>\n                        <p>SAVE BIG ON THE LOWEST-PRICED GPU CLOUD</p>\n                        <div>\n                          <p>\n                            </p><h2>Stop overspending. <br />Start <span>Computesharing.</span></h2>\n                          <p></p>\n                          <p>Scale quickly to thousands of GPU instances worldwide without the need to manage VMs or individual instances, all with a simple usage-based price structure.</p>\n                        </div>\n                      </div>\n      <div>\n              <div>\n                    <h4>Try our GPU pricing calculator</h4>\n                    <p>See how much you save switching to SaladCloud.</p>\n                  </div>\n              <p><img src=\"https://salad.com/images/SaladCloud---GPU-picker-3.png\" srcset=\"https://salad.com/images/SaladCloud---GPU-picker-3-p-500.png 500w, https://salad.com/images/SaladCloud---GPU-picker-3-p-800.png 800w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1080.png 1080w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1600.png 1600w, https://salad.com/images/SaladCloud---GPU-picker-3.png 1909w\" /></p>\n            </div>\n      <div>\n                <div>\n                        <p>Connecting idle GPUs worldwide to compute-hungry businesses securely</p>\n                        <h2>Why AI teams &amp; GPU owners choose <span>SaladCloud</span><br /></h2>\n                      </div>\n                <div>\n                  <p>\n                    </p><h3>Low-cost, high-scale community cloud for seamless <span>AI project scaling</span></h3>\n                  <p></p>\n                  <div>\n                      <div>\n                          <p><img src=\"https://salad.com/images/Logo---Civitai---bw.png\" srcset=\"https://salad.com/images/Logo---Civitai---bw-p-500.png 500w, https://salad.com/images/Logo---Civitai---bw-p-800.png 800w, https://salad.com/images/Logo---Civitai---bw.png 1028w\" /></p>\n                          <div>\n                            <blockquote>“By switching to SaladCloud, we are serving inference on over 600 consumer GPUs to deliver 10 Million images per day and training more than 15,000 LoRAs per month. SaladCloud not only had the<strong> </strong><span><strong>lowest GPU prices</strong></span> in the market but also offered us incredible scalability.”</blockquote>\n                            <p>Justin Maier</p>\n                            <p>Founder &amp; CEO, Civitai</p>\n                            <p>\n                              <a href=\"https://blog.salad.com/civitai-salad\" target=\"_blank\">Read case study &gt;</a>\n                            </p>\n                          </div>\n                        </div>\n                      <div>\n                          <p><img src=\"https://salad.com/images/Logo---Blend---bw.png\" srcset=\"https://salad.com/images/Logo---Blend---bw-p-500.png 500w, https://salad.com/images/Logo---Blend---bw-p-800.png 800w, https://salad.com/images/Logo---Blend---bw.png 1028w\" /></p>\n                          <div>\n                            <blockquote>\"On SaladCloud's consumer GPUs, we are running 3X more scale at half the cost of A100s on our local provider and almost <strong>85% less cost than the two major hyperscalers</strong> we were using before.I’m not losing sleep over scaling issues anymore.\"</blockquote>\n                            <p><strong>Jamsheed Kamardeen</strong></p>\n                            <p>CTO, Blend</p>\n                            <p>\n                              <a href=\"https://blog.salad.com/blend-salad/\" target=\"_blank\">Read case study &gt;</a>\n                            </p>\n                          </div>\n                        </div>\n                      <div>\n                          <p><img src=\"https://salad.com/images/klyne-logo.png\" /></p>\n                          <div>\n                            <blockquote>\"If you want access to 1000s of GPUs, you can get them on SaladCloud for better cost-efficiency. Salad is also <strong>really customer friendly</strong>, something you cannot get from a larger cloud provider as a startup.\"</blockquote>\n                            <p>Zachary Lawrence</p>\n                            <p>CEO, Klyne.ai</p>\n                          </div>\n                        </div>\n                    </div>\n                </div>\n                <div>\n                  <p>\n                    </p><h3>Helping GPU owners turn idle power <span>into tangible income</span></h3>\n                  <p></p>\n                  <div>\n                      <div>\n                          <div>\n                            <p><img src=\"https://salad.com/images/Kyle-LeProvost.png\" srcset=\"https://salad.com/images/Kyle-LeProvost-p-500.png 500w, https://salad.com/images/Kyle-LeProvost.png 552w\" /></p>\n                          </div>\n                          <div>\n                            <blockquote>\"Salad is incredibly easy to set up and use, offers great rewards like Nitro and Amazon gift cards, and allows me to pause and resume whenever I need my hardware. As a cybersecurity professional, I also appreciate Salad’s <strong>commitment to platform security</strong> - they do a good job making sure the platform is safe for customers and Chefs alike.\"</blockquote>\n                            <p>Kyle LePrevost</p>\n                            <p>Cybersecurity architect</p>\n                          </div>\n                        </div>\n                      <div>\n                          <div>\n                            <p><img src=\"https://salad.com/images/Netanel.png\" srcset=\"https://salad.com/images/Netanel-p-500.png 500w, https://salad.com/images/Netanel.png 750w\" /></p>\n                          </div>\n                          <div>\n                            <blockquote>\"Ever since discovering Salad, I’ve stopped letting my computer sit idle, wasting electricity. Instead, I’ve put my PC to work and earned<strong> rewards which I can easily redeem</strong> on the storefront on things I love, like video games and anime merchandise. Salad has been a game changer, turning my computer's downtime into something truly valuable.\"</blockquote>\n                            <p><strong>Netanel Takuni</strong></p>\n                            <p>Logistics specialist</p>\n                          </div>\n                        </div>\n                      <div>\n                          <div>\n                            <p><img src=\"https://salad.com/images/Brandon-Coin-1.png\" srcset=\"https://salad.com/images/Brandon-Coin-1-p-500.png 500w, https://salad.com/images/Brandon-Coin-1.png 750w\" /></p>\n                          </div>\n                          <div>\n                            <blockquote>\"I've been using Salad for about six months, and it's been a significant shift from traditional crypto mining for me. Embracing this platform has allowed me to explore new and exciting ways to <strong>utilize my computer hardware</strong>.  </blockquote>\n                            <p>Brandon Coin</p>\n                            <p>BC-PC.com</p>\n                          </div>\n                        </div>\n                    </div>\n                </div>\n              </div>\n      <div>\n                <div>\n                    <p>\n                      </p><h2>Built for <span>Inference</span> at Scale</h2>\n                    <p></p>\n                    <p>Scale quickly to thousands of GPU instances worldwide without the need to manage VMs or individual instances, all with a simple usage-based price structure.</p>\n                  </div>\n                <div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Reduce-Budget-Float.svg\" alt=\"Reduce budget bloat by lowering your AI/ML cloud costs\" /></p>\n                    <p>\n                      </p><h3>Reduce Budget Bloat</h3>\n                    <p></p>\n                    <p>Save up to 90% on orchestration services from big box providers, plus discounts on recurring plans.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Frame-1886.svg\" alt=\"gpu driven processing\" /></p>\n                    <p>\n                      </p><h3>GPU-Driven Processing</h3>\n                    <p></p>\n                    <p>Distribute data batch jobs, HPC workloads, and rendering queues to thousands of 3D accelerated GPUS.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1880.svg\" alt=\"global edge network\" /></p>\n                    <p>\n                      </p><h3>Global Edge Network</h3>\n                    <p></p>\n                    <p>Bring workloads to the brink on low-latency edge nodes located in nearly every corner of the planet.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1881.svg\" alt=\"Distributed network\" /></p>\n                    <p>\n                      </p><h3>Multi-cloud Compatible</h3>\n                    <p></p>\n                    <p>Deploy Salad Container Engine workloads alongside your existing hybrid or multi-cloud configurations.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1879.svg\" alt=\"On-demand elasticity\" /></p>\n                    <p>\n                      </p><h3>On-Demand Elasticity</h3>\n                    <p></p>\n                    <p>Scale your workloads effortlessly with dynamic resource allocation, meeting fluctuating demands in real time without over-provisioning.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1882.svg\" alt=\"Optimized usage fees\" /></p>\n                    <p>\n                      </p><h3>Optimized Usage Fees</h3>\n                    <p></p>\n                    <p>Experience flexible pricing tailored to your usage, ensuring cost-effective scaling without compromising performance.</p>\n                  </div>\n                </div>\n              </div>\n      <div>\n              <div>\n                    <p>\n                      </p><h2>Perfect for <span>GPU-heavy</span> <br />workloads of any type</h2>\n                    <p></p>\n                    <p>Scale quickly to thousands of GPU instances worldwide without the need to manage VMs or individual instances, all with a simple usage-based price structure.</p>\n                  </div>\n              <div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Get more images per dollar than any other cloud</p>\n                          </div>\n                          <div>\n                            <p>4265 images/$ for Flux.1-Schnell</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud---text-to-image-1.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Convert 4.7 million words/$ with OpenVoice</p>\n                          </div>\n                          <div>\n                            <p>Convert 39,000 words/$ with Bark TTS</p>\n                          </div>\n                          <div>\n                            <p>Convert 23,300 words/$ with MetaVoice</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-text-to-speech.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Pricing from $0.10 per hour</p>\n                          </div>\n                          <div>\n                            <p>91.13% accuracy powered by Whisper Large v3</p>\n                          </div>\n                          <div>\n                            <p>LLM-based insights using Llama 3 8B</p>\n                          </div>\n                        </div>\n                      <p><img srcset=\"https://salad.com/images/Salad-Transcription-API-p-500.png 500w, https://salad.com/images/Salad-Transcription-API-p-800.png 800w, https://salad.com/images/Salad-Transcription-API-p-1080.png 1080w, https://salad.com/images/Salad-Transcription-API.png 1362w\" alt=\"Salad AI Transcription\" src=\"https://salad.com/images/Salad-Transcription-API.png\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Tag 309,000 images/$ with RAM++  </p>\n                          </div>\n                          <div>\n                            <p>Segment 50,000 images/$ with SAM</p>\n                          </div>\n                          <div>\n                            <p>73% less cost than Azure for object detection</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-computer-vision.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>$0.12 per Million tokens avg. for TGI</p>\n                          </div>\n                          <div>\n                            <p>$0.04/hr starting price to deploy own LLM</p>\n                          </div>\n                          <div>\n                            <p>$0.22/hr to run 7 Billion parameter models</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-llm.svg\" /></p>\n                    </div>\n                </div>\n            </div>\n      <div>\n                        <p>\n                          </p><h2>Read the SaladCloud blog</h2>\n                        <p></p>\n                        <p>Benchmarks, tutorials, product updates and more.</p>\n                        <p><a href=\"https://blog.salad.com/\" target=\"_blank\">Read the blog</a>\n                      </p></div>\n      <div>\n              <p><img src=\"https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11.png\" srcset=\"https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11-p-500.png 500w, https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11-p-800.png 800w, https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11-p-1080.png 1080w, https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11-p-1600.png 1600w, https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11-p-2000.png 2000w, https://salad.com/images/Salad-Dreambooth-API-for-Stable-Diffusion-Training---11.png 2236w\" /></p>\n              <div>\n                <p>\n                  </p><h2>Break free from the big cloud monopoly</h2>\n                <p></p>\n                <p>We can’t print our way out of the chip shortage. Run your workloads on the edge with already available resources. Democratization of cloud computing is the key to a sustainable future, after all.</p>\n                <div>\n                    <div>\n                        <p>Take advantage of geo-distributed nodes</p>\n                        <p>Save your deployments from outages &amp; shortages with 1 million+ distributed nodes across 180+ countries.</p>\n                      </div>\n                    <div>\n                        <p>A sustainable way to compute for the future</p>\n                        <p>Deploying unused, latent GPUs lessens the environmental impact, safeguards against tech monopolies, and democratizes access &amp; profits from computing.</p>\n                      </div>\n                  </div>\n              </div>\n            </div>\n      <div>\n                <div>\n                  <p>\n                    </p><h2>Lower your total cost of ownership (TCO) on cloud</h2>\n                  <p></p>\n                  <p>The high total cost of ownership (TCO) on popular clouds is a well-known secret. With SaladCloud, you containerize your application, choose your resources, and we manage the rest, lowering your TCO and getting to market quickly.</p>\n                  <div>\n                      <div>\n                          <p>Unmatched inference. Unbeatable prices.</p>\n                          <p>Compared to other clouds, we offer 10X more inferences per dollar. If you find a lower price, we will beat the bill.</p>\n                        </div>\n                      <div>\n                          <p>Scale as you grow without breaking the bank</p>\n                          <p>Scale up (or down) easily with no pre-paid contracts, no commitments and transparent, usage-based pricing.</p>\n                        </div>\n                    </div>\n                </div>\n                <p><img src=\"https://salad.com/images/SaladCloud---GPU-picker-3.png\" alt=\"Salad GPU cloud - deployment options\" srcset=\"https://salad.com/images/SaladCloud---GPU-picker-3-p-500.png 500w, https://salad.com/images/SaladCloud---GPU-picker-3-p-800.png 800w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1080.png 1080w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1600.png 1600w, https://salad.com/images/SaladCloud---GPU-picker-3.png 1909w\" /></p>\n              </div>\n      <div>\n                <p><img src=\"https://salad.com/images/SaladCloud---Container-groups-2.png\" srcset=\"https://salad.com/images/SaladCloud---Container-groups-2-p-500.png 500w, https://salad.com/images/SaladCloud---Container-groups-2-p-800.png 800w, https://salad.com/images/SaladCloud---Container-groups-2-p-1080.png 1080w, https://salad.com/images/SaladCloud---Container-groups-2-p-1600.png 1600w, https://salad.com/images/SaladCloud---Container-groups-2.png 1812w\" alt=\"Salad GPU cloud distributed network\" /></p>\n                <div>\n                  <p>\n                    </p><h2>Deploy securely to geo-distributed nodes with high availability</h2>\n                  <p></p>\n                  <p>Over 1 million individual nodes and 100s of customers trust SaladCloud with their resources and applications.</p>\n                  <div>\n                      <div>\n                          <p>Redundant security and compliance</p>\n                          <p>SaladCloud is SOC2 certified, and our patented approach isolates customer environments and data across our network.</p>\n                        </div>\n                      <div>\n                          <p>Reliable nodes available in plenty</p>\n                          <p>Don’t get tied into expensive contracts and prepayments just to get a shocking cloud bill as you scale. Access GPUs when you need them at the lowest cost, not when ‘they’ can provide them.</p>\n                        </div>\n                    </div>\n                </div>\n              </div>\n      <div>\n              <div>\n                <h2>Frequently Asked <span>Questions</span><br /></h2>\n              </div>\n              <div>\n                  <div>\n                    <div>\n                      <div>\n                        <p>What kind of GPUs does SaladCloud have?</p>\n                      </div>\n                        <p>All GPUs on SaladCloud belong to the RTX/GTX class of GPUs from Nvidia. Our GPU selection policy is strict and we only onboard AI-enabled, high performance compute capable GPUs to the network.<br /></p>\n                    </div>\n                    <div>\n                      <div>\n                        <p><strong>How does security work on SaladCloud?</strong></p>\n                      </div>\n                        <p>We have several layers of security to keep your containers safe, encrypting them in transit, and at rest. Containers run in an isolated environment on our nodes - keeping your data isolated and also ensuring you have the same compute environment regardless of the machine you’re running on.</p>\n                    </div>\n                    <div>\n                      <div>\n                        <p>What are some unique traits of SaladCloud?</p>\n                      </div>\n                        <p>Since SaladCloud is a compute-share network, our GPUs have longer cold start times than usual, and are subject to interruption. The highest vRAM on the network is 24 GB. Workloads requiring extremely low latency times are not a fit for our network.</p>\n                    </div>\n                    <div>\n                      <div>\n                        <p>What is Salad Container Engine (SCE)?</p>\n                      </div>\n                        <p>Workloads are deployed to SaladCloud via docker containers. SCE is a massively scalable orchestration engine, purpose-built to simplify this container development.Containerize your model and inference server, choose the hardware and we take care of the rest.</p>\n                    </div>\n                  </div>\n                  <div>\n                    <div>\n                      <div>\n                        <p><strong>How does SaladCloud work?</strong></p>\n                      </div>\n                        <p>GPUs on SaladCloud are similar to spot instances. Some providers share GPUs for 20-22 hours a day. Others share GPUs for 1-2 hours per day. Users running workloads select the GPU types and quantity. SaladCloud handles all the orchestration in the backend and ensures you will have uninterrupted GPU time as per requirements.</p>\n                    </div>\n                    <div>\n                      <div>\n                        <p><strong>Why do owners share GPUs with SaladCloud?</strong></p>\n                      </div>\n                        <p>Owners earn rewards (in the form of Salad balance) for sharing their compute. Many compute providers earn <br />$30−$200 per month on SaladCloud as a reward that they exchange for games, gift cards and more.</p>\n                    </div>\n                    <div>\n                      <div>\n                        <p><strong>What if a host tries to access my container?</strong></p>\n                      </div>\n                        <p>Our constant host intrusion detection tests look for operations like folder access, opening a shell, etc. If a host machine tries to access the linux environment, we automatically implode the environment and blacklist the machine. We’re also bringing Falco into our runtime for a more robust set of checks.</p>\n                    </div>\n                    <div>\n                      <div>\n                        <p>How do I know a GPU is performant? What if it goes offline? </p>\n                      </div>\n                        <p>We use a proprietary trust rating system to index node performance, forecast availability, and select the optimal hardware configuration for deployment. We also run proprietary tests on every GPU to determine their fit for our network. Salad Container Engine automatically reallocates your workload to another GPU (same type and class) when a resource goes offline.<br /> </p>\n                    </div>\n                  </div>\n                </div>\n            </div>\n      <div>\n                  <p>\n                    </p><h2>Run popular models or bring your own </h2>\n                  <p></p>\n                </div>\n      <div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/No-VM-Management.svg\" alt=\"No virtual machine management on SaladCloud\" /></p>\n                    <p>You don’t have to manage any Virtual Machines (VMs).</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon.svg\" alt=\"Less data costs\" /></p>\n                    <p>No ingress/egress costs on SaladCloud. No surprises.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon-1.svg\" alt=\"Less DevOps\" /></p>\n                    <p>Save time &amp; resources with minimal DevOps work.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon-2.svg\" alt=\"Infinite GPU scalability on cloud\" /></p>\n                    <p>Scale without worrying about access to GPUs.</p>\n                  </div>\n                </div>\n    </div>",
  "author": "",
  "favicon": "https://salad.com/images/favicon.svg",
  "source": "salad.com",
  "published": "",
  "ttr": 289,
  "type": "website"
}