Show HN: Salad, a distributed cloud for AI (like Airbnb for GPUs)

{
  "by": "bobjmiles",
  "descendants": 0,
  "id": 40248345,
  "score": 1,
  "text": "Hey HN! Bob here, Founder and CEO of Salad ([www.salad.com](<a href=\"http:&#x2F;&#x2F;www.salad.comwww.salad.com\" rel=\"nofollow\">http:&#x2F;&#x2F;www.salad.comwww.salad.com</a>)), a distributed cloud for AI inference at scale.<p>*Why Salad?* Because there’s 400 Million consumer GPUs in the world (~100 Million AI-enabled RTX GPUS) and most of them lie unused for 18-22 hrs a day.<p>These consumer GPUs offer similar or better cost-performance than high-end AI GPUs for many AI&#x2F;ML use cases (Speech-to-text, batch jobs, text-to-image, computer vision to name a few).<p>With Salad, we have activated this latent compute in everyday PCs to power AI&#x2F;ML workloads.<p>*How big is our network?* More than 1,900,000 individual PC owners on the network. Around 10K+ GPUs (RTX&#x2F;GTX series) are running AI workloads from companies at any given time.<p>*What’s in it for AI companies &amp; data scientists?*<p>Users get GPUs at the lowest market price with high scalability<p>*What’s in it for people sharing GPU time?*<p>GPU owners get rewards ranging $20 - $180 depending on the GPU type (Higher vRAM GPUs earn more). These rewards can be exchanged in our marketplace for gift cards, games and more.<p>*How are our prices?*<p>GPU prices start from $0.02&#x2F;hour and across different consumer GPUs, we have the lowest price and largest scale in the market.<p>For ex, an RTX 3080Ti for AI transcription costs $0.0012&#x2F;hour with a self-managed OS model on Salad. The next best cost in the market is an API ($0.28&#x2F;hr).<p>*Who can run on SaladCloud today?*<p>Here are the best fits for our infra today:<p>(1) Needs &gt;3 GPUs running 24*7<p>(2) AI inference workloads or batch processing<p>(3) No compliance-related workloads (HIPAA, etc) or highly sensitive&#x2F;proprietary data<p>As a distributed cloud, we are workload-agnostic. That being said, with our current features &amp; team, we are best poised to support AI&#x2F;ML workloads. As we grow, we will add more support for other workloads.<p>We’re happy to offer $1000 in free credits if you have a demand for more than 10 GPUs per month running consistently.<p>Just sign up for a demo call and select ‘HackerNews’ in the ‘How did you hear about us?’ field.<p>Book a call to discuss your use case: <a href=\"https:&#x2F;&#x2F;salad.com&#x2F;get-a-demo\" rel=\"nofollow\">https:&#x2F;&#x2F;salad.com&#x2F;get-a-demo</a><p>Signup for SaladCloud here: <a href=\"https:&#x2F;&#x2F;portal.salad.com&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;portal.salad.com&#x2F;</a><p>To earn with your PC, download the Salad app here: <a href=\"https:&#x2F;&#x2F;salad.com&#x2F;download\" rel=\"nofollow\">https:&#x2F;&#x2F;salad.com&#x2F;download</a><p>GitHub Repo: <a href=\"https:&#x2F;&#x2F;github.com&#x2F;SaladTechnologies\">https:&#x2F;&#x2F;github.com&#x2F;SaladTechnologies</a><p>Our mission is to democratize cloud computing with a fully people-powered cloud and helping companies break free from the cloud monopoly!",
  "time": 1714747893,
  "title": "Show HN: Salad, a distributed cloud for AI (like Airbnb for GPUs)",
  "type": "story",
  "url": "https://salad.com/"
}

{
  "author": "Justin",
  "date": null,
  "description": "Save up to 90% on cloud costs compared to hyperscalers. Deploy AI/ML production models easily on the world’s largest distributed cloud. Perfect for AI inference, batch processing, molecular dynamics & more.",
  "image": "https://uploads-ssl.webflow.com/657145f7e647f68f04562685/658075992cdde6c9d1975a1b_image%20106.png",
  "logo": "https://logo.clearbit.com/salad.com",
  "publisher": "Salad",
  "title": "Salad - Distributed GPU Cloud | 11,000+ daily active GPUs from $0.02/hour",
  "url": "https://salad.com/"
}

{
  "url": "https://salad.com/",
  "title": "Salad - Distributed GPU Cloud | 11,000+ daily active GPUs from $0.02/hour",
  "description": "Save up to 90% on cloud costs compared to hyperscalers. Deploy AI/ML production models easily on the world's largest distributed cloud. Perfect for AI inference, batch processing, molecular dynamics & more.",
  "links": [
    "https://salad.com/"
  ],
  "image": "https://uploads-ssl.webflow.com/657145f7e647f68f04562685/658075992cdde6c9d1975a1b_image%20106.png",
  "content": "<div>\n        <div>\n                <div>\n                  <p>450K+</p>\n                  <p>Worldwide earning nodes</p>\n                </div>\n                <div>\n                  <p>$0.02/hr</p>\n                  <p>GPU starting price</p>\n                </div>\n              </div>\n      <div>\n                <div>\n                      <p>Have questions about enterprise pricing for SaladCloud? </p>\n                      <h2>Get in touch with our Sales team. <br /></h2>\n                    </div>\n                <p><a target=\"_blank\" href=\"https://salad.com/sales-salad-gpu-cloud\">Talk to Sales</a>\n              </p></div>\n      <div>\n              <p>\n                </p><h4> <span>100s</span><span> </span>of innovative companies trust SaladCloud</h4>\n              <p></p>\n            </div>\n      <div>\n                <div>\n                      <p>\n                        </p><h2>Scale without <span>overspending</span> </h2>\n                      <p></p>\n                      <p>Consumer GPUs like the RTX 4090 offer better cost-performance for many use cases, such as AI inference and batch jobs. SaladCloud offers a fully managed container service, opening up access to thousands of AI-enabled consumer GPUs on the world’s largest distributed network.</p>\n                    </div>\n                <div>\n                  <a target=\"_blank\" href=\"https://salad.com/#\"><img src=\"https://salad.com/images/Saladcloud---Introduction.png\" srcset=\"https://salad.com/images/Saladcloud---Introduction-p-500.png 500w, https://salad.com/images/Saladcloud---Introduction-p-800.png 800w, https://salad.com/images/Saladcloud---Introduction-p-1080.png 1080w, https://salad.com/images/Saladcloud---Introduction-p-1600.png 1600w, https://salad.com/images/Saladcloud---Introduction-p-2000.png 2000w, https://salad.com/images/Saladcloud---Introduction-p-2600.png 2600w, https://salad.com/images/Saladcloud---Introduction.png 3027w\" />\n                  </a>\n                </div>\n              </div>\n      <div>\n                <div>\n                        <p>Lowest GPU prices. Incredible scalability. Up to 90% less cost than hyperscalers. </p>\n                        <h2>Why AI teams choose <span>SaladCloud</span><br /></h2>\n                      </div>\n                <div>\n                      <div>\n                            <div>\n                              <p>Founder, Civitai</p>\n                              <p><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /></p>\n                              <p>“By switching to SaladCloud, Civitai is now serving inference on over 600 consumer GPUs to deliver 10 Million images per day and training more than 15,000 LoRAs per month. SaladCloud not only had the lowest GPU prices in the market but also offered us incredible scalability.\"</p>\n                            </div>\n                            <p><img srcset=\"https://salad.com/images/Civitai-home-screen-p-500.png 500w, https://salad.com/images/Civitai-home-screen-p-800.png 800w, https://salad.com/images/Civitai-home-screen-p-1080.png 1080w, https://salad.com/images/Civitai-home-screen-p-1600.png 1600w, https://salad.com/images/Civitai-home-screen.png 1892w\" alt=\"Civitai Salad Case Study\" src=\"https://salad.com/images/Civitai-home-screen.png\" /></p>\n                          </div>\n                      <div>\n                            <div>\n                              <p>Jamsheed Kamardeen</p>\n                              <p>Chief Technology Officer, Blend</p>\n                              <p><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /></p>\n                              <p>“On SaladCloud's consumer GPUs, we are running 3X more scale at half the cost of A100s on our local provider and almost 85% less cost than the two major hyperscalers we were using before.I’m not losing sleep over scaling issues anymore.”</p>\n                            </div>\n                            <p><img srcset=\"https://salad.com/images/Blend-AI-product-pics-p-500.jpg 500w, https://salad.com/images/Blend-AI-product-pics-p-800.jpg 800w, https://salad.com/images/Blend-AI-product-pics.jpg 947w\" alt=\"Blend Salad case study\" src=\"https://salad.com/images/Blend-AI-product-pics.jpg\" /></p>\n                          </div>\n                      <div>\n                            <div>\n                              <p>Shawn Rushefsky</p>\n                              <p>Founder, Dreamup</p>\n                              <p><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /></p>\n                              <p>“SaladCloud makes it more realistic to keep up with deploying these new models. We might never deploy most of them if we had to pay AWS cost for them.”</p>\n                            </div>\n                            <p><img srcset=\"https://salad.com/images/dreamup-screen-1-3-min-p-500.png 500w, https://salad.com/images/dreamup-screen-1-3-min-p-800.png 800w, https://salad.com/images/dreamup-screen-1-3-min-p-1080.png 1080w, https://salad.com/images/dreamup-screen-1-3-min-p-1600.png 1600w, https://salad.com/images/dreamup-screen-1-3-min-p-2000.png 2000w, https://salad.com/images/dreamup-screen-1-3-min-p-2600.png 2600w, https://salad.com/images/dreamup-screen-1-3-min.png 2909w\" alt=\"Dreamup Salad case study\" src=\"https://salad.com/images/dreamup-screen-1-3-min.png\" /></p>\n                          </div>\n                      <div>\n                            <div>\n                              <p>Shawn Rushefsky</p>\n                              <p>Founder, DreamUp</p>\n                              <p><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /><img src=\"https://salad.com/images/Star.svg\" /></p>\n                              <p>“Salad makes it more realistic to keep up with deploying these new models. We might never deploy most of them if we had to pay AWS cost for them.”</p>\n                            </div>\n                            <p><img srcset=\"https://salad.com/images/dreamup-screen-1-3-min-p-500.png 500w, https://salad.com/images/dreamup-screen-1-3-min-p-800.png 800w, https://salad.com/images/dreamup-screen-1-3-min-p-1080.png 1080w, https://salad.com/images/dreamup-screen-1-3-min-p-1600.png 1600w, https://salad.com/images/dreamup-screen-1-3-min-p-2000.png 2000w, https://salad.com/images/dreamup-screen-1-3-min-p-2600.png 2600w, https://salad.com/images/dreamup-screen-1-3-min.png 2909w\" src=\"https://salad.com/images/dreamup-screen-1-3-min.png\" /></p>\n                          </div>\n                    </div>\n              </div>\n      <div>\n                <div>\n                    <p>\n                      </p><h2>Built for <span>Inference</span> at Scale</h2>\n                    <p></p>\n                    <p>Scale quickly to thousands of GPU instances worldwide without the need to manage VMs or individual instances, all with a simple usage-based price structure.</p>\n                  </div>\n                <div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Reduce-Budget-Float.svg\" alt=\"Reduce budget bloat by lowering your AI/ML cloud costs\" /></p>\n                    <p>\n                      </p><h3>Reduce Budget Bloat</h3>\n                    <p></p>\n                    <p>Save up to 90% on orchestration services from big box providers, plus discounts on recurring plans.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Frame-1886.svg\" alt=\"gpu driven processing\" /></p>\n                    <p>\n                      </p><h3>GPU-Driven Processing</h3>\n                    <p></p>\n                    <p>Distribute data batch jobs, HPC workloads, and rendering queues to thousands of 3D accelerated GPUS.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1880.svg\" alt=\"global edge network\" /></p>\n                    <p>\n                      </p><h3>Global Edge Network</h3>\n                    <p></p>\n                    <p>Bring workloads to the brink on low-latency edge nodes located in nearly every corner of the planet.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1881.svg\" alt=\"Distributed network\" /></p>\n                    <p>\n                      </p><h3>Multi-cloud Compatible</h3>\n                    <p></p>\n                    <p>Deploy Salad Container Engine workloads alongside your existing hybrid or multi-cloud configurations.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1879.svg\" alt=\"On-demand elasticity\" /></p>\n                    <p>\n                      </p><h3>On-Demand Elasticity</h3>\n                    <p></p>\n                    <p>Scale your workloads effortlessly with dynamic resource allocation, meeting fluctuating demands in real time without over-provisioning.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/Group-1882.svg\" alt=\"Optimized usage fees\" /></p>\n                    <p>\n                      </p><h3>Optimized Usage Fees</h3>\n                    <p></p>\n                    <p>Experience flexible pricing tailored to your usage, ensuring cost-effective scaling without compromising performance.</p>\n                  </div>\n                </div>\n              </div>\n      <div>\n              <div>\n                    <p>\n                      </p><h2>Perfect for <span>GPU-heavy</span> <br />workloads of any type</h2>\n                    <p></p>\n                    <p>Scale quickly to thousands of GPU instances worldwide without the need to manage VMs or individual instances, all with a simple usage-based price structure.</p>\n                  </div>\n              <div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Get more images per dollar than any other cloud</p>\n                          </div>\n                          <div>\n                            <p>4265 images/$ for Flux.1-Schnell</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud---text-to-image-1.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Convert 4.7 million words/$ with OpenVoice</p>\n                          </div>\n                          <div>\n                            <p>Convert 39,000 words/$ with Bark TTS</p>\n                          </div>\n                          <div>\n                            <p>Convert 23,300 words/$ with MetaVoice</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-text-to-speech.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Pricing from $0.10 per hour</p>\n                          </div>\n                          <div>\n                            <p>91.13% accuracy powered by Whisper Large v3</p>\n                          </div>\n                          <div>\n                            <p>LLM-based insights using Llama 3 8B</p>\n                          </div>\n                        </div>\n                      <p><img srcset=\"https://salad.com/images/Salad-Transcription-API-p-500.png 500w, https://salad.com/images/Salad-Transcription-API-p-800.png 800w, https://salad.com/images/Salad-Transcription-API-p-1080.png 1080w, https://salad.com/images/Salad-Transcription-API.png 1362w\" alt=\"Salad AI Transcription\" src=\"https://salad.com/images/Salad-Transcription-API.png\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>Tag 309,000 images/$ with RAM++  </p>\n                          </div>\n                          <div>\n                            <p>Segment 50,000 images/$ with SAM</p>\n                          </div>\n                          <div>\n                            <p>73% less cost than Azure for object detection</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-computer-vision.svg\" /></p>\n                    </div>\n                  <div>\n                      <div>\n                          <div>\n                            <p>$0.12 per Million tokens avg. for TGI</p>\n                          </div>\n                          <div>\n                            <p>$0.04/hr starting price to deploy own LLM</p>\n                          </div>\n                          <div>\n                            <p>$0.22/hr to run 7 Billion parameter models</p>\n                          </div>\n                        </div>\n                      <p><img src=\"https://salad.com/images/SaladCloud-llm.svg\" /></p>\n                    </div>\n                </div>\n            </div>\n      <div>\n                        <p>\n                          </p><h2>Read the SaladCloud blog</h2>\n                        <p></p>\n                        <p>Benchmarks, tutorials, product updates and more.</p>\n                        <p><a href=\"https://blog.salad.com/\" target=\"_blank\">Read the blog</a>\n                      </p></div>\n      <div>\n              <p><img src=\"https://salad.com/images/SaladCloud---Container-groups-2.png\" srcset=\"https://salad.com/images/SaladCloud---Container-groups-2-p-500.png 500w, https://salad.com/images/SaladCloud---Container-groups-2-p-800.png 800w, https://salad.com/images/SaladCloud---Container-groups-2-p-1080.png 1080w, https://salad.com/images/SaladCloud---Container-groups-2-p-1600.png 1600w, https://salad.com/images/SaladCloud---Container-groups-2.png 1812w\" /></p>\n              <div>\n                <p>\n                  </p><h2>Break free from the big cloud monopoly</h2>\n                <p></p>\n                <p>We can’t print our way out of the chip shortage. Run your workloads on the edge with already available resources. Democratization of cloud computing is the key to a sustainable future, after all.</p>\n                <div>\n                    <div>\n                        <p>Take advantage of geo-distributed nodes</p>\n                        <p>Save your deployments from outages &amp; shortages with 1 million+ distributed nodes across 180+ countries.</p>\n                      </div>\n                    <div>\n                        <p>A sustainable way to compute for the future</p>\n                        <p>Deploying unused, latent GPUs lessens the environmental impact, safeguards against tech monopolies, and democratizes access &amp; profits from computing.</p>\n                      </div>\n                  </div>\n              </div>\n            </div>\n      <div>\n                <div>\n                  <p>\n                    </p><h2>Lower your total cost of ownership (TCO) on cloud</h2>\n                  <p></p>\n                  <p>The high total cost of ownership (TCO) on popular clouds is a well-known secret. With SaladCloud, you containerize your application, choose your resources, and we manage the rest, lowering your TCO and getting to market quickly.</p>\n                  <div>\n                      <div>\n                          <p>Unmatched inference. Unbeatable prices.</p>\n                          <p>Compared to other clouds, we offer 10X more inferences per dollar. If you find a lower price, we will beat the bill.</p>\n                        </div>\n                      <div>\n                          <p>Scale as you grow without breaking the bank</p>\n                          <p>Scale up (or down) easily with no pre-paid contracts, no commitments and transparent, usage-based pricing.</p>\n                        </div>\n                    </div>\n                </div>\n                <p><img src=\"https://salad.com/images/SaladCloud---GPU-picker-3.png\" alt=\"Salad GPU cloud - deployment options\" srcset=\"https://salad.com/images/SaladCloud---GPU-picker-3-p-500.png 500w, https://salad.com/images/SaladCloud---GPU-picker-3-p-800.png 800w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1080.png 1080w, https://salad.com/images/SaladCloud---GPU-picker-3-p-1600.png 1600w, https://salad.com/images/SaladCloud---GPU-picker-3.png 1909w\" /></p>\n              </div>\n      <div>\n                <p><img src=\"https://salad.com/images/Salad-nodes-3.png\" srcset=\"https://salad.com/images/Salad-nodes-3-p-500.png 500w, https://salad.com/images/Salad-nodes-3-p-800.png 800w, https://salad.com/images/Salad-nodes-3-p-1080.png 1080w, https://salad.com/images/Salad-nodes-3-p-1600.png 1600w, https://salad.com/images/Salad-nodes-3-p-2000.png 2000w, https://salad.com/images/Salad-nodes-3-p-2600.png 2600w, https://salad.com/images/Salad-nodes-3.png 2865w\" alt=\"Salad GPU cloud distributed network\" /></p>\n                <div>\n                  <p>\n                    </p><h2>Deploy securely to geo-distributed nodes with high availability</h2>\n                  <p></p>\n                  <p>Over 1 million individual nodes and 100s of customers trust SaladCloud with their resources and applications.</p>\n                  <div>\n                      <div>\n                          <p>Redundant security and compliance</p>\n                          <p>SaladCloud is SOC2 certified, and our patented approach isolates customer environments and data across our network.</p>\n                        </div>\n                      <div>\n                          <p>Reliable nodes available in plenty</p>\n                          <p>Don’t get tied into expensive contracts and prepayments just to get a shocking cloud bill as you scale. Access GPUs when you need them at the lowest cost, not when ‘they’ can provide them.</p>\n                        </div>\n                    </div>\n                </div>\n              </div>\n      <div>\n                  <p>\n                    </p><h2>Run popular models or bring your own </h2>\n                  <p></p>\n                </div>\n      <div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/No-VM-Management.svg\" alt=\"No virtual machine management on SaladCloud\" /></p>\n                    <p>You don’t have to manage any Virtual Machines (VMs).</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon.svg\" alt=\"Less data costs\" /></p>\n                    <p>No ingress/egress costs on SaladCloud. No surprises.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon-1.svg\" alt=\"Less DevOps\" /></p>\n                    <p>Save time &amp; resources with minimal DevOps work.</p>\n                  </div>\n                  <div>\n                    <p><img src=\"https://salad.com/images/icon-2.svg\" alt=\"Infinite GPU scalability on cloud\" /></p>\n                    <p>Scale without worrying about access to GPUs.</p>\n                  </div>\n                </div>\n    </div>",
  "author": "",
  "favicon": "https://salad.com/images/favicon.svg",
  "source": "salad.com",
  "published": "",
  "ttr": 164,
  "type": "website"
}