BIG AI Servers NEED This

40 thoughts on “BIG AI Servers NEED This”

1. How much quieter are these racks? One of the problems with big air-cooled DCs is the noise hazard to employees.

2. Damn that looks slick. Looks like they're doing a lot to reduce the pucker factor of having that much water all around your expensive servers.

3. Supermicro are such an innovative company and it's awesome to see them out here promoting YouTube creator content.

   I'm always amazed at the level of access you guys get to just show off their stuff, from your channel to LTT, etc.

   Absolutely massive respect for them to put this stuff out there.

4. SuperMicro really need to get that end to end solution to market. My previous employer was way too shaky about having to incorporate the building's chiller system into the server room water cooling that they opted to again go with inefficient air-cooled sytems. Big waste.

   I love the tech and can't wait to see where it goes.

5. I cant wait for these to land on ebay for pennies

6. Even more work for plumbers, remember that the next time you build your home lab! 🙂

7. All that power usage just for lazy people and rendering funny pictures.

8. 5:50 – Raspberry pi cm4. Usb флешки и прочие поделки в серверной стойке. Жуть…

9. Hi! I deal with a lot of data centre builders through work, and the case for liquid cooling the facilities was hard enough to convince a lot of people because of the extra capital required to offset the opex. If you're saving 10-20% power, how much extra money are they asking you to spend upfront to get that saving?

10. I was designing my own waterblocks for the Socket940 AMD Opteron back in 2006, when I was in university, doing my bachelor's in mechanical engineering.

    This isn't new.

    This story has been, at least, 17 years in the making.

11. very interesting! As always, an exciting video that keeps the viewer watching. The quiet background music was a bit disturbing. they could have safely been left out.

12. Hi Patrick. Is there a chance for the article about how to prepare DC space for liquid cooling. Colo space tends to be dry and facility water is not something that exists close by.

13. I'm a bit surprised to see the rPi show up. A CM4 certainly does the job and has an attractively low barrier to entry; but I would have assumed that Supermicro would have just slapped an Aspeed onto anything that even resembles a baseboard in need of management out of pure reflex.

    Is it known whether there's something about an AST2600 that made it unsuitable; or whether the group behind the design of the liquid cooling system is sufficiently distinct from the motherboard side that they aren't in a position to reuse the BMC work already done and so went with the rPi as a better option for working from scratch?

14. Put the computers in a cold climate and use the resulting heat for living spaces or other productive use..

15. The suitcase spin at the beginning was buttery smooth

16. This

17. Any chance these things can run on cooling tower condenser water instead of chiller water? That would really ramp the power savings to the max if you could skip chillers entirely or at least on many days of the year.

18. Very very good summary of the state of the industry and a liquid cooled rack system. SuperMicro has been on the leading edge of moving liquid cooled IT from specialized installs into mainstream & they are working in many industry organization in this pursuit.

19. At 5:52, CM4 in the CDU?

20. Houses should have hot and cold loops too.

21. The sad reality of liquid cooling in the datacenter, is that it’s been kicked around for over 20 years, and yet every solution is proprietary and gains about 0 market penetration. Wash rinse repeat with the latest solution. DCs are crazy expensive and infra has to last a long time so customers are rightfully leery. Air cooling is universal and compatible with everything, albeit inefficient. Triply so, hyperscalers are very cost sensitive and this all looks very much the opposite of that.

    AI may change that but there is some serious uphill battle here.

22. Hi, what's intrinsic power usage of each CDU for pumps and controls? I looked and couldn't find any data

23. Is this proprietary liquid heat transfer hardware system compatible with the open source hardware rack – Open Compute Project Open Rack v3 – which went into mass production in 2023?

24. So when could we start seeing geothermal combine with liquid cooling?

25. Interesting upload, not something we see everyday

26. Do you have a homelab AI server recommendation to fine-tune LLMs? Thank you in advance.

27. Sweden, the heat generated by data centers is used to heat entire cities.

    The aluminum and copper parts of the radiator look very high quality. Connection from servers looks incredibly cool😎

28. Hey I just tried to read some of your articles over RSS. Is there a chance you could the articles directly into the RSS feed?

29. San jose is my hometown, I miss SJ and the Sunnyvale/Mountain View area, so much cool tech stuff in that area.

30. Thanks for the informative video! I noticed that Asetek units, including the CDU, were used in the A100 server. Did Asetek products get replaced with Supermicro's in-house developed products for the H100 server?

31. I just toured a large data center where experiments in liquid cooling were taking place. They were abandoning the experiment for now as the coolant fluid is considered toxic. Further, conventional cooling including liquid requires huge water usage.

32. liquid cooling also makes it easier to transfer to district heating as a secondary use of the waste heat

33. This is fantastic! Thank you for your efforts; they're truly inspiring. I hope everyone recognizes the importance of the work being done at SuperMicro.

34. 5:50 Is that a CM4?

35. He does not raise the safety concerns of DLC. Leaks can be catastrophic to a datacenter. Leak detection development is a must!

36. This.. THIS.. THISS!.. This is Patrick.

37. Are these racks able to change gpus/cpus or do they only work with nvidia?

38. Hi Patrick, came back to your Supermicro Server AI review (~1 year ago)—excellent 👏. Liquid‑cooling is clearly accelerating 🚀 as AI scales. With datacenter AI, xAI clusters, on‑chip cooling via CDU or integrated loops is inevitable. Your blue‑orange bar graph (12:04) puzzled me—could you dive deeper on that in a few more seconds? Thanks!

39. Okay Patrick I see you 😂😂 @0:50

40. @servethehome is there any information e.g. from supermicro for the recommended cpu temperatures when using dlc?

Comments are closed.