6) Liquid cooling takes off
The warmth generated by AI methods has already pushed the necessity for liquid cooling as a result of air cooling is just not sufficient. Nevertheless it’s not simply GPUs that run scorching – new CPUs from Intel and AMD are fairly toasty as effectively. I count on to see a rise in self-contained liquid cooling that may go into current information facilities and never require a hefty retrofit. I additionally suppose that HPE and Dell will lastly do their very own liquid cooling, much like Lenovo’s Undertaking Neptune. Up till now, HPE and Dell have been content material to go away liquid cooling to 3rd events, however they could must lastly do their very own factor.
7) Intel splits
There’s simply no means round it. Intel should spin off its fabrication enterprise similar to AMD did in 2008. It was costly, painful and crucial for long-term success. Gelsinger merely didn’t have the bandwidth to handle Intel foundries and Intel merchandise, and all three suffered for it: The fab enterprise was sluggish to get began, the chip enterprise fell behind AMD, and Gelsinger’s tenure was reduce brief. It’s time to chop the fabs free, Intel.
8) Continued predictions of on-prem exodus
This utterly inaccurate prognostication will proceed, and it’ll proceed to be improper. There are too many causes to maintain an on-premises information heart, beginning with information privateness and integrity. Repatriation of knowledge from the cloud to on-premises infrastructure goes on yearly. On-premises information facilities will die when mainframes do.
9) GPU utilization turns into paramount
Nvidia is displaying no indicators of reducing energy draw, so it’s as much as others to make these items work as effectively as doable. Meaning most utilization and scaling of {hardware}. In consequence, maximizing GPU utilization will change into the first design objective for contemporary information facilities. It will drive improvements in {hardware} and software program to maintain the infrastructure crucial for coaching and decrease latency, lagging, and different points that trigger pauses in coaching. Success will probably be measured by how successfully information facilities can maintain their GPU assets utilized.
10) Energy constraints affect information heart places
With nearly 500 information facilities within the Virginia space, it’s secure to say that area is reaching its restrict. The identical applies for Texas and Santa Clara. The demand for large-scale processing of knowledge for AI, information analytics, and quantum computing will shift the place new information facilities are constructed. The excellent news is that these purposes, particularly AI coaching, are usually not latency delicate, to allow them to afford to be positioned in a distant location that has loads of land and loads of low-cost energy. It will largely contain information facilities devoted to huge computational processes, so there’s no want to fret that your colocation supplier will open up store within the Sierra Mountains.