Welcome to the official platform of Indian financial investment and wealth management
  Home  Gold  Text
Kanpur Wealth Management:Amazon❼AI data center dream runs into the reality of ➃mbie✩acilities, higher costs, and labor shortages

Time:2024-11-05 Read:13 Comment:0 Author:Admin88

Amazon❼AI data center dream runs into the reality of ➃mbie✩acilities, higher costs, and labor shortages

is spending heavily on to support booming workloads, putting it on pace to build 240 new facilities by 2040, one estimate found.

These plans are increasingly running into physical constraints that are slowing the buildout, according to an internal document, people familiar with the matter, and emails obtained through a public-records request.

"Across the AMER region, we are experiencing headwinds in power, zoning and permitting, water, and workforce/labor that are providing challenges to our long-term capacity growth," the internal document said, referring to the Americas market, Amazon's largest.

As the biggest cloud provider, Amazon's predicament highlights broader problems facing the tech industry as generative upends the status quo. While more companies want access to cloud computing for AI initiatives, there's only so much power, water, and labor available to support these services.

It's not just an Amazon problem. David Cahn, a Sequoia Capital general partner, recently predicted data center delays across the sector.

"The need for more power and a better functioning grid was clear before AI," he wrote in a blog post. "Now, it is becoming urgent."

It may be natural for a company like Amazon, one of the largest and fastest-growing data center operators, to face these challenges when it's expanding at breakneck speed.

Marc Wulfraat, the president of the consulting firm MWPVL, told BI that Amazon could roll out even more than 240 data centers in the coming years. That's because the cloud giant also leases space in buildings shared with other companies. Collectively, this building spree amounts to almost 75 million gross square feet of space, Wulfraat estimates. That's the equivalent of roughly 27 Empire State Buildings.

In an email to BI, an Amazon spokesperson said customers' energy demand "continues to grow," and the company is continuously working on ways to "efficiently build and operate data centers" to meet their needs.

"Nobody knows better than we do that building data centers is exceptionally complex, and by embracing that challenge, we've become really good at it over the years," the spokesperson added. "We're confident we can continue to build at a rapid pace to provide the cloud capacity our customers will need."

Power might be the most scarce resource. US data center electricity consumption is forecast to triple by 2030, said Boston Consulting Group, much of it to power generative AI. Bernstein Research recently estimated that electricity demand for AI data centers could exceed supply in just two years without action.

Electricity shortages have been a major concern for Amazon and a topic of discussion at almost every leadership meeting in recent years, people familiar with the matter said.

Amazon is experiencing power-supply issues in Oregon, Ohio, and Northern Virginia, according to the internal document from May. For example, it said that PacifiCorp, Amazon's Portland-based utility partner, has electricity shortfalls and generation constraints forecast until 2030.

This is leaving Amazon with an unpredictable energy supply in some markets and a possible loss of "bridging" solutions that help maintain power during the early stages of construction.

"With the utility power headwind, we are seeing continued risk driven by transmission constraints as well as unexpected changes to committed/available generation, gaps in promised vs delivered incremental power, and potential loss of bridging power as utility infrastructure projects are delayed," the document said.

Some markets have so-called "zombie" data centers, a term used by some Amazon employees who spoke with Business Insider about the electricity-supply problems.

These facilities are also described internally as "operationally blocked" because the data centers can sometimes sit idle when they don't have access to enough power to run them, the people familiar with the matter said.

Amazon's spokesperson told BI there are a "very small number of cases" where the company decides to complete data center construction before full building power is available. "These situations are all managed as part of the standard course of business," the spokesperson added.

Amazon Web Services CEO Matt Garman.

JOSH EDELSON

Amazon Web Services CEO Matt Garman recently spoke publicly about challenges related to AI data center buildouts, including accessing enough GPUs and power.

During a podcast interview in August, he said customer demand is "mind-boggling" and requires "a lot of investment."

"We're probably going to be tight for the next little bit of time," Garman added.

The company is on the hunt for more energy. It's conducting "power studies" with utility partners to evaluate additional transmission capacity, which could result in more power allocation, the internal document said.Kanpur Wealth Management

The company is also working on ways to reclaim stranded and retired power, the document said, likely in reference to the practice of redeveloping old power plants that have become inactive for economic or sustainability reasons.

Amazon has been more actively seeking partnership opportunities with third-party colocation data center providers, one of the people BI spoke to said. At these facilities, Amazon would simply lease space, transferring the need to secure power to the data centers' owners.

Additionally, Amazon has started looking beyond well-established data center markets, such as Northern Virginia and Arizona, and is expanding into newer regions like Indiana. Crowded data center regions are running out of power and other resources, making newer locations .

The company is also more aggressively pursuing alternative energy sources. Last week, Amazon unveiled a plan to lead a $500 million funding round to develop small modular nuclear reactors, following an earlier announcement to purchase power from a nuclear plant in rural Pennsylvania.

"It's almost like mosquitoes to light — we are attracted to power," one of the people familiar told BI.

Amazon's spokesperson said the company's data center expansion strategy considers several factors, including system resiliency and latency, the availability of renewable energy, and the local government's long-term commitment. Amazon is also constantly looking for ways to make its data centers more energy efficient by using carbon-free resources, in-house processors, and natural air-cooling systems, the spokesperson said.

In some cases, Amazon is paying higher prices to get its new data centers up and running.

One example is an Amazon facility in Santa Clara, California, in the heart of Silicon Valley. For the past two years, Amazon has been in talks with the city of Santa Clara about securing power for a new data center near Levi's Stadium, the home of the San Francisco 49ers.

Amazon and the city are discussing a 15-year, 20-megawatt proposal for the facility under the condition that the company pays the full cost of the energy, whether it uses the power or not, Manuel Pineda, the chief electric utility officer of the City of Santa Clara, said at a July city council meeting. Amazon will have to pay up to 50% higher rates than normal and will be entitled to additional "financial assurances" to cover any contractual risks, Pineda added.

As part of the deal, Amazon also plans to use the 20-megawatt power agreement for a second on-site building, which currently has no electric capacity, Pineda said.

Amazon's spokesperson told BI that this arrangement has not been finalized, and the project is progressing as expected.

Presentation slide from a Santa Clara city council meeting.

City of Santa Clara

Amazon appears to be dealing with further delays in Santa Clara. On August 28, an AWS employee wrote to a city official about another facility, a former Owens Corning factory the company purchased in 2023. The email discussed delays at the site and said that the problems are raising concerns internally at Amazon.Udabur Stock

"Delays as significant as this unfortunately impact our ability to serve our customers which has resulted in escalation," said the email, which was obtained by BI through a public-records request.

The next day, another Amazon employee wrote to a Santa Clara city official. "This is time sensitive," the staffer saidVaranasi Wealth Management. "AWS executives are highly concerned about the constant push in the results."

Water supply is another problem. A growing number of data centers rely on water instead of air to cool the servers and other equipment inside the facilities, and that requires an enormous amount of water.

Amazon is "straining local jurisdictions' existing infrastructure" for water in some regions and is "dependent on long-term infrastructure upgrades or building our own solutions" to mitigate the issue, the internal document said.

There are also zoning and permitting problems. Some local jurisdictions do not support the rezoning of industrial property for data center use and have stricter environmental regulations, the document said. Amazon is "working proactively" with local municipalities to solve these challenges, as they can impact its "future capacity options," the document said.

Amazon is "one of the world's most water efficient operators" and its data centers are much more water efficient than the industry average, the company's spokesperson told BI.

An even bigger problem may be a lack of skilled electricians to build and run these data centers, according to the internal document and people directly involved in these Amazon projects.

Electrical work is a major part of data center construction. But Amazon has struggled to find enough people to do the jobs, especially in rural areas, these people said. Amazon has talked to local colleges, general contractors, and labor unions in certain markets about training more electricians, one of the people said.

An Amazon data center in Oregon.

Amazon

A shortage of skilled electricians is a growing industry problem. An Uptime Institute Data Center Staffing Survey released last year reported that more than half of respondents said they struggled to fill open positions due to demand outstripping supply.

"For workforce/labor, we are seeing a lack of available skilled labor," Amazon's internal document said. "Which requires us to prioritize where we allocate these resources, and we are becoming increasingly reliant on more expensive travelling [primarily] electricians."

Amazon's spokesperson shared blog posts detailing its training programs in this space, adding, "AWS has established a number of workforce development programs and collaborations with education institutions to help ensure a strong pipeline of talent."

Do you work at Amazon? Got a tip?


Chennai Stock

Notice: Article by "Insurance Financial Products | Bank loan overdue". Please include the original source link and this statement when reprinting;

Article link:http://fsyidafu.com/Gold/110.html

  •  Friendly link: