Data Centers are all over the news lately because AI companies are building them, apparently as fast as they can manage. They take up huge amounts of resources, including electricity and water and hardware and all of the things building huge facilities requires. States and counties and cities are trying to figure out whether they’re a net benefit, or a draw on resources that outweighs any benefits. Some people who live near data centers complain of noise and pollution.
Industrial market data indicates that between 2023 and 2025, roughly 313 major data center facilities were built in the United States. Overall, there are currently more than 4000 active data centers in the U.S. and more than 700 are under construction with thousands more planned. Trillions of dollars are being spent building and maintaining data centers with apparently no end in sight.
But what exactly is a data center, and why do we need so many of them? And why do they consume so much electricity and water and other resources? What are they doing? Are they all doing the same thing or are there different kinds?
We discuss these questions, and some of the ways we all use data centers every day even if we don't use Generative AI — and some of the benefits we all receive without realizing there's a data center on the other end of the service.
Guest:
Dr. Leandro de Castro Silva, founding director of Florida Gulf Coast University’s Dendritic Institute and a Full Professor of Artificial Intelligence and Data Sciences at FGCU
WGCU is your trusted source for news and information in Southwest Florida. We are a nonprofit public service, and your support is more critical than ever. Keep public media strong and donate now. Thank you.
Transcript created with Copilot. Please forgive any spelling errors or mistranslations.
Mike Kiniry
This is Gulf Coast Life. I'm Mike Kanairy. Thanks for joining us. Data centers are all over the news lately because AI companies are building them, apparently as fast as they can manage. They take up huge amounts of resources, including electricity and water and hardware and all of the things building huge facilities requires. States and cities and towns are trying to figure out whether they are a benefit or a draw on resources that outweighs any benefits. People who of near ones complain of noise and pollution sometimes. But what exactly is a data center, and why do we need so many of them, and why do they consume so much electricity and water and other resources? What kinds of data centers are they? Are they all doing the same thing, or are there different kinds? It occurred to me that we talk about data centers like everyone knows what they are and what they do, but that's probably not the case. So today we're having a data centers 101 conversation with Dr. Leandro DeCastro. He's founding director of Florida Gulf Coast University's Dendritic Institute and a full professor of artificial intelligence and data sciences at FGCU. Welcome back to the show, Dr. DeCastro.
Dr. Leandro de Castro
Thank you. Thank you for having me back. It's great to be here.
Mike Kiniry
This may sound like a strange place to start, but when did you get your first computer? I'm trying to get a sense of your timeline with computers?
Dr. Leandro de Castro
Yeah, my first computer was in the late 80s.
Mike Kiniry
Okay.
Dr. Leandro de Castro
So at that time I was still in high school, first years of high school and then early 90s.
Mike Kiniry
When did you first get on the internet as we know it now with the World Wide Web? When it first came out, I guess, if you had a computer in the 80s.
Dr. Leandro de Castro
Yeah, exactly. It was around the 90s and from 1992 onwards, I was doing my bachelor's degree, so I was fully online using emails and everything.
Mike Kiniry
And you were probably playing around with maybe bulletin board services or Usenet groups or those things that sort of existed before we had what we think of as the World Wide Web.
Dr. Leandro de Castro
Yeah, I used them a little bit, but I was never that much into this type of groups, right?
Mike Kiniry
Gotcha. So we're here to talk about data centers. From your perspective, as broadly as you can, explain to a listener what a data center is. And I don't necessarily mean what's being built now by AI companies, but just what is the concept of a data center?
Dr. Leandro de Castro
Well, the concept of a data center is related to a building or a facility in which you are going to store and to maintain a number of computing components, right? Mainly servers. And their goal is to provide storage and processing for different types of companies.
Mike Kiniry
And when you say server, people have seen on movies, there'll be a room with racks of things. And inside of those, there'll be a hard drive, like we have in a computer where you store stuff, but also the CPU, which is doing processing. And so that's what you mean by a server.
Dr. Leandro de Castro
Yeah, absolutely. Well, actually, the definition of a server, a server is basically a computer. but which is designed to provide processing and storage for different users. VIOS, a standard computer, a PC, a laptop, is for a single person user. A server is for many people to use simultaneously.
Mike Kiniry
Somebody who may have worked in an office back in like the 60s or the 70s, they may have had what we called a mainframe computer. that would have been a one computer that other people's computers connect to, that would have been in the sense a data center, right?
Dr. Leandro de Castro
Yeah, they can be seen as a data center. If you look, for example, at what IBM defines as a data center, IBM considers ENIAC, which is basically the first computer invented, a data center, a sort of data center, right? So the idea, again, the idea of a data center is the place, it is a building or a facility in which you're going to keep all these computing equipment.
Mike Kiniry
If we step really far back before we had digital technology and computers, would a library, something where information is stored and there's a catalog that allows people to access it efficiently, would that have been a data center before the modern sense of data centers?
Dr. Leandro de Castro
Well, you can use the metaphor if you want. Right, but it's a different concept than the one that we use today. But the idea is the same, where you're going to storage the knowledge and where you're going to access the knowledge.
Mike Kiniry
Did data centers always have the processing side or early on were they mostly about a place to store and retrieve information?
Dr. Leandro de Castro
No, they always had the processing side as well. If you think about it, what happened was mainly during the year 2000, around the year 2000, most companies used to have their own servers. And this meant that the companies had to now have this computing equipment and to keep them, to maintain them, to cool them internally. And this is very costly and this is very energy inefficient. If you compare, for example, The use of a standard server hosted in an enterprise, it's much higher than the power consumption of a server in a data center. It's around three times the power consumption of a server in a data center. The data centers were created to reduce costs of enterprises and also to make the whole system more efficient.
Mike Kiniry
So that would have been around the time that what we think of as the cloud was born with Amazon Web Services and things like that. And just to recap what you said, so before then, every company that needed a server had one in their building somewhere, and they had to have somebody that was there to maintain it, and they had to cool it and do all that. And then Amazon came along and said, we're going to build these giant warehouses full of those things for you, and then you can connect to them. I guess that required high-speed internet, right?
Dr. Leandro de Castro
Yeah, absolutely. And actually, the history, the story with Amazon was slightly different. Because what happened with them was that they built this big data centers for themselves to provide their services, their online sales services. And they started realizing that they had a lot of spare time. Because when you plan a system like this, you have to plan it for the peak hours. So they planned them for the peak seasons, Christmas, and other seasons in which they had a lot of sales. And in times when they didn't have that much sale, they had a lot of computing power available and computing storage available. So what they did was they decided, okay, so let's rent this space and this computing power during the times that we are not using them. So that's one of the main reasons why they started providing the Amazon Web Services, now known as AWS.
Mike Kiniry
So like YouTube is something that people will be familiar with. Everything that you connect to on YouTube is held in a data center somewhere, which is filled with racks of these machines. And it's obviously doing processing because whether people realize it or not, when you upload a video to YouTube, It's turning it into something that works for YouTube, that everybody, so YouTube would be a great example of a data center for storage and processing.
Dr. Leandro de Castro
Well, YouTube is actually a user, right? Because the service provided by YouTube, which is YouTube videos and everything that we have in our YouTube pages, they have to be stored somewhere. Google has its own data center, and YouTube is hosted in Google's data center. These big, massive data centers are called hyperscalers, and we have a few of them. AWS, as we mentioned before, is one of them. Google, Meta has one of them. XAI, and all these big tech companies have their own hyperscalers.
Mike Kiniry
And the hyperscalers, how long have those been around? Since about when AWS started scaling up? I mean, because we're talking now, and we'll get into what we're talking about now in a little bit, but we're talking about, you know, these data centers that take up, you know, hundreds of acres of space. I mean, they're huge. And that would be the hyperscalers.
Dr. Leandro de Castro
Well, the definition of hyperscalers usually work around 100 megawatts plus, right? Some of them are bigger than others. And the need for a lot of land, a lot of space is also related with the need of generating its own power, the need of cooling systems, and all the infrastructure that a data center requires. So the more servers you have, the more computing power and computing storage you have in a data center, the more land you tend to need.
Mike Kiniry
cryptocurrency came along. And as I understand it, at first, people could quote unquote, mine cryptocurrency, which we won't get into what that's all about, but it's basically doing a lot of math, if I understand it correctly. And then people would build racks of the machines that would do the mining. And then the data center people came along and said, well, we'll do that too. So cryptocurrency, before we had AI, was a driver in the growth of these things and the need for them, right?
Dr. Leandro de Castro
They certainly had their contribution, but there are not really many numbers saying how impactful the cryptocurrency mining has caused in data center expansion. If we go for this type of reasoning, AI has had a much greater impact than mining cryptocurrency, right? I mean, impacting in the data center growth process.
Mike Kiniry
But the cryptocurrency, I think, would maybe be a bridge because cryptocurrency is when they figured out that you could use what are called graphical processing units, which are designed for video games mostly, originally, and I guess any kind of video editing and things like that. And they do, explain the difference between a CPU, which is the thing inside your computer that's doing the normal processing, and what a GPU is. And then we'll bridge that gap from crypto to AI.
Dr. Leandro de Castro
Yeah, I'm sure. Well, the CPU is the central processing unit, and it's used in the standard computers, the PCs, the laptops.
Mike Kiniry
And our phones.
Dr. Leandro de Castro
And our phones, yeah. They're basically tied to that general purpose processing of information. Whilst the GPUs, the graphics processing units, they were created, as you mentioned, for games. But one of their characteristics is that they are very good at numeric processing and they're very good at parallel processing. which are characteristics that are relevant for mining cryptocurrency and also for performing most of the AI maths that we need to generate to train and to use the models.
Mike Kiniry
You've been in the world of AI and data science and machine learning for a long time. When early GPUs came along, were they immediately being harnessed for that, or were you still tied to CPUs before you saw the benefit of these graphical processors?
Dr. Leandro de Castro
they took some time until we really realized how much more powerful they were to do the processing that we need in AI. So, and for some time, some companies like Intel, for example, were trying to develop chips that were more efficient for processing AI types of instructions and maths processing, right? I don't know how far that has gone, but certainly the GPUs are still much more effective. And what happened to the market was when we really realized how much GPUs were more efficient for this type of analytical processing, the whole market started shifting from CPU to GPUs for AI-related applications.
Mike Kiniry
And GPUs require more electricity than CPUs? Is that true?
Dr. Leandro de Castro
they usually do require because of the type of processing that they do and their computing capabilities as well.
Mike Kiniry
This is Gulf Coast Life. Our guest is Dr. Leandro de Castro. He's a full professor of artificial intelligence and data sciences at Florida Gulf Coast University, and he's the founding director of FGCU's data. dendritic human-centered AI and Data Science Institute. With all the talk of data centers in the news lately, we're exploring just what a data center is, what different kinds of them there are, and what they're being used for, and why they consume so much energy and water and land and all the rest. So we've set it up now. So people who turn on their TV every day, they hear the news, data center this, data center that. OpenAI put out ChatGPT about coming up on four years ago now. The other companies have come along. Everybody's using AI for different things and talking about it. And all of that requires these data centers filled with servers, filled with CPUs and GPUs. And that's really what we're talking about now, right?
Dr. Leandro de Castro
Yeah, absolutely.
Mike Kiniry
And they take up so much energy because of what?
Dr. Leandro de Castro
Well, They basically have three uses of energy. One of them is running the processors themselves. The second one is the cooling of these processors because you need to cool down to keep them functioning properly. And the third use is the battery, the backup system that you need for the whole power system. Because if you have power grid shut down, for example, your computers cannot go off. They have to keep running. So you have these three main uses of power.
Mike Kiniry
And they are running 24 hours a day, seven days a week, 365 days a year, which would be different than other kinds of data centers. These AI data centers are pretty much on all the time, right?
Dr. Leandro de Castro
Yeah, but they're standard data centers too. They have a service level agreement, an SLA, usually of 99.9% and above, right? So the idea is that they never go down. and they also work with a lot of redundancy. Most systems have a three-tiered redundancy system, right? So if one fails, you have another one, and if the other one fails, you have the third one, right? And this includes backup.
Mike Kiniry
You mentioned earlier, when you were talking about hyperscale facilities, you mentioned 100 megawatts. I had a large language model give me some data here. So 100 megawatt continuous power draw data center would be the equivalent of 80 to 100,000 homes. So that's a lot of energy.
Dr. Leandro de Castro
Yeah, it is indeed. The question that I would like or the reflection that I would like to bring to everyone is how much computing power and how much how many different solutions are being provided by all the servers. Because what I see in this debate is, yes, definitely, they consume a lot of energy. They require a lot of water for cooling the processors. But at the same time, they provide us a number of features and a number of solutions. that save a lot of energy as well. And in many cases, it may save a lot of water. I can give you an example. Let's take the simple case of a smart building. A building in which the elevators are controlled by AI, in which the lighting system is controlled by AI. So everything or a number of features of the building are controlled by AI in such a way that it's much more energy efficient. So this was all generated and this is all controlled by AI. So how much energy are you saving on this end? And how do you compare that with the amount of energy that you have to spend and use to make that AI function in that building? This is the type of investigation that you cannot find many studies and it's very hard to build these studies because there is no direct way of computing these things, right? At finding, okay, what's the exact AI model that is being used there, at what time, for how long, versus what's the energy that it's saving on the other side.
Mike Kiniry
Yeah, so it's very complicated. There's a lot of sort of unknowns in it that what that reminded me of is I've often thought of, you know, maybe somebody's done the math on this, but you know, you don't really get lost anymore when you're driving around because we're using our phones and GPS, and a data center's involved there somewhere with that service. And I wonder if you could just tally up at the end of the year how many people didn't wander, didn't, you know, that's another example of how, you know, there may be an overlooked benefit that we don't see.
Dr. Leandro de Castro
Absolutely, and that's a great example, right? I remember I was young traveling with my father. We arrived at Sao Paulo City, which is as big and as complicated as New York City. And with this big map in the hand trying to find some place, we stopped in a gas station. We had to find some help. We spent a lot of time. We drove around for quite some time until we finally reached where we wanted to reach. So all that is time and energy and fuel being wasted. Yeah, that's a great example.
Mike Kiniry
These companies, they're spending trillions of dollars, and they're not really making that back on the retail end, I guess. from your perspective, how is it going to balance out in the long run with the amount of capital investment versus the amount of return they get on that investment? Because we've got all these sort of squishy examples of benefit, but if they can't monetize that, is that going to be a problem for them at some point, it seems?
Dr. Leandro de Castro
Yeah, I understand that it varies from company to company. If you think about Google, for example, Google has its own AI model, Google Gemini, its own AI tools. Google provides a number of other services. And many of the services that Google provides, it doesn't monetize from these services. For example, you don't pay to use Gmail. Of course, we all know that we are the product, right?
Mike Kiniry
They're benefiting from our use of Gmail somehow.
Dr. Leandro de Castro
Exactly. But my point is exactly this, right? Some companies, they can use AI to improve the revenue streams in other areas in such a way that they don't need to focus that much on monetizing AI itself because they have other sources of revenue. But We have other companies, for example, ChatGPT or OpenAI, right, that they don't have this business model. They are basically selling the subscription, which we know that in most cases does not pay for their own expenses, but they're thinking about different ways of monetizing. So my point is that maybe the AI market, or at least these general purpose models, is not going to be focused on monetizing the use of the model itself, but on benefiting from the model for other types of revenue streams that they may have.
Mike Kiniry
Would the early days of the internet be an example? I mean, we had the.com boom and then we had the bust, but the internet stayed around and other people figured out how to use that infrastructure and maybe, you know, the AI infrastructure will just be that heading off into the future.
Dr. Leandro de Castro
Oh yeah, absolutely. And it's going to grow significantly. What we see now is already awesome in terms of what we can do with these models. Every day we find something new, some new type of application, some new models, some new app being delivered, and it's only going to grow. If we think about, for example, computers are still mostly performed by silicon-based devices, but when we go into more into quantum computing and other approaches, for example, molecular computing, we'll have a jump in AI again, another jump. Because when you are at the molecular level, for example, the types of interactions that you have, your capability of storing information, of processing information, everything runs in parallel. It's a completely different world. Right. This will make AI even more powerful than it is today.
Mike Kiniry
Might it make it be more efficient in terms of energy and water?
Dr. Leandro de Castro
Absolutely. I mean, computing at the molecular level, for example, is much more energy efficient because everything is done in parallel at the molecular level.
Mike Kiniry
Because one of the big complaints is the environmental side of it is the water use. So it seems like, you know, they're going to have to figure something out if they're going to keep building these things. There's only so much water, right?
Dr. Leandro de Castro
There are some things being done in this direction. One of the things is related with the technology itself. So we have cooling systems that are much more efficient. Some of them, they reuse the water. Some of them use other types of liquids that don't need to be replenished so often. Another thing that many companies are doing, mainly the big companies, is they're finding ways to compensate for the water they use. For example, investing in projects that are related with the protection of water sources and things like that. And many of the hyperscalers, if we look at them currently, they are trying to be water positive in less than three to four years from now. Some of them are already water positive. And of course, I also understand that there is a debate around it because in many cases they are water positive, but not exactly in the place where they are using the water, right? And in many cases...
Mike Kiniry
Kind of like carbon credits or something like that.
Dr. Leandro de Castro
Yeah, exactly. But at least we see that there is a concern and there is a movement done in the direction of, okay, we are using resources, but we are trying to bring back these resources.
Mike Kiniry
I'm pretty much out of time, so I'm going to have to end it there. But these things are not going away. They're giant buildings that are doing tons of processing that generate lots of heat. And we are all in some way probably benefiting from them. Anything else you'd like to add?
Dr. Leandro de Castro
Well, I think for me, the main point is We have to really find a way of being more power efficient and of being more water efficient when we are talking about data centers. But at the same time, we have to think about how much time, effort, and energy everything that they provide us is saving. And I'll give you one last simple example. People like to use this number that One prompt is equivalent to 10 Google searches, right, for example. But this is a very abstract number, because what is this prompt like? How complex is this prompt? What exactly are you getting out of it? And we can ask the same questions about the search engines, right? But my point is, How much effort can you save with one prompt when compared with one Google search or one Bing search or whatever, right? When you do a search, you have to take the result back. You have to look at it. You're probably going to do another search to find more things. Then you have to look at everything to put together, to interpret. This is going to cost a lot of time. And maybe with a single prompt, you can get everything at once, right? So there is... Always this balance and we have to think about the benefit that we get from the use of data centers and from the use of AI.
Mike Kiniry
Next we'll have to do a what is a prompt show for people who don't even know what that means. That's when you ask a question to a language model listeners. Dr. Leandro de Castro is founding director of Florida Gulf Coast University's Dendritic Institute. He's a full professor of artificial intelligence and data sciences at FGCU. Thank you so much for your time.
Dr. Leandro de Castro
Thank you. Thank you for having me here.