Skip to main content

Steam Pushes Over 3/4 of a Terabit on Their CDN

The Steam Summer Sale is upon us once again. I, like many Steam users, look forward to these seasonal events. Unlike most Steam users though (I assume), I have a constant fascination with the Steam Content Server Stats page. I like watching the trends and seeing just how much bandwidth the Steam CDN can eat up, keeping a mental note of the highest peak utilization.

In terms of the trend, utilization is often around 200 - 300 Gbps, sometimes dipping below 200 when there’s nothing particularly exciting happening (e.g. a not-so-great midweek sale). Prior to the sale, the highest I had ever seen the peak value was 658 Gbps. The sales are often the record breakers and this summer did not disappoint. Below is a screen capture showing a peak of over 768 Gbps, 3/4th’s of a terabit.

Even the smaller of those numbers is nothing to sneeze at. That’s a lot of bandwidth. In late 2010 when Netflix announced a move to Level 3 for streaming of their video services, Level 3 stated that they had 1.65 terabits of global CDN bandwidth with plans to add 2.9 Tbps more. Now, that’s not just the bandwidth allocated to Netflix but Level 3’s entire global CDN which serves various other customers. Granted we all pretty much know Steam is not small in terms of users, but this just further shows that they are definitely playing with the big boys here. (Today, Level 3 boasts a total 5.6 Tbps of global capacity, with today’s numbers Steam could still eat a huge chunk of that if they used Level 3 exclusively).

I was initially thinking about holding off writing this post up as there is a good possibility for Steam’s current throughput record to be broken as we are just starting the summer sale. However, I don’t think it can be beat by much.  Looking at the individual server loads, you can see many of them are being pushed to the max. While the demand could very well be capable of using up over a terabit, it doesn’t look like Steam could provide it without adding more servers. The images below show the demand that the Summer Sale has brought on the network.

I’d personally love to read up on some details of Steam’s CDN, something like a High Scalability post. It’s not clear to what extent (if any) Valve runs their own content servers or utilizes other company CDN/cloud services.  I did find information on Valve using Highwinds’ CDN for some of their Steam traffic. The majority of Steam traffic may even utilize Highwinds, though the article is not specific. I’m somewhat surprised at this since CDN pricing is usually seen as a bit high, so they must be getting a good volume discount. I remember once tracking an IP that my Steam client was connected on to Limelight Networks, so multiple cloud providers are probably at work here. If so, why the hard limit on individual servers (whatever those may be)? Why slow download speeds during sales? Could Steam actually be placing that much load on multiple cloud providers? Perhaps, but those providers are not likely to let their other customers be drastically affected due to the demand of one other customer.  My guess is that there is some sort of throttling going on as part of the negotiations. But whatever it may be, Valve certainly knows what they’re doing.


Dustin said…
Great article on Steam and Highwinds CDN! We are very happy working with them. Email me if you have any questions.

Dustin DeTorres
Social Media Manager @highwinds

Popular posts from this blog

IE Caches a Lot

Cross post from my employer's development blog:

In developing a page, I decided to do things a bit differently on the server. By doing an explicit check on the HTTP request headers, I can detect server-side if a request to the server is coming via XHR (Ajax) or a standard page load. I can then serve different content based on the request type. So, I can use the same URL for retrieving the initial HTML page and the raw JSON data associated with that page. Express makes this pretty easy:
if (req.xhr){      return res.json(await this.usersData());    }    else {      return res.view('users', await this.usersData());    }
I’m not sure if it’s technically more RESTful than having separate URL routes for data and HTML, but it felt like it made sense. The URL is referring to the same data, and based on a header, I want to determine how it is represented, but the data doesn’t change so why should the URL? This also makes it possible to d…

Atari E3 2004 PAL digital press kit

Making note of some old swag. The Atari E3 2004 PAL digital press kit. See video for details.

Changing Password Requirements with SailsJS and Passport

Cross post from my employer's development blog:

If you perform an installation of [Passport][passport] with [SailsJS][sails] using the [Sails Passport Auth Generator][sails-generate-auth] you get several files in your app already configured for you. If you then use passport-local, you will already have a complexity requirement on the password. It defaults to requiring 8 characters minimum, letters, numbers, and symbols.

What if you want to change this requirement? In the generated model file `Passport.js`, you should see a line that says `provider   : { type: 'alphanumericdashed' },` and `password    : { type: 'string', minLength: 6 }`. The minLength is an easy and obvious change. What about the complexity requirement though? This stumped me for a bit. There doesn’t seem to be any mention of these keywords or providers on the Passport official site, nor anything in the [Passport-local repository][passport…