Archive for the ‘Amazon EC2’ Category

Load-balanced EC2 setup on Podango.com

Disclaimer: This is not live yet.

At Podango, we have been working on migrating to Amazon EC2 from our existing hosting solution. We now have a load-balancer in front of multiple web servers and are set up for multiple processing servers and a DB server behind them. We are still a few weeks from going live with it, but when we do, we will have a very scalable system with at least a half dozen servers running all for less than the price of one Rackspace server.

Advertisements

The power of Amazon EC2

So, one thing that is nice about Amazon EC2 is the price. The cost of a server is $0.10/hour, or about $75/month.

Another nice thing is that you can have an instance up and running in a few minutes once you have an AMI ready that you are happy with. No need to order and install hardware, or even wait 24-48 hours for a new server from somewhere like Rackspace.

Yet another really cool thing about EC2 is that you can use it to give you bursts of computing power. Let’s suppose that I have a cron job that does some sort of regular processing (off on a processing server or other non-web server). Eventually, as I get more and more traffic to my site, the processing ends up taking all day. So, eventually, I add a second server. However, suppose that from an end user perspective, it would be beneficial if I could have all that processing done in 1 hour rather than 24-48 hours.

In a traditional environment, that would be really expensive. I would have to purchase 24-48 “processing” servers in order to get all the processing done in an hour. Then, all those servers would sit idle for 23 hous/day.

With EC2, on the other hand, I could instantiate 24-48 servers for one hour, knock out all the processing, and then shut them back down. The end cost is about the same since EC2 charges by the hour. So, I can appear to have 24-48 servers for the price of 1-2 servers (and I would in fact have 24-48 servers, but for only 1 hour/day).

One of today’s Amazon Web Services Blog entries has an entry about a Perl interface to Amazon EC2 written by Jeff Kim that allows you to script the starting and stopping of EC2 instances. This would allow you to programatically determine the number of servers you need, automate the process of starting up new instances, and automate the shutting down of instances that are no longer needed.

Another simple use of this would be to automatically monitor the load on your web servers and instantiate new instances or deactive unneeded instances depending on the amount of traffic coming to your website.

Bottom line: EC2 is amazing.

Biggest technology news nobody is talking about from 2006

I am amazed at how little buzz two Amazon web services have generated since launghing in 2006. Amazon S3 and Amazon EC2 are groundbreaking services in my opinion.

A few years ago, Amazon did something very smart. As they discovered that they needed highly scalable and reliable platform components that they couldn’t buy, they decided to build them in a modular way such that they could then profit from these platform pieces by selling them to others. I have read that Amazon’s CEO describes Amazon as a software services company. I would guess that most people equate Amazon to an online Barnes & Noble done right. However, I think Amazon will outgrow that image over time with what they are now doing. Right now, Amazon is my favorite internet company with Yahoo and Google coming in a very distant second.

Amazon S3 allows you to store gigabytes or even terrabytes of data for pennies a month ($0.15/gigabyte to be exact) in a highly scalable and reliable environment. If you need to serve that content up to someone over the web, it only costs $0.20/gigabyte of data transfer. The product is sooo easy to use, and those prices are sooo low, it becomes a no-brainer to use S3 to store anything that takes up any space. People are dumping audio, video, images, mail, backups, and many other things on S3, and having great success.

Amazon EC2 makes the typical small business IT infrastructure almost obsolete. It allows you to “instantiate” servers in 2-3 minutes time. Suppose I have a website with traffic that has outgrown the single-server setup. I can go to EC2 and set up a load-balancer, multiple web servers, a database server, and multiple utility servers for $450/month. The time it takes to do this is very small, and the ongoing costs are very small. Once again, I only pay $0.20/gigagbyte of bandwidth consumed. The ease of use and low price just blow everything else out there away.

The bottom line is that Amazon with S3 and EC2 are making it so small and medium sized companies can have big-company style infrastructure for a VERY affordable price. Yes, people are talking about these services more and more. However, they are not getting publicized nearly enough for what they really are. If Google had released these services, it would be all anyone could talk about. But, since it wasn’t Google, they still continue to fly under the radar (relatively speaking), and that’s too bad IMHO.

A few good links:
Amazon Web Services Blog
Some sites using Amazon’s web services