He’s been a poster boy of Indian infotech, co-founded a company that has become a byword for participative entrepreneurship, given Thomas Friedman the idea for the bestselling ‘The World Is Flat’, and himself penned a book, ‘Imagining India’.

And now, at the age of 54, his shareholding in Infosys alone worth Rs 3,500 crore, Nandan Nilekani has taken on one of the most ambitious government programs ever envisaged: heading the project to equip every Indian with a biometric Unique Identification Card.

This is the biggest movement from private sector to government in India in re-callable memory.

Back in College when we used to have those personality development classes, each one has to come up and say what they wanted to achieve in their lives. That was one question I hated to answer, not because I didn’t have an answer to that, because how hard I try, I was not able to put the point clearly in front of the class. I used to say, “I want to be Computer Scientist and I want to do something that impacts people lives, enriches them. To do something makes my family and my country proud.” That ’something’ here was very vague to describe, no popular example to put forth.

Today, I have a one word to describe that, Nilekeni.

Personally, there can be nothing bigger than the Mr. Prime Minister of India himself calling you up and giving you an offer to serve the country. That is the ultimate respect I can ask for. In my opinion he did the right thing accepting the offer. An inspiration to both current and future leaders.

This post is password protected. To view it please enter your password below:

Password:

If you don’t give a damn or you don’t understand, its like you going nowhere.

Live your life like you care for something, anything, the real thing!
What does it mean to you? How does it feel to you?

If you don’t give a damn or you don’t understand, its like you going nowhere.

—The Freelance Hellraiser

Amazon S3 is storage for the Internet. It is designed to make web-scale computing easier for developers.

Its a no frills service and does exactly what it promises — makes it easy for developers so that they can concentrate on features and leave the scaling to Amazon. If you are new to Amazon S3, heres a good starting guide for you.

S3 is like a sharp sword, you must know how to play with it lest you can hurt yourself. Thats exactly what happened to me. One of the many applications that we are developing on MySpace, Sketch Me, required us to store (and serve) huge amount of image data (user sketches). And due to the viral nature of the application, the load almost tripled every month. S3 was a clear choice. It saved us time, money and headache. Our current stats (with caching) are:

• Total files stored: 205GB
• Bandwidth per month: 2TB
• GET Requests per month: 112m

Clearly I would not like to waste time setting up image serving servers that can handle such load and I am more than happy to outsource it to Amazon S3.

You would be surprised before caching when our total images were just 5GB, the no of requests were 263m ($363.91) (almost double to what it is now with 205GB of images)

So if we take the total request to be directly proportional to number of images, with that rate the actual requests should be approx 4.5 billion or $15,000 :O

How did I tame the beast?

At first look the pricing of Amazon’s S3 services seems quite cheap. Wait until you get your first bill and you will see have cents add up to huge $$$.

Storage

• $0.150 per GB – first 50 TB / month of storage used

Data Transfer

• $0.100 per GB – all data transfer in
• $0.170 per GB – first 10 TB / month data transfer out

Requests

• $0.01 per 1,000 PUT, POST, or LIST requests
• $0.01 per 10,000 GET and all other requests

So after getting the first bill for a few hundred dollars, I sat down thinking how to bring that down. When I was digging the HTTP headers, I found out that by default S3 doesn’t have any cache request headers set. So even when the visitor has the requested the file from S3 before and has it in his browser cache, the browser will send a HTTP GET request to S3 just to verify if the file has changed. S3 returns a 304 Not Modified header if the file has not changed and file wont be downloaded. You may think, S3 saved me a few GB of bandwidth cost. But each of this requests cost you ($0.01 per 10,000 GET) which is generally the bulk of the S3 bill.

Since photos our users upload almost never change. Asking S3 every time if the file has changed on S3 is certainly not required. You can stop browser sending this extra request for the same user by setting appropriate Cache-Control headers or Expires headers for the files. We can set Cache-Control max-age=864000 which will tell browser to not request the same file until next 10 days (3600*24*10 sec)

Fortunately S3 allows us to do that, but there is no simple and easy way to do that. So I decided write a small script (see below) to achieve this.

After Domestication

After setting Cache headers, my bill got down drastically. The traffic doubled and number of images  almost tripled (5GB - 15GB) within a month while the number of requests was reduced 3 times. So that is 9 times reduction in cost. Ideally, your bandwidth cost should be more than your requests cost.

If you own a high traffic blog or website, you can also store your javascripts or css files on S3 by using far fetched expires headers and using versioning (changing file name when contents change) so that the browser knows when the file has changed.

For Example:

<link href="http://s3.amazonaws.com/lalit/style.css?v=3” … />
after change in stylesheet, change your code to,
<link href="http://s3.amazonaws.com/lalit/style.css?v=4” … />

Domestication

The popular Firefox extension S3Fox doesn’t allow us to do that. So I decided write a small script using the S3 PHP REST Library.

You can download the code here (zip 6k).

Update: Fixed a bug in code (mime type calculation was failing on some php configurations)

To use the script, you have to upload it to your server (running PHP). You need to edit the upload.php file to specify your AWS access key and Secret, your S3 bucket name.

/* One time settings. */
$awsAccessKey	= '---';	// your AWS Key
$awsSecretKey	= '---';	// your AWS Secret
$bucket_name	= '---';	// S3 Bucket name
$age		= 3600*24*10;	// Cache age 10 days	
 
/* File Data */
$s3_dir_name	= 'dir1/dir2/';	// Directory on s3 where you want to upload file
				// example http://s3.amazonawas.com/bucket_name/dir1/dir2/filename.ext
 
$upload_file	= 'filename.ext';// name of the file you want to upload.
				// keep it in the same dir as this file.

After you have saved the config info, every time you need to upload a file, you have to specify the file name and the dir name in upload.php and callit from the browser http://yoursite.com/s3/upload.php. (I know it sucks, I promise will make it better soon)

If you want to escape all this trouble, there is a paid tool Bucket Explorer which helps you to upload files with custom headers. I havn’t used it but it looks great and works on Win/Linux/Mac.

I hope your next S3 bill will come down

Demo

After a few hours of javascript hacking, this is what I came up with.

How it works

It will fetch random (Creative Commons Licensed) sideshows from slideshare.net using the API. The application uses the SlideShare.net API and Prototype/Scriptacluous to create some pretty visual effects. The SlideShare Karaoke Randomizer was used for the first time on 11th July at the Creative Commons Salon in San Francisco!

Here’s a great writeup for how to run your own PPT karaoke.
More info on SlideShare.net blog here and here

Download

The code has been released under the CC-GPL license at Google Code project hosting.

Download: Aksharabhyas (zip 605kb)

Screenshots

Its your chance to make a big impact by affecting lives of billions of people around the globe. Your idea, Google’s implementation.

Or is it that Google wants to fool people to give them their ideas so that it can get richer? Either ways, its good that someone’s thinking about the Earth.

Youtube: http://www.youtube.com/watch?v=NgSRwOZtDQ8

Youtube: http://in.youtube.com/watch?v=pHO1JTNPPOU

Reminds me of one of the quotes in my hostel dorm:

Another day passed and you still haven’t done anything!

Although my place Bhubaneswar, is dry and safe, many of the surrounding areas have been submerged including the twin city of Cuttack which is on high alert as Hirakud Dam released more water.

You can find for more information about the status of relief work and floods through this portal.