11 notes &
Cloud Tips: How to Efficiently Forklift 1 Billion Rows into SimpleDB
From rooksfury:
About 9 months ago, I was tasked with fork-lifting a massive amount of data into Amazon’s SimpleDB in a short amount of time. I achieved it. […] If you read-on, I’ll show you how to achieve data upload rates of around 10K items/second.
Worth a good read if you’re a cloud nerd like me and thinking about storing a lot of data in Amazon’s SimpleDB nosql database.