Performance test storage system

[benjaminran]

https://github.com/briandoconnor/my-sandbox/tree/develop/20160403_icgc_storage_download_test

[briandoconnor]

So we get reports that upload is very slow:

"Separately, I’m not sure what kind of transfer rates you’re expecting for the spinnaker upload but it seems a very slow process. Originally I was doing this from my macbook on a 1gb Ethernet connection and it was going slow (>20 mins per bam), so moved it into s3 and did it from ec2 and it still was taking about that long, which seems very slow for aws. Is it doing something other than data transfer? The old s3am method takes less than a minute to achieve the same upload. "

I looked at the code and upload looks multi-threaded. We need to profile upload vs. download and try to see why upload is 10x slower than expected.