Author Archive for Peter

Page 2 of 41

A picture a day: Flickr’s storage growth

Just how many pictures does Flickr receive every day? I found a way to estimate the # of images that they add to their database, and another way to get average (original) file sizes for those images. The result? Their storage growth, i.e. their upload bandwidth, and the growth rate of their storage system (how many days to reach a terabyte?)

Number of photos per hour

Flickr: #photos per hour
You see here that weekends, Sundays specifically, are the most busy days for uploads. You can see peaks of almost 68.000 pictures an hour (almost 20 pictures a second). Peaks are around 22h CET (or 1 PM PDT – in California). The lowest rates (still around 20.000 photos/hour) are 12h apart: 10h CET (1 AM PDT).
The average inflow of pictures is: 38.400 photos/hour. That is around 10 photos/second, 920.000 photos/day.

Average photo size

Flickr: average and max photo size
And how big are those pictures? I have found a way to estimate average filesize (and maximum, while I’m at it). It’s not perfect, but quite accurate. How? That’s classified. I could tell you, but then I’d have to … Anyway: these are the numbers:
On average, a picture uploaded to Flickr is 555.2 KB big. They receive files up to 7.3 MB (what number of megapixels would that be?) and quite a lot of 3MB images. My Canon 350D makes 8 megapixel images (3456 x 2304 pixels) that are between 2 and 4 MB large. But the ones I send to Flickr (after Picasa processing) are typically smaller: 1200 x 800 (300 – 600KB) or 1024 x 683 (200 – 400KB).

Upload bandwidth

What happens if we multiply both numbers?
38.400 pictures/hour x 555,2 KB/pic = 21,3 GB/hour = 5,9MB/sec or 47,3 Mbps. Storagewise, this is 15,3 terabyte/month of new pictures. Thank God storage prices are dropping.

Five years ago, a server with a few hundred gigabytes of storage – one of many needed to handle uploads of member photographs – would have cost Flickr about $250,000. Today, Mr Butterfield says, “you can get a terabyte of storage for about $5,000”. (via ft.com)

Peak bandwidth usage: let’s take 60.000 pictures/hour x 3MB/pic: 180GB/hour = 50 MB/sec or 400 Mbps. This is probably still peanuts compared to their outgoing bandwidth.

Video hosting shootout: Youtube, Google, Vimeo, MySpace …

Let’s compare some of the main video hosting services. Now that YouTube has been sold to Google, maybe one of these is on the shopping list of Microsoft or Yahoo!

The source: mobile video

The source file I used was recorded with my Nokia N91 phone at a concert of Billie King in the Ancienne Belgique (Brussels), at the end of their set. The cute girl you see hitting the cymbals is Isolde Lasoen, Belgium’s finest female drummer. The equally cute lead singer is Tine Reymer.

The input file is:

  • video format: MPEG-4 (compressed), 352 x 288 pixels, 15 fps
  • filesize: 7.817.226 bytes
  • duration: 0:01:54 (114 seconds) – so around 550 kbps bitrate

This means that (a) the source material was already compressed and comes from a consumer-grade, low-quality camera, so it was no DVD quality to start with and (b) the source dimensions (352 wide) are smaller than most embedded players(400-480 wide) so the movie had to be upsized, which adds some more distortion.

Video hosting services

Youtube


Size: 425 x 350
Continue reading ‘Video hosting shootout: Youtube, Google, Vimeo, MySpace …’

Helping Martin Luther King, Jr. a hand

Martin Luther King

Last week, CNET’s Elinor Mills reported on how a web search for “Martin Luther King” returns, as its first result on Google and as its second result on Windows Live Search, a web site (martinlutherking dot org) operated by a white supremacist organization named Stormfront.
(…)
What’s remarkable, though, is not that a search algorithm might be gamed by extremists but that the owners of the algorithm might themselves defend the offensive result – and reject any attempt to override it as an assault on the “integrity” of their system.
via Nicholas Carr

How were they (i.e. Stormfront) able to reach #1 with only 372 backlinks and a Pagerank 6? Any SEO tricks being used there?

Anyway, the best thing we can do is to push Google and the other search engines in the right direction: link Martin Luther King’s name to another site that is a better start point to learn about the man. Let’s take his Wikipedia page.

If you want to have an idea about who MLK was: check the following page:

Martin Luther King

Feel free to add your push, let’s see how long it takes before the Google results have been corrected.

UPDATE: Scoble added some more links:
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King
Martin Luther King

Pixar, Dreamworks … : synchronized imagination

One wonders if, next to the departments Marketing and Human Resources, there are a number of offices marked “Industrial espionage” in the studios of Pixar, Dreamworks and other animation houses. It could be a coincidence, but they seem to do the same kind of movies at the same time:

Ants: A bug’s life (Pixar – 1998) | Antz (Dreamworks – 1998)
Monsters: Monsters Inc (Pixar – 2001) | Shrek (Dreamworks – 2001)
Oceans: Nemo (Pixar – 2003) | Shark’s tale (Dreamworks – 2004)
Wild animals: Madagascar (Dreamworks – 2005) | The Wild (Disney – 2006)

Hyperactive nut-focused squirl-ish creature:
Ice age
Ice Age II (Blue Sky – 2006)
Over the hedge
Over the hedge (Dreamworks – 2006)
Continue reading ‘Pixar, Dreamworks … : synchronized imagination’

Coditel digital television

Some remarks on the Coditel digital television system that I have been using for the last two weeks:

Way too many useless channels
Exotic channels
I could now watch channels like Nile TV, Qatar TV and Al Jazeera for Kids. But no Discovery Channel or National Geographic. On the good side: I now have Vijf TV and Vitaya, which was not the case with analog TV.
Continue reading ‘Coditel digital television’

Barcamp Brussels: this Sunday!

Five more days to go! Some more tips for those of you who are attending Barcamp Brussels on Sunday:

How to get there

SAP Lounge: map
The SAP Lounge is located in the Arsenal complex, an old military building that is now turned into fancy offices. The address is Chaussée de Wavre 950, 1040 Etterbeek. That is on the corner of the Chaussée de Wavre and the Boulevard Général Jacques, right next to the VUB University. There is a parking for SAP Lounge visitors just before the Colruyt at the right.
Here is a map of SAP Lounge.

Sponsoring

SAP LoungeLike last time, most things have been paid for (thank you Skynet), but we are still going to need some sponsors for drinks. If you or your company would like to contribute (I will of course mention this kind gesture), please contact me on the day itself.

Fancy Wordpress themes on Dreamhost

new Wordpress themes on Dreamhost

It used to be that when you installed Wordpress on Dreamhost, you only got 3 standard themes installed. Now you get a whopping 50: 2exquisite, 534, Abstrakt3c, Almost-spring, Artsemerging, Barthelme, Blue Kino, Classic, Connections-reloaded, Craving4green, Dapit_hapon, Darknight2.0, Daydream, Default, Disconnected, Durable, Fasttrack, Fluidityrs, Fspring_widgets, Greening, Hemmednoajax, Leone, Lush, Milc3, Modern, Newzen_2.0_build_105, Nineshadesgreen, Nolimits, Ocadia, Orchids, Phoenixblue, Plaintxtblog, Pressrow, Qwilm!, Rounded-v2, Roundflow, Rusty, Shadedgrey, Simply-vic, Sirius, Stripedplus, Tbs-blue, Thirteen, Tiga, Typoxp, Unsleepable, Veryplaintxt, Vslider2, Wpandreas03, Wpglass, Wpjeriko01.
Continue reading ‘Fancy Wordpress themes on Dreamhost’

Intrusive Google ads on Sourceforge

Intrusive Google ads on Sourceforge
Come on, I can understand Sourceforge needs the Adsense revenue, but this is going too far. A huge 450 x 400 blue advertisement is blocking access to most download links on a Sourceforge download page, and there is no way to make it disappear, no [X] button in the top right or a “hide this” link.

The biggest square ads I can see in the Adsense overview page are 336 x 280 (”large rectangle”), so this must be some kind of special ad. It renders the page virtually useless. Drop it, already.

BTW: more flexible screwing, anyone?