Automated initial image tagging: Ojos Inc27 Aug 2005
What meta-data do we have for the average digital picture we take:
- a filename, typically autogenerated by the camera (e.g. “DSC0009”) or chosen at the moment of import (e.g. “Trip to Portugal 001” or “Aug2005_001”)
- a filedate, which probably correponds to the date the picture landed on the hard disk
- EXIF information: date of image capture, camera brand and model, aperture, … (maybe in the future also geo-location from a built-in GPS)</p>
ADDED BY HUMAN HAND</p>
- : a title and a description: in free text
- an group/set/album name: typically less than 10 words
- tags or labels: the ideal search criteria, typically added by the owner
- geo coordinates: the new craze on Pixagogo (who then also add the city name as a tag), so the pictures can be mapped on Google Maps
If the human-added metadata is missing, there is hardly a way to find the picture through Google Images or Flickr. What if there could be an software that analyzes a picture and automatically adds relevant metadata to a picture?
Munjal Shah, onetime cofounder of the auction services firm Andale, finally let slip on his new blog what he’s been working on since leaving last year (…) In other words, his startup, tentatively named Ojos (Spanish for “eyes”), is creating a new way to search and organize photos.
(…) he revealed the key technologies behind Ojos: face and text recognition. (…) The other key: You can assign tags, or keywords, to one photo and the service will automatically append that tag to other photos of the same people.
I wonder if it also could be used to recognize familiar archetypes/icons like: a house, an sunset, an iPod, a Ferrari…
On his own blog, Shah writes:
I think Flickr’s tag based system is just super (in fact I love it), but I wanted all of my photos on there, I wanted them all tagged, and I didn’t want to spend hundreds of hours doing it. So being the lazy engineers that we are, we thought maybe we can at least auto-tag some of the faces and names.
Ho John Lee states on his blog that the technology should be offered as a web service, not as yet another photo storage site. He has a point, and I can see also it working in a technology licensing model: let Flickr or Pixagogo run it locally and let them pay per million pictures treated. Anyway, it will be interesting to see where this company goes.