Analyze uploaded photos with Classemes #16
Description
From this article on NBCNews:
Once the police figure out what "suspicious behavior" looks like, they can enlist the help of computers to scan images and videos for certain descriptors, such as "brown hair" or "yellow jacket" or "caucasian."
"You can enter these attributes, and [the software] builds a visual model of the target and then scans for the pattern," Lorenzo Torresani, assistant professor at the Vision Learning Group at Dartmouth, told NBC News.
In the approach Toressani created, images are broken down into units, sort of like tag words, that can be called up, anything from vague ("backpack") to specific ("Dalmatian dog"). The software can comb through millions of photo files in under a minute.
When we asked the FBI if they used this software, a spokesperson told us it doesn't discuss the brands or types of computer systems that it uses, but Torresani "suspects" that software like this is available to the criminal investigators.
The software developed by Professor Lorenzo Torresani at Dartmouth can be found here:
http://www.cs.dartmouth.edu/~lorenzo/projects/classemes/
Looks like you also have to download this 5.4GB parameters database:
http://vlg.cs.dartmouth.edu/projects/vlg_extractor/data/parameters_1.1.zip