Running out of Images
Andrew Bell
Visual Architect : New York
topics: Visualizers, Rock and Roll, Process, Design, and Video
I was thinking recently, one day we might run out of new images. Let’s take the current standard for high quality images, 1080p hi def video. It’s surprising to realize that that frame contains a finite number of possible images. I thought it would be interesting to figure out just how many, so I wrote a little Python expression to do the math. The total number of pixels is 1920 horizontally x 1080 vertically = 2,073,600 pixels. There are 256 possible intensities of red, green and blue for each pixel, so that’s 2563 = 16,777,216 possible colors. To figure out how many possible images there are, we need to raise the second number to the power of the first, so 16,777,2162,073,600 = 1.5 * 1014,981,180 possible images. That’s a pretty big number – it’s almost fifteen million digits long. Printing it in 10 point Monaco would take over 2,700 pages of paper. Scientists estimate that there are 1080 atoms in the observable universe – a tiny number in comparison.
However big it may be, the fact that the number is finite is a surprising thing to realize. It means that every possible image has a unique ID number. So instead of asking me, “did you see that picture of MIA performing pregnant at the Grammys”, you might ask, “did you see image number 1,394,239,...,572?” Obviously that is totally impractical and it would make you a huge nerd, but it’s interesting that you could.
We think of visual artists as generally creating things that are original, and if they’re doing their job, they are. But I think it’s also surprising to realize that in another sense, they are just exploring a fixed set of possibilities. “After all that hard work and all those revisions, we decided on image number 884,297,...,493.”
Another weird thing is that the answer to nearly any question is contained in these numbers. Who killed JFK? There is a number which is a picture of the answer. What would Michael Phelps hitting a bong wearing an orange floral sari on the moon on July 19, 2033 at 3:19pm look like? What does a McDonald’s look like flooded with water? The answer to that question in full color and high definition is contained in image number whatever. Strange but true – the things which are, the things which are not and the things which will be – they all have a number.
Most of these possible images are pretty similar to what you get if you crank up the Add Noise filter in Photoshop, and aren’t really that interesting to look at. Part of my job at The Barbarian Group is to help figure out technical ways to create images. Put another way, my job is finding efficient ways to skip over the boring numbers and arrive at the interesting ones.
Most of these possible images are pretty similar to what you get if you crank up the Add Noise filter in Photoshop, and aren’t really that interesting to look at. Part of my job at The Barbarian Group is to help figure out technical ways to create images. Put another way, my job is finding efficient ways to skip over the boring numbers and arrive at the interesting ones.
Update:
Thanks to an anonymous commenter who pointed out that I misplaced a comma. Fixed.
Thanks to an anonymous commenter who pointed out that I misplaced a comma. Fixed.
Also, with respect to the successor of an image, let’s assume a straightforward encoding of the image that lines up the pixels row by row, and stores them as interleaved RGB channel ordering. This would make the majority of images’ lower right pixel imperceptibly bluer than its predecessor, but otherwise the two images would be identical.
21 comments
And if there's 'dickcheneyhasahairybutt', there's also 'dickcheneyhasahairybutt AND ONE', but that's where the grain hits in again.
Maybe I'm stretching it too far.
and if a blogging platforms like Blogger or even whatever les Barbarians use had a length limit, could the same be said for posts? which would make this post number 763,629,...,844. or maybe 763,629,...,845. (yea yea, comments too.)
its only 64x64 B&W but still takes pretty damn long to go through all combinations!
Every digital image has a number because every digital image IS a number. Just a very, very, long one.
So your example of "hey, did you see image 1,345,559,...980" is exactly the same as sending someone an email with the image attached, inline.
I think you may be getting stuck on the notion of "numbering" as "ordering". But the set of all possible digital images isn't ordered in any way that would be meaningful for humans. Image 1,345,559,...981 isn't another image of a McDonald's. At best it might be almost but not quite like its immediately preceding image.
It's kind of like a visual type of "bible code" encoding.
You should actually run an evolutionary algorythm that creates random values for the rbg of each pixel and evolved a rules set which produce results that look most like real photos of say out door scenes and then turn the algorythms loose to predict the futre.
Actually if you assumed only a black and white photo of everything you could greatly reduce the variables.
If eachpixel only had a 256 grey value then that help you a lot.
If you can get away with a 24 bit grey value on a 800 x 600 viewport you are REALLY knocking down numbers and could evovle such photos more easily.
vivzizi
vivzizi
You misplaced your comma, it is supposed to be 10 to the 14,981,180th power. The number is really almost 15 million digits long.
I agree with Neil Kandalgaonkar on this one. This seems surprising at first, until you realize that a digital representation of an image is itself an "ID number". I think the reason it seems so surprising is that we have an association with "ID numbers" being short sequences, but in fact in this case the sequence is so long that the number is equally complex as the image.
"evolutionary algorythm that creates random values for the rbg of each pixel"
See the Einstein's Brain Project http://people.ucalgary.ca/~einbrain/new/text/ghosts_in_the_machine.html Where they generate random imagery then use face recognition to pick out the structure.
"there are many implementations of this concept"
I think the best known is "Every Icon" http://www.numeral.com/eicon.html There is another more developed piece from the same year that is fairly unknown, and more similar to the proposition here http://runme.org/project/+godseye/ There are a bunch more documented on http://radicalart.info/AlgorithmicArt/grid/every/ with the earliest one from 1991. That site (radical art) has some great discussion of related concepts as well.
Imagine all possible combinations in a big image stack:
It then becomes a matter of sorting and selecting from the stack.
For example what about a yet to be taken mug shot photo of the face of the man who did something?
That photo would have certain color tones in certain places that would considerably reduce the total number of images not yet taken but easy to construct to sort through.
Remember also that the big stack would not only have one photo but every possible photo of everything from every angle.
Suddenly by using some math you can determine both which photos would be faces by color tones and then determine which photos would be profiles that would match those faces based on the physics of light falling across faces that have a certain nose length etc.
I am starting to think that with super powerful computers there would be ways to actually start to sub select real photos that have not been taken yet from this "stack of all possible photos".
One way to start is if you assume a much smaller camera resolution (which after all worked for digital camera for quite some time as webcams at merely 320 by 240 resolution) then you can really start getting the numbers way down.
In a real sense we are talking about a time machine too.
For example by restricting photos to those wearing old clothes or even bearskins we can create all possible photos of people of the past.
Whatever is left then are all possible photos of the future.
Let me say that again. Whatever is left ARE PHOTOS OF THE FUTURE.
There are many other constraints one could use which in combination start really narrowing down this stack of all possible photos into something very meaningful. For example all possible extra solar planets could be imaged before being visited. using a presumption of a centered image of the planet partially filling the frame and a star of a certain color then the only possible light dropoff for the possible planet can be constrained and all possible planets photos created. Somewhere within that now much smaller stack IS AN ACTUAL IMAGE OF THAT PLANET.
It's also interesting to realize that this whole concept is in many ways similar to how a hologram works. A hologram holds all photographs angles in a nearly flat plane flim emulsion because it records the wavelengths that have pased through the film from all directiosn and only display the one that a reconstructing laser projects whenit comes from the film in that same angle.
In a way this virtual photo stack or all possible color combinations of all possible pixels in a digital camera holds information in much the same way
vivzizi
www.vivzizi.com The fizz of Life.