In my previous post on Bing image search vs. Google, Yahoo & Tin Eye, I mentioned the “visual search” or “search by image” features of the major search engines, in which a reference image is the basis of the search rather than text.
Bing and Google will search first for additional copies of the same image, and when past those, will show “similar images” or “related images”. This can be an interesting way to discover new art and artists.
In comments on that post, a reader was kind enough to inform me of a new and fascinating entry into the field of image based search: Same Energy.
Same Energy is based on deep learning, a subset of machine learning, which is a form of computer process that is sometimes over generously called “artificial intelligence” or “AI”.
Although I’m sure Microsoft and Google are incorporating elements of machine learning into their image search algorithms, I believe they still rely heavily on associated text, tags and meta information. Same Energy appears to rely entirely on deep learning.
I fed a source image of Monet’s On the Seine at Bennecourt to Bing, Google and Same Energy. The regular search engines returned many sources of copies of the same image, and then started to suggest “similar” images (images above).
Same Energy, while often finding a few copies of the same image, would much more readily start showing a range of similar images, often with more varied results than the big two (image above). I found its results were pretty good in terms of similarity, but often ranged wider and led to interesting discoveries.
When you upload an image (most easily by dragging one from your desktop, there is no provision for entering a URL for an image on the web), Same Energy immediately displays a tight grid, arranged mosaic style, of numerous images (you can modify the grid under “Settings”). The image being referred to is displayed at the upper left.
Clicking on one of the similar images places that image in the upper left, and shifts the response and field of images to similarity to that image. It also allows you to click on that new reference image and see more detail, including a link to the page from which the image was sourced (images above).
While Same Energy seemed to have a broader interpretation of “similar” than the major search engines, it was quite good at recognizing the nature of the image and the quality of the art. I deliberately tried to get it to mistake very realistic paintings for photographs, but it almost never did. It also did not readily mix in amateurish low quality paintings with high quality work by more accomplished painters. Both of these can be unfortunate tendencies in the big search engines’ image similarity searches.
The combination of the quick, densely displayed returns and the level of quality makes searching for similar images more engaging with Same Energy than with Bing or Google. I found myself fascinated, dragging images of widely varied styles into the interface, and often tracking down images that came up that were new to me, and bookmarking often. If you sign up for an account, the option is offered to save images and create Collections.
Searching for images with nudity, as in figure drawing models, returns blurred images. You must click through on an image and check your acceptance to see images that contain nudity, or have been tagged NSFW, etc. Be aware that the results (many sourced from Reddit) are then pretty much unfiltered.
I tried uploading an image from my own webcomic, Argon Zark!, and I found the returns actually gave me some insight into how others (or at least a deep learning algorithm) might perceive my style (image above).
You can also enter text searches, but I found this feature weak at this point in the system’s development. I tried the names of several artists, and many weren’t recognized as viable search terms. There is no provision yet for setting image size, or other refinements that might possibly be added in the future. Also, I noticed the same images coming up fairly often in my searches for a given genre, for instance landscape painting.
Same Energy is young, still in Beta, and likely has a much smaller database of indexed material at this point than the big players, who have been at it for years and with significantly greater resources.
Jacob Jackson, the developer, indicates that Same Energy is an ongoing project and will continue to be refined and improved, even while its reach increases.
I, for one, will be stopping back frequently to indulge.
The upshot is, if you’re looking for alternate sizes or additional information on a given image, use Bing or Google. If you are more interested in exploring, discovering and just having fun searching through art images (or any kind of images), give Same Energy a try.
4 Replies to “Same Energy – image similarity search with Deep Learning”
“Same Energy is based on deep learning, a subset of machine learning, a form of computer process that is sometimes over generously called “artificial intelligence” or “AI”.”
This is not over generous. Machine learning is a subfield of AI. It’s a big tent.
Sorry if I didn’t make myself clear. I mean I believe the use of the term “artrificial intelligence” itself is overly generous, in that “intelligence” implies much greater capabilities for machine learning than are currently being demonstrated.
Perhaps when we achieve a synthesis of neural nets and quantum computing, we’ll see systems worthy of that term.
“Good morning, Forbin.”
Bacteria have intelligence. We may be the only species possessing a certain kind of consciousness that has recently given rise to culture and civillization, but intelligence spans a very broad spectrum, even in nature. The artificial systems we have now fit somewhere in the middle of that spectrum.
Hi Don. I understand your point and you are technically correct. However, when I say I find the use of the term overly generous, I’m less concerned with a technical definition, and more concerned with the general public’s interpretation of the term’s meaning. There is an inference in the general public’s view of the term “intelligence” that it implies consciousness, or at least the image of consciousness that we associate with species like dogs or dolphins that also learn.
I have a problem with the way that misconception is being used by companies selling “AI solutions” to create a false impression of their systems’ viability and the state of the current technology. If the current level of machine learning is intelligence, it’s a savant syndrome kind of intelligence – extraordinarily powerful in one way (pattern recognition), and deficient in other ways in comparison of the intelligence of human beings.
I think it would be most helpful to call the current state of the technology “machine learning”, and leave the term “artificial intelligence” as a goal, so there is a way to distinguish between the two — potentially vastly different — sets of capabilities when the higher form is achieved.
Yes, science is concerned with technical definitions, but Language, after all, is about communication, and if the scientific community is dismayed about the lack of understanding of scientific issues among the general population, they might do well to consider that in the choice of terms used.
Comments are closed.