Identify Objects using Phone Camera and Translate Them

 

Thing Translator is a free website that can identify any object using your phone’s camera, and then show its translation in different languages. You just need to open this website on your phone, allow it to access your phone camera, and then take photo of any object. It uses Google’s Cloud Vision to identify an object and then shows its name on the screen in your native language. Not only that, it also shows translation of that object in any other language of your choice.

So, if you are in some foreign land and don’t know what an object is called there in local language, just take photo of that object using this website, and you will immediately come to know its translation.

Thing Translator

Do note that it is not always 100% correct, and in my testing, it showed some of the things incorrectly. But if I took a photo of them from a better angle, then it was able to recognize them correctly.

Also, if you are looking to translate text by taking its photo, then this website won’t do that; for that, there are OCR Apps with Language translation.
How to Identify Objects using Phone Camera:

Thing Translator is actually an AI project, and they have made this sample website that demonstrates its power. You can access the homepage of the website here. They actually call it “demo” page. The entire code is on github (here), and you can also host it on your own.

Open this website on your phone (it doesn’t work on iOS yet). I tried it with my Android phone using Chrome browser. It immediately asked me for permission to open the phone camera. Once I granted the permission, it asked me to take photo of the object that I want to identify. I took photo of the object, and it immediately showed me the name of the object in English, and also its translation in Spanish. And both were correct. I tried with many objects and it was able to more or less identify them correctly.

An interesting part of this app is that it shows at the bottom level of confidence it has in the identification it has given, and it gives other possible identification also for that object, with their levels of confidence. You can see this in screenshots above. One of the photos I took was of a sunglass, but it showed that as “footwear”. However, at bottom, it showed other possible identification as sun glass.

The main purpose of this website is to help you identify objects and know their translation. As I mentioned above, by default it shows English and Spanish translations. However, both of them can be changed. Just click on name of the language to choose any language as your native language, and any other language as the language you want to translate into.

Do note that it does not shows accurate identification of the object. For example, if you take a photo of some food item, it might simply say “Food”, instead of telling exactly what food is it.