Yandex Browser began to translate text in images. Now it will be more convenient for users to make purchases and search for information on foreign sites. This became possible thanks to Yandex.Translator and computer vision technologies.
It is the first desktop browser with built-in image translation. Users will be able to translate such texts without downloading any special extensions.
The browser allows you to translate all pictures at once or one by one. To translate a specific image, just select the appropriate item in the context menu. If a person translates the entire site, a “Translate” button appears on the pictures – so you can translate them selectively. And if you need to translate all the pictures – say, to read the names of the buttons – it’s easier to open the Translator menu in the address bar and select the desired item.
Translation takes place in several stages. First, the Browser finds pictures and, using computer vision, tries to highlight text on them – and the fancy the font, the more difficult this task is.
Then the text is sent to Yandex.Translator, which knows more than 90 languages. The translated text needs to be beautifully superimposed on the picture, and this is not always easy. If the translation differs greatly from the original in length, it is displayed in a separate window: it opens when you hover the cursor over the picture.
The new feature is already available in Yandex Browser for Windows and beta versions for Android . In the near future, it will appear in the browser version for other desktop platforms, and by the end of the year – for iOS.
Note that Yandex Browser has long been able to translate text on a page, but sometimes this is not enough. Important information – for example, a concert announcement or a sale – can be displayed in the picture. In addition, it is not always clear what is written on buttons made in the form of images. Now browser users will definitely not miss anything important.