Google Translate, Now With Voice Input

Google Chrome 11 added support for HTML speech input API. "With this API, developers can give web apps the ability to transcribe your voice to text. When a web page uses this feature, you simply click on an icon and then speak into your computer's microphone. The recorded audio is sent to speech servers for transcription, after which the text is typed out for you."

Google Translate is the first Google service that uses this feature. If you use Google Chrome 11 Beta, Google Chrome 12 Dev/Canary or a recent Chromium build and visit Google Translate, you can click the voice input icon. Right now, this feature only works for English, so you need to select "English" from the list of input languages.


Unfortunately, the results aren't great. I tried to translate "beautiful sunshine" into French, but the speech-to-text engine didn't work properly and Google had to translate "wake up beautiful sunshine girl".


{ Thanks, Kalin. }

Google Translate App for iPhone

Yet another Google app initially developed for Android makes its way onto the Apple App Store: Google Translate. It doesn't have all the features of the Android app: there's no conversation mode, no SMS translation, Google Suggest or a list of related phrases. Another issue is that the font size is way too big.

The application has a feature that's not available in the Android app: full-screen mode, so it doesn't make sense to use a such a big font size which is not even configurable. Google says that "the ability to easily enlarge the translated text to full-screen size" makes it "much easier to read the text on the screen, or show the translation to the person you are communicating with. Just tap on the zoom icon to quickly zoom in."


Why would you use the native application instead of visiting translate.google.com? The native application supports voice input for 15 languages, text-to-speech for 23 languages and it's better suited for quickly switching between multiple languages.

{ via Google Mobile Blog }

Conversation Mode in Google Translate for Android

Google Translate's app for Android added a feature that has previously announced by Google: conversation mode. The new option is experimental and it only works for English and Spanish, so it's more like an early preview. Conversation mode is a fancy name for making it easy to have a conversation in two different languages.

"In conversation mode, simply press the microphone for your language and start speaking. Google Translate will translate your speech and read the translation out loud. Your conversation partner can then respond in their language, and you'll hear the translation spoken back to you. Because this technology is still in alpha, factors like regional accents, background noise or rapid speech may make it difficult to understand what you're saying," explains Google.


The conversation is supposed to be fluid, but you still need to confirm that Google's voice recognition system worked well and tap the "Reply" button to switch roles. Here's a demo that shows the new feature in action for English and German:

Google Translate's Beatbox Easter Egg

Last month, a Reddit user found an unexpected way to use Google Translate: as a beatbox.

1) Go to Google Translate
2) Set the translator to translate German to German
3) Copy + paste the following into the translate box: pv zk pv pv zk pv zk kz zk pv pv pv zk pv zk zk pzk pzk pvzkpkzvpvzk kkkkkk bsch
4) Click "listen"
5) Be amazed :)

You could also use this permalink, but it's less exciting. There are many other variations you could try.

Google decided to make it more obvious that this is an Easter egg by replacing "Listen" with "Beatbox".


Here's a YouTube video featured in Google Demo Slam:

{ Thanks, Zachary. }

Google Translate Shows Alternate Translations

No translation is perfect, and that's especially true for a machine translation service like Google Translate. From now on, when you translate a text using Google Translate and Google finds some reliable alternate translations, you can pick one of them.

"Just click the translated phrase and you'll see a pop-up menu of possible alternates for that phrase, as well as the original phrase highlighted in your original text. Not only can these alternative translations give you a better understanding of a confusing translation, but they also allow you to help Google choose the best alternative when we make a mistake," explains Google.

It's interesting to notice that the new feature helps you better understand the technology behind Google Translate. "Typically, when we produce a translation, our system searches through millions of possible translations, selecting the best -- that is, the most statistically likely -- translation. With this feature, we expose more of those possible alternatives."


Right now, Google only shows alternate translations when you try to translate a text, so this doesn't work for web pages.

Google Translate Adds Support for Latin

Google Translate is the first important machine translation service that supports Latin. Google says that thousands of books that are available in Google Book Search include Latin passages and the machine translation service has been trained using texts that are already translated.

The results aren't great and it will be difficult to improve them, but it's still an interesting experiment. Here's an example of translation:

"Translating by machine from Latin is difficult and our grasp of grammar not without error. The Latin is unmatched because most of them Latin books have already been written and only a few of the new shall be hereafter. Many have been translated into other languages and these translations we use to train our translation system. Since this system translates books well similar to those from whom he learned, our ability to translate famous books (such as The Gallic War Caesar 's) is already good."

Google Translate's Conversation Mode

Google has recently demoed a new feature that will make Google Translate a lot more useful: conversation mode. Instead of typing the text you want to translate, you can just speak it and Google will convert speech into text, translate the text and use text-to-speech to output the result. You can already do that if you install the Google Translate app from the Android Market. Conversation mode lets you quickly switch between two languages, so that two people can have a conversation even if they speak different languages.

"Google showed off a new application that translates conversations on Android mobiles at a recent conference in Germany. Google employees held a conversation over two Android mobiles with one person speaking German and the other English. The application worked its magic after each persons statement and then referred the translated message back to the other person," reported Simon Thomas.

Unfortunately, the results aren't always great. Google Translate's conversation mode will be released in a few months.



{ spotted by François Beaufort }

Google Tests a New Interface for Google Translate

Garrid Lou spotted a new user interface for Google Translate, which shows examples of news sites that can be translated and other Google products that use Google Translate. The new interface replaces the long drop-down of languages with a multi-column list and moves the translated text to the right.




{ via google.org.cn }

How Google Translate Works

Google uploaded a video that explains how Google's machine translation service works. It's fascinating to see how much Google Translate has improved in the past 4 years and how many Google services use it.

Here's the full text of the video:

"Google Translate is a free tool that enables you to translate sentences, documents and even whole websites instantly. But how exactly does it work? While it may seem like we have a room full of bilingual elves working for us, in fact all of our translations come from computers. These computers use a process called 'statistical machine translation' -- which is just a fancy way to say that our computers generate translations based on patterns found in large amounts of text.

But let's take a step back. If you want to teach someone a new language you might start by teaching them vocabulary words and grammatical rules that explain how to construct sentences. A computer can learn foreign language the same way - by referring to vocabulary and a set of rules. But languages are complicated and, as any language learner can tell you, there are exceptions to almost any rule. When you try to capture all of these exceptions, and exceptions to the exceptions, in a computer program, the translation quality begins to break down. Google Translate takes a different approach.

Instead of trying to teach our computers all the rules of a language, we let our computers discover the rules for themselves. They do this by analyzing millions and millions of documents that have already been translated by human translators. These translated texts come from books, organizations like the UN and websites from all around the world. Our computers scan these texts looking for statistically significant patterns -- that is to say, patterns between the translation and the original text that are unlikely to occur by chance. Once the computer finds a pattern, it can use this pattern to translate similar texts in the future. When you repeat this process billions of times you end up with billions of patterns and one very smart computer program. For some languages however we have fewer translated documents available and therefore fewer patterns that our software has detected. This is why our translation quality will vary by language and language pair. We know our translations aren't always perfect but by constantly providing new translated texts we can make our computers smarter and our translations better. So next time you translate a sentence or webpage with Google Translate, think about those millions of documents and billions of patterns that ultimately led to your translation - and all of it happening in the blink of an eye."