Google Translate gets new AI-powered live translation and language learning tools



 Google Blog:

Every month, people translate around 1 trillion words across Google Translate, Search and in visual translations in Lens and Circle to Search. Now, thanks to AI, we’re making it even more effortless to overcome language barriers. Using the advanced reasoning and multimodal capabilities of Gemini models, we’re bringing two new features to Translate to help with live conversations and language learning.

Live conversations translated in real time​

Exploring the world is more meaningful when you can easily connect with the people you meet along the way. To help with this, we’ve introduced the ability to have a back-and-forth conversation in real time with audio and on-screen translations through the Translate app. Building on our existing live conversation experience, our advanced AI models are now making it even easier to have a live conversation in more than 70 languages — including Arabic, French, Hindi, Korean, Spanish, and Tamil.

To try it out, open the Translate app for Android or iOS, tap on “Live translate,” select the languages you want to translate and simply begin speaking. You’ll hear the translation aloud and see a transcript of your conversation in both languages on your device. Translate smoothly switches between the two languages you and your language partner are speaking, intelligently identifying conversational pauses, accents and intonations. This allows you to have a natural conversation with just a single tap.


Google Translate’s live capabilities use our advanced voice and speech recognition models, which are trained to help isolate sounds. This means you get a high-quality experience in the real world, like in busy airports or at a noisy cafe in a new country. These new live translate capabilities are available starting today for users in the U.S., India and Mexico.

Customized language learning capabilities​

Google Translate is already a powerful tool for learning a new language. But we’ve heard from our users that the toughest skill to master is conversation — specifically, learning to listen and speak with confidence on the topics you care about. So today we’re piloting a new language practice feature designed to help you meet your unique learning goals.

Whether you’re an early learner looking to begin practicing conversation or an advanced speaker looking to brush up on vocabulary for an upcoming trip, Translate can now create tailored listening and speaking practice sessions just for you. These interactive practices are generated on-the-fly and intelligently adapt to your skill level.

sddefault.webp


To start, just tap “practice” in the app, set your skill-level and goals, and Translate will generate customized scenarios for you to dive into. In each scenario, you can either listen to conversations and tap the words you hear to build comprehension, or you can practice speaking with helpful hints available when you need them. Developed with learning experts based on the latest studies in language acquisition, these exercises track your daily progress and help you build the skills you need to communicate in another language with confidence.

Tambien.width-1000.format-webp.webp


Following positive feedback from early testers, we're excited to start rolling out this beta experience more broadly in the Translate app for Android and iOS this week. It’s available first for English speakers practicing Spanish and French, as well as for Spanish, French and Portuguese speakers practicing English.

AI advancements for translation​

These updates are made possible by advancements in AI and machine learning. As we continue to push the boundaries of language processing and understanding, we are able to serve a wider range of languages and improve the quality and speed of translations. And with our Gemini models in Translate, we've been able to take huge strides in translation quality, multimodal translation, and text-to-speech (TTS) capabilities. We're going far beyond simple language-to-language translation, and delivering an experience that helps you learn, understand and navigate conversations with ease.


 Source:

 
It is unclear to me how two people use this app together i.e. how do you start the two way conversation with another person.

Do you call the person on phone, then both start new translate app?
 

My Computer My Computer

At a glance

Windows 11 Pro + Win11 Canary VM.I9 13th gen i9-13900H 2.60 GHZ16 GB solderedIntegrated Intel Iris XE
OS
Windows 11 Pro + Win11 Canary VM.
Computer type
Laptop
Manufacturer/Model
ASUS Zenbook 14
CPU
I9 13th gen i9-13900H 2.60 GHZ
Motherboard
Yep, Laptop has one.
Memory
16 GB soldered
Graphics Card(s)
Integrated Intel Iris XE
Sound Card
Realtek built in
Monitor(s) Displays
laptop OLED screen
Screen Resolution
2880x1800 touchscreen
Hard Drives
1 TB NVME SSD (only weakness is only one slot)
PSU
Internal + 65W thunderbolt USB4 charger
Case
Yep, got one
Cooling
Stella Artois (UK pint cans - 568 ml) - extra cost.
Keyboard
Built in UK keybd
Mouse
Bluetooth , wireless dongled, wired
Internet Speed
900 mbs (ethernet), wifi 6 typical 350-450 mb/s both up and down
Browser
Edge
Antivirus
Defender
Other Info
TPM 2.0, 2xUSB4 thunderbolt, 1xUsb3 (usb a), 1xUsb-c, hdmi out, 3.5 mm audio out/in combo, ASUS backlit trackpad (inc. switchable number pad)

Macrium Reflect Home V8
Office 365 Family (6 users each 1TB onedrive space)
Hyper-V (a vm runs almost as fast as my older laptop)
Last edited:

My Computer My Computer

At a glance

Microsoft Windows 11 HomeIntel Core i5-13490F2 x 16 Patriot Memory (PDP Systems) PSD516G56...GIGABYTE GeForce RTX 4070 WINDFORCE OC 12G (G...
OS
Microsoft Windows 11 Home
Computer type
PC/Desktop
Manufacturer/Model
MSI MS-7D98
CPU
Intel Core i5-13490F
Motherboard
MSI B760 GAMING PLUS WIFI
Memory
2 x 16 Patriot Memory (PDP Systems) PSD516G560081 6400MT (32-37-37-74); 1.35V)
Graphics Card(s)
GIGABYTE GeForce RTX 4070 WINDFORCE OC 12G (GV-N4070WF3OC-12GD)
Sound Card
Bluetooth Аудио
Monitor(s) Displays
INNOCN 15K1F
Screen Resolution
1920 x 1080
Hard Drives
WD_BLACK SN770 250GB
KINGSTON SNV2S1000G (ELFK0S.6)
PSU
Thermaltake Toughpower GF3 1000W
Case
CG560 - DeepCool
Cooling
ID-COOLING SE-224-XTS / 2 x 140Mm Fan - rear and top; 3 x 120Mm - front
Keyboard
Corsair K70 RGB TKL
Mouse
Corsair KATAR PRO XT
Internet Speed
100 Mbps
Browser
Firefox
Antivirus
Microsoft Defender Antivirus
Other Info
https://www.userbenchmark.com/UserRun/66553205

Latest Support Threads

Back
Top Bottom