- The improved MBUX Voice Assistant, powered by AI, offers accurate, real-time answers to a wide range of questions.
- State-of-the-art ChatGPT technology provides responses via Microsoft Azure OpenAI Service and Microsoft Bing web search data.
- Seamless interaction with conversation history enables follow-up questions for continuous communication.
- Free update available for over three million vehicles starting today.
Bucharest, December 18. Mercedes-Benz is leveraging the power of artificial intelligence (AI) to expand the capabilities of its MBUX Voice Assistant with a new general knowledge feature. By utilizing AI, the system now provides up-to-date answers to general knowledge queries through Microsoft Bing. Responses are then crafted in natural language using ChatGPT via the Microsoft Azure OpenAI Service. Following its beta introduction in the U.S. last year, Mercedes-Benz is now integrating this groundbreaking functionality into its production vehicles for the first time.
With this in-car feature, users can ask questions about a variety of general topics—ranging from pop culture to geography, science, health, and history—and engage in open-ended discussions for more detailed information. The system also features contextual awareness, enabling it to understand follow-up questions even when they are phrased vaguely. For instance, a user might ask, “How many Grammy Awards has a specific artist won?” After receiving the answer, they could follow up with, “When was the first one?” The system would provide the correct response while maintaining the context.
The MBUX Voice Assistant remains capable of answering everyday questions about weather, stock market updates, news, and sports results.
“By adding AI-powered general knowledge functionality to the MBUX Voice Assistant, we provide our customers with a more engaging and intuitive way to interact with their vehicles. Our innovative AI software seamlessly integrates ChatGPT and Bing, leveraging the Microsoft Azure OpenAI Service to deliver information in a completely new way. This marks yet another step towards a hyper-personalized in-car experience.”
– Markus Schäfer, Member of the Board of Management of Mercedes-Benz Group AG, Chief Technology Officer, Development & Procurement
Enhanced Features for a Safer, More Intuitive Driving Experience
The new feature is seamlessly integrated into the MBUX Voice Assistant. Passengers can activate it just as before by saying, “Hey Mercedes,” ensuring intuitive use and a hands-free driving experience. Alternatively, they can use the dedicated button on the steering wheel to activate the assistant.
To enhance functionality, conversation history is stored for up to one hour, allowing users to ask follow-up questions without needing to repeat previous information.
Starting today, this feature is available as a free update for over three million vehicles equipped with the MBUX infotainment system. Initially, it will be offered in three languages: German, British English, and American English. Users in other regions can change the system language to test the new functionality.
Advanced AI Ensures Data Privacy
With this new functionality, Mercedes-Benz utilizes leading generative AI models provided by Azure OpenAI Service, supported by the security, privacy, and reliability of the Azure cloud platform. Mercedes-Benz maintains full control over backend IT processes. All data collected through voice commands is stored in the Mercedes-Benz Intelligent Cloud, where it is anonymized and analyzed.
To minimize the risk of users encountering harmful, illegal, or controversial content, Mercedes-Benz has implemented a risk assessment tool that evaluates system responses and identifies best practices to reduce the likelihood of harmful answers.
This marks a significant milestone in delivering a cutting-edge, personalized driving experience powered by AI, ensuring both innovation and user safety at the forefront.