Back
Technology

Samsung Bixby AI Assistant Undergoing Major Upgrade with LLM and Third-Party Integrations

View source

Samsung's Bixby AI assistant is undergoing a significant upgrade, integrating large language models (LLMs) and various third-party services, with details emerging from leaked screenshots and a briefly published, then deleted, official announcement. This enhanced version is expected to be part of the upcoming One UI 8.5 update, aiming to provide a more natural and conversational user experience with improved context understanding and direct task execution.

Overview of the Upgrade

Reports from leaked firmware files, developer-shared screenshots, and a recent, though retracted, Samsung announcement indicate that Bixby is being redesigned with a focus on artificial intelligence. The update is intended to enable more intuitive device control and natural interactions. Many of the functionalities identified in leaks and the brief announcement mirror features found in Google's Gemini AI assistant.

Core AI Enhancements and Natural Language Processing

The updated Bixby is designed to improve its understanding of context and execute tasks more directly. Examples provided include Bixby understanding natural language requests such as "I don’t want the screen to time out while I’m still looking at it" to directly activate the "Keep Screen On While Viewing" setting. Similarly, asking to keep the screen on while viewing will directly adjust the relevant setting in the Settings app, rather than providing instructions. Bixby may also surface specific settings, such as Accidental Touch Protection, when a user inquires about the screen staying on in a pocket.

Perplexity Integration

A key aspect of the Bixby upgrade is its integration with Perplexity, an AI-powered search engine. This integration is designed to enable Bixby to perform real-time web searches and display AI-powered answers directly within the Bixby interface, eliminating the need to navigate to separate browsers or applications. An example query provided was "Find me hotels in Seoul that have swimming pools for kids," demonstrating its ability to retrieve specific information from the web.

Third-Party Service Connectivity

Beyond Perplexity, Bixby is expected to integrate with additional third-party services. Leaked screenshots have indicated potential integrations with:

  • The Weather Channel
  • HERE Maps
  • SkyScanner
  • Uber

These integrations would allow Bixby to access and utilize data from these services for various user requests.

Advanced AI Capabilities and User Interface

Details from leaked screenshots suggest several advanced features and UI improvements:

  • Mini-Window Interface: When activated, Bixby will appear in a mini-window over existing content, allowing users to continue conversations, rate results, copy text, and access sources directly.
  • Conversation History: The Bixby application, accessible from the app drawer, will display previous conversations through a left-side menu.
  • Device Control: Bixby is shown to perform device-related actions such as controlling Bluetooth, Dark Mode, and the Flashlight.
  • Document and Image Discussion: Users may be able to upload documents or images for discussion with Bixby, with capabilities to discuss uploaded documents in a podcast-style format.
  • Circle To Ask: A feature named Circle To Ask is under development, which is described as comparable to Google's Circle to Search functionality.
  • Bixby Live: This feature, resembling Google's Gemini Live, provides real-time responses during active conversations. It includes several selectable conversational styles: General Agent, Interview, Listening Ear, Positive Speaker, Storyteller, and Tour Guide.
  • Camera and Screen Sharing: Bixby Live may allow users to share their phone's camera viewfinder to analyze surroundings or share the phone's screen for discussion. When the camera viewfinder is shared, three modes are available:
    • AI Solver: Described as assisting students with assignments.
    • Translation: Intended for live language translation.
    • General: Designed to handle other tasks.

Release and Availability

The updated Bixby is slated to launch as part of the One UI 8.5 software update. The new Bixby version will be tested through the One UI 8.5 beta program, which is reportedly available for the Galaxy S25 series in specific markets. The public release of the stable One UI 8.5 build, along with the enhanced Bixby features, is anticipated to launch alongside the Galaxy S26 series, which is expected next month. It is currently unconfirmed if these new Bixby features will be released to existing or older Samsung devices.

Samsung's Stated Intent and Information Dissemination

Woo-Joon Chai of Samsung was quoted in the briefly published announcement, stating that the company aims to make AI phones easier to use and to enable more natural interactions and intuitive device control through Bixby. The official announcement regarding the Bixby reboot was published by Samsung through its US and Global Newsrooms but was subsequently deleted. The reason for the deletion is unclear, though it has been speculated that the posts may have been published earlier than intended. Despite the deletion, the information had already been disseminated by several tech news outlets.