Samsung Galaxy AI: What is it and how does it work?

Let’s break down exactly what Galaxy AI is, what it can do, which devices get it, and why it’s so rad.

What is Galaxy AI?

Galaxy AI refers to Samsung’s initiative to leverage on-device processing power to deliver AI features and functionality. This allows users to access certain AI capabilities without needing an internet connection.

Samsung first hinted at Galaxy AI in November 2023, describing it as a combination of on-device and cloud-based services aimed at enhancing the user experience. The company has since developed the platform further, with the Galaxy S24 series representing the first real showcase of its potential.

Galaxy AI consists of three main sub-models focused on coding, language, and imaging:

– Gauss Code – Used internally by Samsung developers to generate test cases and annotate code. Gauss Code and its derivative assistant code.i help Samsung developers improve software efficiency.

– Gauss Language – Powers natural language processing for chatbot-style applications. Gauss Language is tuned specifically for summarising, translating, and generating text responses.

– Gauss Image – Enables image generation and editing based on text prompts. Gauss Image can create and modify images in a similar manner to leading AI services like DALL-E, Midjourney and Adobe Firefly.

By processing data locally on the device rather than in the cloud, Galaxy AI provides benefits such as reduced latency, enhanced privacy and security, and lower data costs for users.

What are the features of Galaxy AI?

The newly launched Galaxy S24 lineup comes loaded with a variety of AI-powered features leveraging the on-device processing of Galaxy AI. Here’s a look at some of the key capabilities now available:

– Live Translate – Real-time translation for conversations using the phone dialer or Interpreter mode. This feature enables smooth two-way translations for in-person chats.

– Chat Assist – Helps users chat in multiple languages across messaging/social apps. Chat Assist allows adjusting the tone and fixes grammar and spelling.

– Note Assist – Summarises documents and creates templates in Samsung Notes. Note Assist can intelligently summarise lengthy files or generate new document templates.

– Auto Replies – Summarises incoming messages and suggests smart replies. Users can respond to messages with voice commands to send informative auto-generated replies.

– Transcript Assist – Generates transcripts for voice memos with speaker tags. Transcripts are instantly created for audio recordings.

– Circle to Search – Lets users circle or highlight text/images to instantly run a web search. This feature allows searching directly from visual content on screen.

(Image: Samsung)

– Edit Suggestion – Recommends edits to enhance photos. Users get intelligent suggestions to improve their images.

– Generative Edit – Allows editing photos by generating new image content. Photos can be altered by removing objects or adding new generated visuals.

– Instant Slow-mo – Converts standard videos into slow motion. Any video can be turned into share-worthy slow motion content.

Some AI features on Galaxy S24 Ultra are powered by Google’s Gemini LLM. (Image: Google)

– Android Auto tuning – Android Auto will be able to summarise incoming messages and you’ll also be able to send simple voice commands to share certain information, such as ETA.

Is Galaxy AI secure?

Data privacy and security are critical considerations with any AI system. Since Galaxy AI runs locally on devices, it avoids privacy issues associated with cloud-based AI. Samsung states user data remains “end-to-end secure hardware” with threat monitoring and protection.

Users uncomfortable with Galaxy AI can simply disable these features entirely through the Advanced Intelligence settings menu. For those who enable Galaxy AI, Samsung states all personal data is processed in accordance with applicable laws.

What do you need to try Galaxy AI?

Galaxy S24, S24+, and the Galaxy S24 Ultra (Image: Nandagopal Rajan/The Indian Express)

For now, Galaxy AI is only available on the newly launched Galaxy S24 lineup – the S24, S24+ and S24 Ultra models. Samsung currently provides all Galaxy AI features for free, though notes this is only guaranteed through the end of 2025. The company has also hinted that Galaxy AI will eventually make its way to other Samsung devices.

How’s Galaxy AI different from Bixby?

With the arrival of Galaxy AI, how does it compare to Bixby, Samsung’s existing virtual assistant? Well, Bixby is Samsung’s equivalent of Alexa or Google Assistant – focused on answering questions, controlling devices, and accessing information.

Galaxy AI, on the other hand, represents a new generation of on-device AI that powers features like real-time translation and image generation. As Samsung moves away from Bixby, Galaxy AI appears positioned as its replacement over time. For now, both AI systems coexist within Samsung’s ecosystem.