Feature Articles

Here are all the Samsung Galaxy AI features on the Galaxy S24 series at launch

By Liu Hongzuo - 27 Jan 2024

Galaxy AI, Edit Suggestion, Generative Edit, Instant Slow-mo, Live Translate, Interpreter, Chat Assist, Note Assist

Note: This feature was first published on 18 January 2024.

Samsung Galaxy S24 Ultra in four colourways.

In case you missed it, Samsung made a big deal about its on-device and cloud-based artificial intelligence features during the launch of the Galaxy S24 series, its latest flagship-grade mobile phones.

Besides a hands-on session with these devices, Samsung also took us through the bulk of its Galaxy AI features that signal the Koreans' serious foray into an AI-first approach for its handsets.

We’ll go through the key Galaxy AI features introduced at launch, how they work, and our findings on their practicality and accuracy. Before we go into each feature, here’s a quick reminder of what Galaxy AI is all about.

What is Galaxy AI?

Our hands-on demo session had us running through a gamut of Galaxy AI features testing.

Galaxy AI to Samsung's Galaxy S24 series is what Magic-whatever is to Google’s Pixel phones. In short, they are a bunch of artificial intelligence features built by Samsung, using a combination of on-device processing (via the chipset’s NPU) and cloud-based processing to make certain tools accessible on your smartphone.

As of writing, the features are available on all three versions of Galaxy S24 series phones: Galaxy S24, Galaxy S24+, and Galaxy S24 Ultra. Logging in to your Samsung Account on your Galaxy S smartphone is required for some of the AI features to work, and are sometimes limited to specific Samsung default apps. We’ll make a mention if the feature is available on other third-party apps or not.

Edit Suggestion, Generative Edit, and Instant Slow-mo

@hwztech Generative Edit using Galaxy AI #galaxyunpacked #samsungunpacked #galaxyai #galaxys24series ♬ original sound - HardwareZone

Edit Suggestion and Generative Edit are two photography-related AI features by Samsung. If you are familiar with Magic Editor inside the Google Photos app (or on a newer Google Pixel phone), these Samsung features should be easy to understand.

Edit Suggestion, as the name implies, suggests edits based on the perceived “defects” in the photos you’ve taken. At the demo session, we saw Edit Suggestion use AI to help remove reflections in glass windows or remove shadows across the subject’s face. In both demos, the edits were done perfectly. This is an on-device process done inside the default Gallery app.

Samsung’s Generative Edit is closer to what Google’s Magic Editor offers. By tapping on the cyan, three-starred symbol inside your photos app, you can erase or reposition photo elements to your liking. This depends on the user circling the offending items in the photo, and Samsung will automatically trace out the rest for you. Drag the highlighted item around to reposition it, or simply erase unwanted bits. This service requires cloud access to Samsung’s servers. It takes about 15 to 30 seconds for a Generative Edit to batch-apply all the changes in one go (which is nice, since it doesn’t process every single time you make a change).

While it may not look like it, Instant Slow-mo is also a Galaxy AI feature. That’s because the phone uses generative AI processing to “create” extra video frames for smooth-looking slow-motion clips. For the user, it saves them from having to reshoot the same clip in slow-motion mode.

Together, these three photography/videography features can help Samsung users create social media-ready content with minimal retakes or mistakes.

Live Translate and Interpreter

@hwztech You can now reserve Michelin-starred foreign restaurants with the help of a two-way translator! #galaxyunpacked #samsungunpacked #galaxyai #galaxys24series ♬ original sound - HardwareZone

Samsung has two voice/speech AI features that push out translated speech in real time. 

Live Translate is a call-based, on-device Galaxy AI feature that translates languages foreign to both speakers during a call. At launch, it supports 13 languages, which include languages in popular tourist destinations (English, Chinese, Japanese, Italian, French, Thai, Vietnamese, etc.). Live Translate is enabled during phone calls, and all translations are on-device, protecting the contents of your calls by keeping them private.

Live Translate listens to the entirety of your message before it translates it for your caller (who can use any other phone). Similarly, the feature will translate what they’ve said after they’re done speaking. Both parties can clearly hear if it’s a live person or a translation voice following up in real-time, but it can be very difficult to use in crowded places or if both parties have terrible enunciation. Also, the translation is imperfect, and it can take a while for both parties to fill in the gaps based on what’s said.

We found that the most effective way to use Live Translate is to have your phone in speaker mode, because it allows you to read the translated messages appearing on the screen. Doing so also helps minimise mistranslations or misunderstandings between two callers who cannot understand each other natively.

Live Translate is only available on the default Phone app and requires a network connection to function (since it’s over a call). It’s probably most useful for booking holiday dinner reservations ahead of time, as demonstrated in the hands-on sessions.

@hwztech Conversations are private, because its not processed in the cloud. #galaxyunpacked #samsungunpacked #galaxyai #galaxys24series ♬ original sound - HardwareZone

Interpreter is similar in nature, but this is for two people speaking face-to-face — not over a call. Interpreter’s perk is that it shows the conversation on your phone in a split-screen format, with its orientation and transcripts designed to accommodate two speakers facing each other. Since this is for in-person translation, it does not require mobile data or Wi-Fi. The translations are all on-device.

However, Interpreter supports the same 13 languages found in Live Translate, so you can’t really ditch Google Translate’s Conversation for Interpreter just yet.

A third speech-to-text AI feature, Transcript Assist, wasn’t shown at the demo session. Just like Google’s Recorder app, Transcript Assist is unique to Samsung’s default voice recording app. It uses AI to identify different voices in a voice recording and ascribes them to separate “speakers” while providing a voice recording transcription.

Chat Assist and Note Assist 

@hwztech You dont have to waste braincells on a boss you cant be bothered with if you use Galaxy AI. #galaxyunpacked #samsungunpacked #galaxyai #galaxys24series ♬ Dance / Night / Suspense / Jingle B(1021442) - G-axis sound music

Galaxy AI also offers productivity features like Chat Assist and Note Assist. These are probably the favourites of our AI bunch. They’re so helpful, that it feels almost illegal to use them. You’ll need to log in to your Samsung Account to use both features.

Chat Assist is built directly into Samsung’s Keyboard. It helps you “correct” your tone, so that you sound more appropriate to the people you are texting. It offers six different tones by default, showing you a preview before you hit that “send” button. 

There are professional or friendlier tones, as well as casual tones. It’s useful if you’re texting someone at work or trying to create a social media caption for yourself while relieving yourself of the mental chore of self-censoring. However, it’s not 100% accurate, so you must vet the message after switching tones. 

Note Assist options are built into Samsung Notes app.

Note Assist is a lifesaver for anybody who writes down stuff in Samsung Notes, or reads long articles online. Note Assist has two key perks: Auto-format, and Summarise. They both do exactly what they say: Auto-format is perfect for formatting textual diarrhoea, and it creates presentable meeting minutes in seconds. Summarise pulls out all the key points in long articles to help you save some time when you have a lot of reading to do (provided you copy-paste it into Samsung Notes).

You can literally copy text off websites to get Samsung Notes be your personal summary assistant.

On a related note, Android Auto (the automobile operating system for Android-powered dashboards) can also use AI for summarisation and auto-suggest replies or actions, such as sending your ETA to a recipient or replying to them without taking your eyes off the road.

Circle to Search with Google

Hold down the Home Button and circle what you'd like to Google Search.

The last AI feature is a Google-based one built into One UI. Instead of saving, crop, and refining your image searches via Google Lens or Google Image Search, you can now hold down the Home Button and circle what you’d like to image-search for. Circle to Search with Google basically reduces a multi-step process into a two-step one, and it works across anything you can screenshot or even watch on the display. 

You can follow up on the search further by typing into the search field above. For example, we can try looking for the same MicroSD card, but ask if there are variants with higher storage capacities.

Once the search starts, Google takes over, so we can’t say this is entirely Samsung’s effort despite the conveniences it brings. Also, the conversant follow-up searches you get are also on Google’s end. It’s limited by Google’s ability to recognise what’s circled, so don’t expect it to tell if your friends are wearing fake branded stuff. 

Samsung Galaxy S24, Galaxy S24+, and Galaxy S24 Ultra pricing and availability 

Samsung Galaxy S24+ in four colourways.

Do you have a favourite Galaxy AI feature? Let us know. In the meantime, be sure to check out the official Singapore pricing, availability, and promotions for the Samsung Galaxy S24 series.

Be sure also to check out our hands-on/buying guide of the Galaxy S24 series, and everything new for the new phone

Join HWZ's Telegram channel here and catch all the latest tech news!
Our articles may contain affiliate links. If you buy through these links, we may earn a small commission.