Google’s Chat-Based Photo Editor: A Unique AI Tool That Users Will Embrace

Pixeltone, a prototype app created by Adobe Research alongside the University of Michigan, demonstrates the potential of utilizing voice commands and touch for photo editing. A viewer left the top comment on the related YouTube video 12 years ago: “Why so much hate? It isn’t for the ‘real’ photographer, but for my dad, who occasionally uses Photoshop; this is fantastic.”

The democratization of advanced photo editing tools poses risks, particularly regarding their misuse for spreading disinformation and altering reality. While most current editing applications necessitate active engagement and expertise, Google’s conversational editor stands out with its intuitive design, offering robust functionality through simple English commands. It’s just a tap away in the Google Photos library.

“For many, ChatGPT is a playful novelty,” remarks Chris Harrison, director of the Future Interfaces Group at Carnegie Mellon University. “Some have integrated it into their routines, but for most, it’s merely a gimmick.” Harrison anticipates that Google’s editing tool will see broader adoption—especially among those adept enough to utilize Instagram filters. “AI should simplify tasks; this is a prime example that will genuinely interest consumers.”

Clear guidance makes Google’s photo editor more user-friendly. Many AI chatbots begin with a blank text box that provides little insight into their functionalities, which can be unhelpful for users unsure of how to proceed. By presenting the conversational editor immediately upon tapping “edit” in Google Photos, it becomes significantly easier to navigate, as the context for editing a photo is already established. “Human laziness always prevails,” says Harrison.

Google via Julian Chokkattu

Google via Julian Chokkattu

Although you could always go into Adobe Photoshop to remove a street lamp from an image, the cost of a Photoshop subscription can be steep, and using the program effectively demands a foundational understanding of photo editing. “People probably desired this feature but didn’t want the expense or time spent in Photoshop to alter a single image.”

Google’s conversational editor surpasses standard edits like adjusting lighting, eliminating trash from backgrounds, and cropping. Users can simply say, “Add King Kong climbing the Empire State Building,” and it happens. It even allows you to remove people from photos.

This brings us back to the potential for manipulation that these generative AI features introduce. While Harrison recognizes the concerns, he believes they will eventually dissipate.

“People have been modifying smartphone-captured images forever,” he states. “If anyone believes Instagram represents reality, they are in for a surprise. This is just an upgraded tool that reflects what has always existed,” he adds.

To respond to these apprehensions, images edited with Google’s new tool come equipped with C2PA content credentials, IPTC metadata, and SynthID for watermarking and tracking AI usage in media, ensuring the file’s origin can be traced. These measures clearly indicate to other editing software and diagnostic tools that the images have been altered.

Conversational Editing

Photograph: Julian Chokkattu

Editing photos on a smartphone can be cumbersome. It often involves navigating multiple tabs and sliders, which can be challenging to operate precisely. Google has previously explored AI-assisted edits—offering one-tap enhancements based on algorithmic assumptions—but results have varied.