Rufus: Amazon’s Beta AI Shopping Assistant Faces Challenges

The beta version of Rufus was released in the USA in February 2024 and has been available in Germany since November. Rufus is an Amazon assistant designed to help users with product comparison and selection. However, Rufus quickly reaches its limits as a consultant.

According to Amazon, this “AI-based shopping assistant” is trained using the product catalog and internet information. Rufus is supposed to answer product questions and provide recommendations and comparisons. Amazon emphasizes that Rufus is still in its early stages.

When I first opened the chat, I saw various questions like “What do gamers need?” or “What are the best vitamins?” Clicking on the vitamins question, Rufus suggested products, the first being vitamins for women over 50. It’s clear that the AI cannot use personal information, as it doesn’t know I’m 28 and not interested in that product. Amazon does not specify which data was used for training.

After asking Rufus about making cinnamon stars in the oven, he showed a recipe with a list of ingredients and quantities, along with a button for cookie cutters. Clicking it, various products appeared, most of which had the required star shape. One cutter had a customer review mentioning sharp edges. I asked Rufus about this, specifically mentioning the sharp edges and the review. Rufus ignored this, referring to the company’s details and stating, “The customer reviews do not specifically mention sharp edges.”

Next, I wanted advice from Rufus about choosing between an iPhone 16 Pro and an iPhone 15 Pro for Black Friday. Rufus didn’t answer which model is cheaper. Instead, I was suggested to click on an overview page for the sale. The iPhone advice remained superficial, with Rufus only providing vague information.

When I asked where Rufus gets his information, he ignored the question and continued with iPhone tips. I tried asking again using voice dictation, which led to a long sentence without punctuation. Rufus understood it and said he gets information from Amazon product pages. When I asked for specific details, Rufus got sidetracked, returning to the topic of cinnamon star cutters, mentioning sharp edges again.

Finally, I asked Rufus to suggest a smartphone for personal use, focusing on design and camera, without being too expensive. He suggested five “mid-range” devices, but prices were not visible. Clicking on each device led to an overview page with sponsored ads at the top, and Rufus’s suggested model below. This was frustrating as I wanted to avoid searching and scrolling.

For a specific question about the cheapest smartphone, Rufus again provided an overview instead of the cheapest device. Rufus lacks the detail necessary for real advice and comparisons, but this may be expected in a beta version. Rufus is useful for simple questions like finding ingredients and utensils for recipes. However, for more complex purchases, like expensive tech items, Rufus is not satisfactory. He may have more data than human sellers, but what good is it if he doesn’t share his “knowledge” with us?

In summary, Rufus can assist with basic inquiries but struggles with more detailed advice. As a beta version, improvements are likely needed before it can be relied upon for significant purchasing decisions.