SouthernWorldwide.com – Artificial intelligence “agents” are emerging with the promise of handling tasks ranging from organizing emails to making purchases based on personal preferences and budget.
However, technology experts are cautioning consumers about the potential risks involved in delegating important decisions to AI. These risks include communication errors, financial losses, and the possibility of sensitive data falling into the wrong hands, particularly when using AI agents for commerce.
“It’s not yet a mainstream practice and carries considerable risk at the moment due to a lack of sufficient safeguards,” stated Matt Kropp, an AI expert at Boston Consulting Group. “While an agent might be capable of purchasing a car, I wouldn’t readily provide it with my credit card details.”
Despite these concerns, major companies are actively pursuing AI-driven commerce, viewing it as a novel approach to customer engagement and a means to boost sales by automating the shopping process for consumers.
American Express, for instance, recently introduced new services and protections for cardholders who utilize designated AI agents for purchases. These measures include verifying the agent’s identity during transactions, as stated by the credit card company in a press release. This service aims to “protect eligible customers from charges related to AI agent error.”
Read more : Mars rover performs unique chemistry experiment off-world
Amazon has developed an AI shopping assistant named “Rufus.” This agent can monitor product prices on its platform, notify customers when prices meet their desired threshold, and subsequently complete the purchase.
Walmart, the largest retailer in the U.S., has launched an AI agent called “Sparky.” The company claims this conversational AI can assist customers in finding products, provide reviews, and facilitate ordering.
Data from market research firm Statista in November indicated that approximately a quarter of Americans aged 18 to 39 have experimented with AI for product research or shopping.
The rapid integration of AI is not without its challenges and occasional failures.
A notable incident involved Sebastian Heyneman, the founder of a tech startup in San Francisco. As reported by The New York Times, he tasked an AI agent with securing him a speaking engagement at the World Economic Forum in Davos, Switzerland. The AI successfully arranged a speaking slot for him at the prestigious event, but at a cost of $30,000, a sum he found unaffordable.
Heyneman utilized a bot from Tasklet, a company that enables businesses to automate routine tasks using AI agents. Andrew Lee, Tasklet’s founder, explained to CBS News that such issues can occur when a user’s instructions to the AI are contradictory.
Lee also commented that current agentic AI is fully capable of handling shopping tasks and other typical consumer activities. However, he cautioned that technological capability does not necessarily equate to advisable usage.
“The specific application of shopping is not yet a beneficial use case for these systems,” he advised CBS News. “These agents are inherently difficult to trust. Personally, I’m not entirely comfortable with that level of delegation yet. I prefer to maintain control over my financial decisions, and as a business, we do not recommend this approach.”
The primary reason for this caution is the vulnerability of AI agents to malicious actors who can exploit them to obtain a consumer’s personal information, according to Bretton Auerbach, founder of LocalMovers.com. This platform is designed to facilitate secure interactions with AI agents on behalf of customers, by vetting businesses, arranging services, and ensuring secure payment processing to mitigate customer risk.
“If you provide an agent with your credit card details and instruct it to purchase something online from a specific website, there are methods to deceive the agent,” Auerbach explained. “It could potentially misinterpret a legitimate website as a phishing site that prominently displays a prompt to ‘Paste your credit card number here.'”
