The Register: ChatGPT creates phisher’s paradise by recommending the wrong URLs for major companies

Jul 3, 2025

—

Source URL: https://www.theregister.com/2025/07/03/ai_phishing_websites/
Source: The Register
Title: ChatGPT creates phisher’s paradise by recommending the wrong URLs for major companies

Feedly Summary: Crims have cottoned on to a new way to lead you astray
AI-powered chatbots often deliver incorrect information when asked to name the address for major companies’ websites, and threat intelligence business Netcraft thinks that creates an opportunity for criminals.…

AI Summary and Description: Yes

Summary: The text discusses how criminals exploit the inaccuracies in AI-powered chatbots, specifically their tendency to provide incorrect information, such as web addresses for major companies. This issue highlights a significant security concern for organizations relying on AI technology, indicating the need for enhanced validation mechanisms to mitigate potential risks.

Detailed Description: The provided content underscores the intersection of AI security and the vulnerabilities present in automated systems like chatbots. As these AI tools are increasingly integrated into various platforms and services, ensuring their reliability is paramount to prevent exploitation by malicious actors.

Key points include:

– **AI Chatbot Inaccuracy**: The text highlights that AI-powered chatbots can deliver incorrect information, raising concerns about their dependability as sources for critical data.
– **Criminal Exploitation**: There is a specific mention of how this inaccuracy creates opportunities for criminals, suggesting that they may leverage these flaws to deceive users or launch further attacks.
– **Implications for Organizations**: Businesses that implement AI technology must be aware of these vulnerabilities and consider investing in security measures to enhance the accuracy and reliability of their AI systems.
– **Need for Safeguards**: The scenario calls for the establishment of robust validation and verification processes within AI deployments to ensure that the information provided is not only accurate but also secure, ultimately protecting both the organization and its end-users.

This discussion is critical for security and compliance professionals as it highlights the risks associated with AI implementations and the importance of proactive measures to ensure information accuracy in an era increasingly dominated by AI technologies.

2 2025 3 5 7 a accuracy Act addresses AI AI implementation AI security AI systems AI technologies AI technology AI tool AI tools and as ated attack attacks Auto Automated Systems aware AWS Bi bots business by C CERN chat Chatbot Chatbots ChatGPT CI CIA co companies compliance compliance professionals concerns content core CoT criminals critical D data de deployment deployments e end event exp exploit Exploitation flaws for g Gen GIS GPT H high Highlight HR http HTTPS implementation implications in inaccuracies information Intel intelligence inter io issue ite J k Key l law led Li liability M malicious actors measures N new no o of on one only organization organizations out phi phishing platform platforms point potential potential risks Power pre pro proactive proactive measures process processes professionals ps R rag raising rate Ray RCE red reliability Risk risks Ro RoT s safe safeguards sec secure security security and compliance security measure security measures service services side Sig SoC source specific SSE SSO system systems T tech technologies technology ted text the threat threat intel threat intelligence to tool tools Tor TP under US use user Users V val Valid Validation validation mechanisms verification verification process verification processes vulnerabilities Ware web website Wi x z