Overconfident Aussies fail to spot AI deepfake scams, 58 per cent fail to determine real vs. fake images

Australians are over-estimating their ability to spot AI deepfake scams as technology improves and basic psychology plays against them. New research from Commonwealth Bank, provided exclusively for NewsWire, show 89 per cent of Australians believe they can spot an AI-generated deepfake. But when put to the test, only 42 per cent of people could spot the difference between a real person and an AI generated image. AI or real image quiz Commonwealth Bank general manager James Roberts told NewsWire scammers are becoming more sophisticated as they are aided by AI. “As deepfake scams have evolved the quality of them has gotten better, so they are harder to spot than even a year ago, which might be the factor for the over confidence,” he said. “The quality of the audio and visuals have improved drastically to the point where it is very hard to distinguish high quality (scams) as deep fakes, so while AI can be used for millions of legitimate reasons, unfortunately the criminals are using generative AI as well.” Mr Roberts points out while Australians were asked to spot a deepfake, it is not a uniquely local problem, but the overconfidence most Australians have could play against them. “The findings reveal a growing gap between confidence and reality – and that gap is exactly what scammers are looking to exploit as they increasingly turn to AI to target everyday Australians and small businesses,” he said. Why do deepfakes work? Australians could be duped by a deepfake scam because scammers tap into basic psychology and exploit trust. According to Monash University professor of human factors in cyber security Monica Whitty says people fall for deepfakes due to them tapping into natural instincts. “Humans tend to trust faces, voices and familiar people. Deepfakes take advantage of that instinct.” One way scammers are becoming increasingly sophisticated is their ability to dupe the voice of a person known to the target. “Be vigilant. Educate yourself. And if things look suspicious talk with others about it,” Prof Whitty said. According to Prof Whitty, people can compound the problem by not openly discussing the threat of scams with loved ones. According to Commonwealth Bank 74 per cent of Aussies say they should set up a safe word with loved ones, but just one in five have actually got one. “The data shows that many Australians don’t talk openly about deepfake scams – with only a third discussing AI-generated scams with their relatives or friends. That means fewer opportunities to share warning signs or learn from others’ experiences,” Prof Whitty said. Mr Roberts says these scams work because they push people into making rash decisions. “(Scammers) put the potential in fast thinking mode instead of slow thinking mode from a behavioural science perspective,” he said. “In fast thinking mode we aren’t going into that depth of interrogation and due diligence that we would usually and the scammers pray on that.” Three words to safely avoid scammers Commonwealth Bank says the way to protect against vanilla or deepfake AI scams are basically identical. “The scammers are adopting some sort of time pressure or urgency to get you to stay in that fast thinking mode,” Mr Roberts said. Mr Roberts urges Aussies to “stop, check and reject” any potential scammers. Using the example of an investment scam, which is the most frequent way Australians are targeted, Mr Roberts outlined how the three words can be used. “Pause, take a breath, if you’re going to make a significant financial decision, you want to put a significant amount of thought into it,” he told NewsWire. “The second bit is check, talk to your friends and family, use them as a sounding board. They are people you trust.” “You can use a search engine to research an entity you are going to invest in or better still talk with your financial adviser to check if this is a bona fide opportunity, or even ASIC’s MoneySmart where you can check for potential scam.” “The last bit, once you’ve made up it, is a scam, you have to hang up, delete the email, block the content because when the scammers feel they have someone on the hook they can be very persistent …. Once you’ve made your mind up, stick true to it and reject,” he said. Commonwealth Bank urges everyone to work together to stop potential scams. “We’ve made some good progress, but everyone – including banks, as well as telcos and digital platforms – must play their part and do more,” Mr Roberts said. “No single organisation or sector can stop scams.”