Toggle Contrast

Deepfake technology – Dangers of AI

Date: Monday, 31st Mar 2025 | Category: General

What are Deepfakes?

A deepfake is an image, video, sound, voice, or GIF which has been manipulated by a computer to superimpose someone’s face, body or voice onto something else. This could be done with or without the subject’s consent. Deepfakes have become popular due to the accessibility of mobile and computer-based apps. This means users without sophisticated technological skills can easily access, create, and distribute deepfakes. Deepfakes can be produced using computer and mobile apps to upload images from a user’s camera roll. The quality of deepfakes can vary depending on the sophistication of the tech used and the skills of the creator. However, the standard of the deepfake produced will rarely matter compared to the potential harm it may cause when used to harass, bully, or abuse a victim.

What are video Deepfakes?

Video deepfakes are the most common type. People who create these videos use artificial intelligence to replace someone’s face or body in existing video footage. Examples include making a celebrity say something controversial or a news anchor reporting fabricated stories. In some video deepfakes, a voice actor will imitate the celebrity or original audio to provide the new voice. Alternatively, the creator might also use voice cloning.

What is voice cloning?

Voice cloning, or audio deepfakes, manipulate voices instead of video to sound like someone else. An increasingly common scam uses voice cloning to target people. For parents, they might receive a frantic call from their child who needs money for a certain purpose immediately. These scams are extremely convincing and have resulted in financial loss. Someone could also use an audio deepfake to bully another person. For example, they could imitate a classmate’s voice to make it seem like they said something they didn’t. Regardless of the type of deepfake, it’s important to remember that someone needs to use an AI tool to create it. Deepfake creators are not always clear, but AI does not automatically generate this content.

What are the potential harms?

Deepfakes can affect people in a range of ways and can leave children and young people open to online harm. Children and young people might struggle to recognise fake videos and audio, especially as technology becomes more sophisticated. Additionally, the increased accessibility to AI tools might mean that more people can create deepfakes. This can therefore increase the reach of potential harms.

Cyberbullying, harassment and abuse

Perpetrators might also use deepfakes to bully others by creating videos meant to mock, intimidate or embarrass them. The nature of deepfakes might make the bullying more severe for the victim. It might even border on abusive behaviour.

Find out more about how you can be deepfake savvy to safeguard the children you are working with this beginners guide to deepfake.