Skip to content
Introducing complead. One AI-native platform for financial crime compliance. Read the story
New Ready Integrations available Check the new integrations

Deepfake detection: fraud at onboarding and in payments

In short

Deepfake detection checks whether a face, voice, document or video was made or altered by AI and whether it came from a live camera. FinCEN's FIN-2024-Alert004 of 13 November 2024 names nine red flags and sets the SAR key term FIN-2024-DEEPFAKEFRAUD. Liveness tests run to ISO/IEC 30107-3 cover attacks presented to the camera only. As of November 2026, injected video needs its own controls.

Picture an applicant who passes a selfie video prompt while the session runs through a third party webcam plugin (illustrative). The date of birth says 61; the face looks about 30. Two weeks later the new account sends a burst of payments to a digital asset exchange. Each step is a red flag in FinCEN's deepfake alert. None alone proves suspicious activity.

Deepfake detection is the layer of fraud detection and prevention built to catch those steps.

What is deepfake detection, and where does a financial institution need it?

Deepfake detection is the set of checks that decides whether a face, voice, document or video is genuine and captured live, or was generated or altered by AI. The EU's AI Act defines the term. Under Article 3(60), a deep fake is AI made or manipulated image, audio or video content that resembles existing persons, objects, places, entities or events and "would falsely appear to a person to be authentic or truthful".

A bank or payment firm meets deepfakes at the three points FinCEN's identity analysis uses: "account opening, account access, and during transactions". At opening, a generated face or document creates the customer. At access, a cloned voice or face passes as the real one, and in a transaction a call tells someone to send money.

FinCEN has seen a rise in suspicious activity reports describing suspected deepfake media, "beginning in 2023 and continuing in 2024".

How do deepfakes get through remote onboarding?

"A deepfake video is used to impersonate an individual portrayed on a stolen driver's license." NIST SP 800-63A-4, the US federal identity proofing guideline of July 2025, files that example under injection attacks.

FinCEN found criminals using generative AI to make "falsified documents, photographs, and videos" to get around customer identification and due diligence controls. Each fake aims at a different check: a forged ID card at the review that document fraud detection covers, a swapped face at the selfie match and liveness test of eKYC.

The fake travels one of two ways. A presentation attack is shown to the capture device itself. An injection attack skips the camera and feeds the fake into the data stream.

On live video checks, FinCEN notes applicants who claim repeated technical glitches or ask to switch channel mid check. NIST tells agents to look for "high latency, synchronization issues". It also asks for random cues, such as a request to move. Complaints in the IC3's 2025 report describe online job interviews where lip movement on camera does not fully match the audio.

What is an injection attack, and why can a liveness check miss it?

In NIST's terms, an injection attack slips forged media in between the capture point and the comparison. ETSI's proofing standard TS 119 461 gives the deepfake version: a recorded or generated stream "purporting to come from the camera". A liveness test judges what reaches it. A clean injected stream can look live. NIST says presentation attack detection is "not sufficient to address all possible cases" and requires checks that the media came from a genuine sensor, not a virtual camera or an emulator.

The selfie and liveness check stay with the firm's IDV provider, but an emulator, one of NIST's examples, also shows at the device layer. complead, formerly Sanction Scanner, reads device and session signals from before login to payment, flags each spoofing tool, emulator, tampered runtime or automation tool on its own, and gathers no face or voice data.

Which standards test liveness and injection attack detection?

None of these is a bank rule; each is a benchmark to put to the IDV provider.

Table 1. Liveness and injection standards (as of November 2026)

StandardWhat it coversWhat it leaves outWho it is written forStatus
ISO/IEC 30107-3:2023Testing and reporting of presentation attack detection (PAD)Attacks away from the capture device, injection includedAny adopter; NIST requires it for PAD testsEdition 2, January 2023
NIST SP 800-63A-4Remote PAD with an impostor attack presentation accept rate (IAPAR) below 0.07; genuine sensor checks; media analysis; false negative rates on requestAuthentication after enrollment, which 63B coversFederal agencies, proofing providers and organizations using themFinal, July 2025
NIST SP 800-63B-4PAD required for face login; voice comparison not allowedOnboarding, which 63A coversLogin to US government systemsFinal, July 2025
ETSI TS 119 461 V2.1.1, citing CEN/TS 18099Detection of generated or manipulated faces in video; injection detection tested by an accredited labProofing outside trust servicesTrust service providers and their proofing subcontractorsLab test before the end of 2026
AI Act Article 50Providers mark AI output; deployers disclose deep fakesChecks by the firm that receives a fakeProviders and deployers of AI systems in the EUApplies from 2 August 2026

The attacks ISO/IEC 30107-3 considers "take place at the biometric capture device during presentation", and any other attack is "outside the scope", so a PAD test report to that standard says nothing about injected video. ETSI covers that for trust services: when video is captured on the applicant's own device, injection detection must pass an accredited lab test to TS 18099 before the end of 2026, at level 2 for Baseline proofing and level 3 for Extended, then again at least every second year.

What should a bank ask its identity verification provider?

  1. A PAD test report to ISO/IEC 30107-3. Ask which attack types and which lab; the report covers the camera only.
  2. An injection attack test to CEN/TS 18099. ETSI asks it of trust services for own device video before the end of 2026.
  3. False negative rates by attack type. NIST has providers make them "available to RPs upon request", and a bank buying the check sits in the relying party's seat.
  4. Sensor and device checks. Virtual cameras, emulators and jailbroken phones are NIST's own examples.
  5. How results reach the risk model. Ask which flags and scores the provider sends back with each result, not only pass or fail.
  6. Where the face data goes. A face image processed to identify someone is biometric data under the GDPR, and Article 9 bars that processing unless an exception applies, such as explicit consent.

What red flags did FinCEN list in its deepfake alert?

Table 2 sorts FinCEN's nine red flags by where each one shows and who decides.

Table 2. FinCEN's nine deepfake red flags (FIN-2024-Alert004)

#Red flag (FinCEN's words, shortened)Where it showsWhat checks itWho decides
1Photo looks altered, or does not fit the date of birth or other detailsIDV sessionFace match, document reviewOnboarding analyst
2Identity documents that contradict each otherIDV sessionDocument reviewOnboarding analyst
3Third party webcam plugin, or a channel change blamed on glitches, in live verificationIDV sessionLiveness and injection detectionProvider flags, analyst decides
4Customer declines multifactor authenticationAuthenticationLogin controlsFraud team
5Reverse image or open source search finds the photo in a gallery of AI made facesIDV sessionReverse image searchOnboarding analyst
6Deepfake detection software flags the photo or videoIDV sessionDetection softwareProvider flags, analyst decides
7Software flags AI written text in the profile or prompt answersIDV sessionText detectionOnboarding analyst
8Location or device data that do not fit the identity documentsDeviceDevice and location signalsFraud team
9New or quiet account: rapid transactions, high volumes to risky payees, many chargebacks or rejected paymentsAccount activityTransaction monitoringFraud or AML analyst

FinCEN says no single red flag "is necessarily indicative" of suspicious activity. The firm weighs the surrounding facts first. When it files a suspicious activity report, FinCEN wants FIN-2024-DEEPFAKEFRAUD both in field 2 of the SAR and in its narrative, beside the key terms of the underlying scheme. A deceived customer in the US files a separate report of fraud with the FBI's IC3, as the FBI's announcement of 3 December 2024 asks.

Give every account a second look on a set date.

FinCEN finds AI made ID documents are often caught on a second look at the opening file. The free individual KYC refresh form has an existing customer confirm details, expected activity and source of funds.

How are deepfake voices and videos used against payments?

Against payments, a deepfake plays someone the victim already trusts. FinCEN describes family emergency schemes, where a cloned voice or video poses as a relative or friend, and executive impersonation, where a fake executive tells staff to send large sums to accounts the criminal controls. The same FBI announcement adds that criminals get into bank accounts with AI made audio clips of the holder, and stage real time video chats with "alleged company executives".

Picture a treasury analyst who receives a voice note from the finance director asking for an urgent payment to a new supplier (illustrative). The voice was cloned from a recorded talk. The request is CEO fraud with a synthetic voice, one form of impersonation fraud.

How do you verify a payment request made on a voice or video call?

  1. Hang up and call back. The FBI advises calling the organization's own number; use one the firm already holds, never the number in the message.
  2. A second approver. A payment asked for by voice or video waits for a second person's sign off.
  3. A code word. The FBI tells families to agree "a secret word or phrase"; an executive team can do the same for payments.
  4. No voice match as proof. NIST bars voice comparison for authentication, which sets voice apart from other biometric authentication methods.
  5. A payee check. When the request names a new beneficiary, look at that account before the money goes; complead checks that payee for mule links, reuse and known fraud signals.

When the cloned voice gets paid into a mule account

Under UK APP reimbursement, sending and receiving firms split the refund 50:50. The 2026 payments AML PDF holds a sheet that passes an APP claim to the mule review.

Which controls catch deepfake fraud after the account is open?

Back to the opening applicant (illustrative): the selfie passed, but the phone behind it opened four other accounts that week, and logins come from an IP address far from the stated home. Device fingerprinting ties those accounts together. Two of FinCEN's indicators for further due diligence fit here: access from an IP address at odds with the customer's profile, and coordinated activity across similar accounts. On complead, the device and account graph surfaces "onboarding clusters from one device", spots one device used across several accounts and picks up impossible travel.

In FinCEN's data, firms tend to catch fake ID documents on a second pass over the opening file, and a reverse image search can tie an ID photo to a public collection of AI made faces.

FinCEN reports that such accounts also receive and launder the proceeds of other scams, and some serve as funnel accounts. AI fraud detection helps here when each score names the signals behind it, so an analyst can see why an account was stopped.

Which 2026 dates matter for deepfake controls?

  • April. The IC3's 2025 report counted 22,364 complaints that mention AI, with $893,346,472 in adjusted losses: complaints, not prevalence.
  • July. FATF's update on virtual assets said AI abuse is "emerging as a risk factor" in fraud, hacking and money laundering, and asked supervisors of virtual asset firms to take account of "controls against deepfakes and synthetic identities".
  • 24 July. A FinCEN alert on federal student aid fraud warned that fraudsters may use AI to "overcome identity verification" with generated documents.
  • 2 August. AI Act Article 50 began to apply; providers with systems on the market before then have until 2 December 2026 to mark output (Regulation (EU) 2026/1744).
  • End of 2026. ETSI's last date for lab tested injection detection on own device video in trust services.

When a deepfake opens an account, is a real person's identity behind the face, or one stitched together from stolen and invented details? FinCEN's student aid alert calls the second a synthetic identity, and synthetic identity fraud has checks of its own.

Bring your onboarding and payment fraud questions to a 1:1.

Take one onboarding session and one payment flow through your fraud and compliance requirements with a complead compliance engineer.

7-day free trialNo credit card required
One Platformall compliance, risk & fraud requirements in a platform

Frequently asked questions

What is one recommended way to detect deepfake content?

Watch whether lip movement keeps pace with the voice. Complaints in the IC3's 2025 report describe job interviews where lips on camera do not fully match the audio, and NIST tells proofing agents to look for high latency and synchronization issues. At scale, deepfake detection software and device checks do that work.

Can deepfakes bypass KYC liveness checks?

They can, through injection. A liveness test run to ISO/IEC 30107-3 covers attacks presented to the camera, and the standard puts every other attack outside its scope, so its test report says nothing about an injected stream. NIST calls presentation attack detection not sufficient on its own and asks for genuine sensor checks.

What features should deepfake detection software have?

Presentation attack detection tested to ISO/IEC 30107-3, injection detection tested to CEN/TS 18099, checks for virtual cameras, emulators and jailbroken devices, and analysis of submitted media for manipulation. The provider should document false negative rates by attack type, as NIST asks of proofing providers.

Is deepfake detection GDPR compliant?

It can be, given a lawful basis and an exception. The GDPR counts facial images processed to identify a person as biometric data (Article 4(14)), and Article 9(1) prohibits processing biometric data to identify someone unless an exception in Article 9(2) applies, such as explicit consent. Device signals avoid part of this: complead's device analysis gathers no face or voice data.

What should a SAR on deepfake fraud include?

FinCEN asks for the key term FIN-2024-DEEPFAKEFRAUD in two places, field 2 of the SAR and the narrative, plus any key terms for the underlying scheme. Before filing, the firm weighs the surrounding facts, since FinCEN says no single red flag is necessarily indicative of suspicious activity.

Is voice verification safe against voice cloning?

No. NIST's authentication guideline rules out voice comparison, and the FBI warns that criminals reach bank accounts with AI made audio clips of the holder. Confirm a payment request by voice by calling back on a number already held, with a second approver.

  • deepfake detection
  • FinCEN deepfake alert
  • identity verification
  • injection attack
  • liveness detection
  • presentation attack detection
  • voice cloning
Emirhan Akgün
Written by Emirhan Akgün Software Engineer

Emirhan Akgün is Software Engineer at Complead and works on the platform's .NET services. Before Complead, Emirhan was a full stack developer at Ekofin.net and SmartInfo Data Solution.

Originally published

Back to blog