
Reviews
Part of Synthetic media verification: a working guide for reporters
Synthetic media evidence types compared, and what each proves
Synthetic media evidence types compared across provenance, source access, context, file metadata, forensic artifacts, detector scores, and corroboration.
What to take away
- Provenance can document file history without proving that a depicted claim is true.
- Direct source access can explain capture history, but the source's account still needs corroboration.
- Context checks often expose false captions even when technical generation remains unresolved.
- Forensic artifacts and detector scores are method-dependent and should be reproducible.
- Strong findings combine independent evidence types that answer different questions.
Synthetic-media investigations fail when every signal is treated as a vote in one large authenticity poll. A valid signature, a strange shadow, an eyewitness, and a model score do not measure the same thing. Compare them by the question each can answer, the failure modes it carries, and the records needed for review.
Comparison table
Best question
- Provenance credential
- Who signed this history, and was it altered?
- Original-file access
- What file did the source retain?
- Metadata
- What does the file report about creation or export?
- Context
- Does the caption fit the real event?
- Source testimony
- How does the provider explain acquisition?
- Forensic observations
- Does the signal show editing or generation traces?
- Detector output
- Does a model flag patterns in its scope?
- Corroborating media
- Is the same event independently recorded?
Strong form
- Provenance credential
- Validated manifest with trusted signer and clear actions
- Original-file access
- Native file transferred with documented custody
- Metadata
- Internally consistent fields matching other records
- Context
- Independent records and parallel media converge
- Source testimony
- Identified source with access and testable detail
- Forensic observations
- Reproducible findings on the best file
- Detector output
- Validated tool, known version, calibrated result
- Corroborating media
- Separate devices and sources show matching details
Main limit
- Provenance credential
- Does not certify the depicted assertion as true
- Original-file access
- A source can still misdescribe or stage content
- Metadata
- Fields may be removed, rewritten, or misconfigured
- Context
- May not reveal how the file was made
- Source testimony
- Memory, incentives, and deception can affect it
- Forensic observations
- Compression and normal processing can mimic anomalies
- Detector output
- Can fail on unfamiliar generators or media processing
- Corroborating media
- Copies can share one origin or coordinated deception
Provenance credentials
Signed provenance can bind a manifest to an asset and record creators, tools, ingredients, and edit actions. Verify the cryptographic result, signer identity, trust status, timestamps, and whether the credential belongs to the exact file. A screenshot of a credential icon is not the credential.
NIST's summary of digital signatures states the whole of what the mathematics delivers: assurance that the claimed signatory signed the information, and that the information was not modified after the signature was generated. Everything past that, including whether the signer is who the newsroom believes and whether the scene is what it appears to be, remains a separate judgment.
Absence is weak negative evidence. Platforms, file exports, and screenshots can strip credentials. Presence is not a truth stamp. A signed image of a staged scene can retain a valid, untampered history.
Original-file access and custody
An original or near-original file provides more resolution, metadata, codec information, and signal detail than a repost. Document who supplied it, when, by what route, and whether it matches the public copy. Hash both files and preserve them.
"Original" can mean several things: camera-native file, first export, first received copy, or earliest located upload. Use the precise description. A file named IMG_0001 is not necessarily camera-native.
Metadata
Metadata can reveal device model, creation time, geographic coordinates, software, export history, dimensions, and codecs. Compare related fields with each other and with external records. A creation date after an upload date deserves investigation, but it may reflect an export or time setting rather than fabrication.
Treat metadata as claims made by a file. Retain the raw extraction and tool version so another reviewer can reproduce it.
Context and chronology
Context testing asks whether the person, place, time, weather, language, objects, and event align. This evidence can be decisive against a false caption. It also guards against the liar's dividend, where authentic media is dismissed as synthetic without proof.
Create an event timeline with independently sourced timestamps. Compare parallel footage from separate positions. Check whether alleged witnesses had access and whether landmarks or acoustics fit the location.
Source testimony
Source access is strongest when the person can explain acquisition, provide the best file, identify others present, and supply details later confirmed elsewhere. Verify identity through independent contact information. Ask open questions first, then test inconsistencies.
Source testimony should not be converted into technical proof. "I recorded it" is an attribution that needs supporting records.
Forensic observations
Media forensics can locate splices, resampling, inconsistent noise, impossible geometry, temporal discontinuities, or traces associated with certain generation methods. Findings are stronger when a qualified reviewer can explain the method, reproduce the result, and rule out ordinary editing and compression.
Visible oddities are vulnerable to expectation bias. Low-quality encodes can distort faces and sound. Check native resolution, adjacent frames, and an authentic control from the same distribution path.
Detector scores
A detector applies a learned or engineered method within a tested scope. The result can be useful triage, but the scope may not include the generator, editing chain, resolution, language, or codec in your case.
MIT researchers who compared human and machine deepfake judgments found that people and a leading model made different errors, and wrong model predictions could reduce human accuracy. That is a reason to preserve independent judgment and disclose the tool's role.
Corroborating media
Independent photos, videos, audio, live streams, sensor records, and contemporaneous documents can confirm event details. Establish independence. Ten reposts of one clip are one source. Two recordings coordinated by the same producer may also share a failure.
Map each item to the claim element it supports. A second angle can confirm presence and movement while saying nothing about the exact words on the disputed audio track.
Weight evidence by function
Use an evidence matrix:
Evidence matrix by claim element
Claim element
- Person present
- Two independent angles
- Words spoken
- One disputed audio track
- Location
- Landmarks and schedule
- File unaltered
- No native original
Supporting evidence
- Person present
- None located
- Words spoken
- Person denies speaking
- Location
- None located
- File unaltered
- Export metadata only
Conflicting evidence
- Person present
- High
- Words spoken
- Low
- Location
- High
- File unaltered
- Unresolved
Confidence
- Person present
- Words spoken
- Location
- File unaltered
| Claim element | Supporting evidence | Conflicting evidence | Confidence |
|---|---|---|---|
| Person present | Two independent angles | None located | High |
| Words spoken | One disputed audio track | Person denies speaking | Low |
| Location | Landmarks and schedule | None located | High |
| File unaltered | No native original | Export metadata only | Unresolved |
Do not total the confidence column. Explain why evidence is independent and why it addresses that field.
Common questions
Which evidence type is strongest?
There is no universal winner. The strongest evidence is the most direct, independently corroborated material for the exact claim being tested.
Are Content Credentials the same as a fact-check?
No. They can help verify provenance data and file integrity, while a fact-check evaluates what the content claims.
Can eyewitnesses identify synthetic media?
They can confirm or dispute real-world events, but technical production questions may require file analysis.
Do several detector scores equal confirmation?
Not if the tools share training data, methods, or blind spots. Record each method and seek independent evidence.







