Skip to content
T+TAFE-IDFORENSICS LABRunbook ↗

INDEPENDENT RESEARCH / DOCUMENT INTEGRITY

Small edits.
Big signals.

A closer look at document tampering. TAFE-ID explores how visual and frequency evidence can reveal manipulated text, one region at a time.

REFERENCE MODEL / SOURCE PAPERToward real text manipulation detection: New dataset and new solution ↗Dongliang Luo et al. · Pattern Recognition, 2024 · RTM / ASCFormer

REFERENCE INFERENCE VERIFIED / RESEARCH PROTOTYPE

TAFE / VISUAL INSPECTORILLUSTRATION · 01
DOCUMENT / 001LOCALIZATION / PIXEL SPACEREGION → MASKLOOK CLOSER.Evidence at the pixel.
REFERENCE PIPELINE VERIFIEDRGB → MASK
REFERENCE CHECKPOINT
32 documents.RTM verification subset
84.4%Precision
49.3%Recall
0.623Pixel F1
0.452IoU

Recorded ASCFormer results on a 32-document verification subset. These numbers are not a full benchmark or a claim about the custom TAFE model.

01 / THE WORKBENCH

Inspect the region.
Understand the output.

A segmentation mask shows where the model suspects an edit. The workbench shows a saved ASCFormer self-test output. You can also preview your own document locally; new predictions require the linked Colab runtime.

DOCUMENT VIEWER / EDIT_0192 / RECORDED OUTPUTSAVED ASCFORMER SELF-TEST
Saved ASCFormer output on RTM edit_0192: a red predicted region near the top of the documentRecorded self-test screenshot · edit_0192

REAL MODEL OUTPUT / SAVED RUN

A prediction you can inspect.

This is the saved output from our successful ASCFormer self-test on RTM edit_0192. The red region was produced by the reference model. Viewing it does not rerun inference, and it is not a ground-truth annotation.

Recorded run: 1122 × 794 pixels · predicted region 0.279% of pixels · maximum model probability 0.969. These are output diagnostics, not accuracy scores.

View image source and license ↗Run the verified GPU demo in Colab ↗

New predictions require a running Colab session. This website currently shows a recorded result and local previews; it does not host the model.

02 / TWO RESEARCH TRACKS

Follow the evidence
through the system.

VERIFIED REFERENCE

ASCFormer inference

The RTM authors’ released model is the working reference. Strict checkpoint loading, CUDA operators and document inference passed in the isolated environment.

  1. RTM document image
  2. Authors’ preprocessing and model
  3. Aligned manipulation mask
  4. Overlay and pixel-level evaluation
CUSTOM EXPERIMENT

TAFE frequency branch

Our experimental pipeline reads real JPEG coefficients and quantization tables alongside RGB crops. Learning fixed crops did not establish useful held-out performance.

  1. RGB + JPEG DCT + quantization table
  2. Frequency-aware crop alignment
  3. TAFE-Net forward / backward audit
  4. Bounded training and held-out checks

RTM = REAL TEXT MANIPULATION, THE DOCUMENT DATASET USED IN THIS PROJECT.

03 / PERFORMANCE PROFILE

Not every edit
leaves the same trace.

Reference-model F1 by manipulation type, from the same 32-document subset. Small category counts limit what we can conclude.

Splice
0.883
Cover
0.860
Copy-move
0.821
Edit
0.793
Insert
0.234
Inpaint
0.154

Inpaint and insert are weak points. Clean-document false positives need separate reporting; positive-class F1 alone does not measure them.

04 / LAB NOTES

What worked.
What we learned.

01 — DATA

Check the inputs first.

9,000 RTM images and masks were restored. Crop alignment and actual JPEG coefficients were inspected before frequency experiments.

02 — TRAINING

Memorization is not validation.

A balanced GroupNorm baseline passed its four-crop gate. Custom models remained weak on held-out documents. BatchNorm statistics and loss balance were investigated.

03 — DELIVERY

Ship the verified reference.

The authors’ checkpoint produced usable localization and a working Colab demo. Its results remain distinct from our custom training experiments.

05 / REPRODUCIBILITY

Keep the run
inspectable.

The verified package is saved in the project owner’s Drive as TAFE-ID-Final.zip. The GPU demo runs separately from this website; arbitrary image uploads are not connected here.

Download recorded verification JSON ↗
Python
3.8.20
PyTorch / CUDA
2.0.0 / 11.8
MMCV / MMEngine
2.0.0 / 0.7.0
Checkpoint loading
Strict · passed
Archive SHA-256
d69041ebc4a6b872b7d0f2a8c6a1da10278e394b7b0853d9e4fb74530fe39a49