OSINT Toolkit and Artifact Matrix

OSINT Toolkit and Artifact Matrix

Do not collect tools for their own sake. Start with the question, identify the artifact, select the least invasive tool, and record the exact method.

Core workstation

Tool Use Typical result
Browser developer tools Rendered page, delivered HTML, requests, headers Page/source differences and asset locators
curl Reproducible retrieval of an authorized URL Response headers/body; use only within scope
file Content-based file identification Actual type despite a misleading extension
shasum -a 256 / sha256sum Integrity comparison SHA-256 fingerprint
ExifTool EXIF, IPTC, XMP, ICC, PDF and document metadata Tagged metadata with groups and duplicate fields
strings Printable byte sequences Candidate embedded text
xxd Hex view and signatures Header bytes and structural clues
Poppler (pdfinfo, pdftotext, pdfimages) PDF properties, text, and image inventory Document metadata and extracted content
unzip / zipinfo Archive and OOXML inspection Container inventory without enabling macros
jq JSON filtering and formatting Reproducible field extraction
base64 Base64 conversion Decoded bytes/text
CyberChef Visual transformation recipes Shareable decode/parse recipe
dig / whois Authorized infrastructure attribution DNS answers and registration data
openssl s_client / openssl x509 Certificate inspection Subject, issuer, SANs, and validity
mediainfo / ffprobe Audio/video technical metadata Codec, duration, streams, tags
tesseract OCR on supplied images Candidate text requiring visual verification
sqlite3 Query a supplied SQLite database copy Tables, schema, selected records
ripgrep (rg) Fast search across extracted text Matching files and lines

Tool availability differs by OS. The system owner approves installations; classroom students should use a prepared image rather than downloading binaries during the exercise.

Any file: first five actions

shasum -a 256 -- "artifact"
file -- "artifact"
stat -- "artifact"
xxd -l 64 -- "artifact"
strings -a -- "artifact" | head

Linux commonly uses sha256sum. stat flags differ between GNU and BSD systems. Work on a copy and record the operating system and tool versions when repeatability matters.

JPEG and PNG

exiftool -G1 -a -s -- "image.jpg"
exiftool -time:all -gps:all -IPTC:all -XMP:all -G1 -a -s -- "image.jpg"
exiftool -Make -Model -LensModel -Software -ImageWidth -ImageHeight -- "image.jpg"
Need Look for Limitation
Device/lens Make, Model, LensModel, serial tags Editable; may identify a workflow, not a person
Capture time DateTimeOriginal, CreateDate, OffsetTime* Clock may be wrong; timezone may be absent
Location GPS latitude/longitude/altitude/direction Can be stale, copied, rounded, or fabricated
Attribution IPTC/XMP creator, credit, rights User-editable claims
Editing trail Software, History, DerivedFrom Absence does not prove “unedited”
Technical context Dimensions, orientation, ICC profile Usually context, not authorship
Embedded preview ThumbnailImage/PreviewImage Preview may differ from displayed pixels
Extra data Verbose structure, xxd, strings Extra bytes are not automatically meaningful

PDF

pdfinfo -- "document.pdf"
pdftotext -layout -- "document.pdf" "document.txt"
pdfimages -list -- "document.pdf"
exiftool -G1 -a -s -- "document.pdf"

pdfinfo reports properties; pdftotext extracts a text layer; pdfimages inventories raster images. A scanned PDF may need approved OCR. Verify OCR against the page image.

DOCX, XLSX, and PPTX

These are normally ZIP-based OOXML containers.

file -- "brief.docx"
unzip -l -- "brief.docx"
exiftool -G1 -a -s -- "brief.docx"

Inspect docProps/core.xml, docProps/app.xml, _rels/, the main word/, xl/, or ppt/ tree, and media folders. Never enable macros. Treat author and application properties as leads.

Audio and video

mediainfo -- "clip.mp4"
ffprobe -hide_banner -- "clip.mp4"
exiftool -G1 -a -s -- "clip.mp4"

Look for duration, codecs, stream layout, creation tags, GPS, device/software, and embedded covers. Container timestamps may reflect export or transcode time rather than recording time.

Archives

file -- "bundle.zip"
zipinfo -- "bundle.zip"
unzip -l -- "bundle.zip"

List before extraction. Extract only into a dedicated working directory, reject path traversal, preserve the archive hash, and hash important extracted members.

Encodings and structured data

printf '%s' 'VEVTVA==' | base64 --decode
printf '%s' '54455354' | xxd -r -p
jq . -- "data.json"

Base64, hex, URL encoding, and timestamps are representations, not proof of authenticity or authorization. Preserve the original, record the exact recipe, and hash generated output.

Web and infrastructure context

Need Tool Boundary
Visible statement Browser Record full URL, access time, exact excerpt
Delivered source View Source/devtools Separate source observation from rendered content
Response/header Devtools or curl -I Only authorized URLs; no fuzzing
DNS dig Query named domains; record resolver and time
Registration RDAP/WHOIS Privacy redaction and stale records are common
TLS certificate openssl or browser viewer Certificate proves a binding issued under a policy, not organizational intent
Archived page Approved archive Record capture date and archive URL; archived content can be incomplete

Specialized tools: use only when justified

Tool Use Guardrail
binwalk Identify embedded signatures in supplied firmware/media A signature hit requires validation; extraction can create unsafe files
oletools Analyze legacy Office/OLE and macro indicators Do not execute macros
qpdf Inspect/normalize PDFs Operate on a working copy; transformations change hashes
mat2 Show/remove metadata for privacy preparation Use for sanitized release copies, never the preserved original
steghide / zsteg Instructor-designed steganography exercises Do not brute-force or apply to third-party content without authorization
yt-dlp Preserve authorized public media Respect scope, terms, copyright, and data-handling rules

Evidence rule

For every command record: evidence ID, original hash, working-copy path, command/tool version, time, output path/hash, direct observation, interpretation, and limitation.