OSINT Toolkit and Artifact Matrix
OSINT Toolkit and Artifact Matrix
Do not collect tools for their own sake. Start with the question, identify the artifact, select the least invasive tool, and record the exact method.
Core workstation
| Tool | Use | Typical result |
|---|---|---|
| Browser developer tools | Rendered page, delivered HTML, requests, headers | Page/source differences and asset locators |
curl | Reproducible retrieval of an authorized URL | Response headers/body; use only within scope |
file | Content-based file identification | Actual type despite a misleading extension |
shasum -a 256 / sha256sum | Integrity comparison | SHA-256 fingerprint |
| ExifTool | EXIF, IPTC, XMP, ICC, PDF and document metadata | Tagged metadata with groups and duplicate fields |
strings | Printable byte sequences | Candidate embedded text |
xxd | Hex view and signatures | Header bytes and structural clues |
Poppler (pdfinfo, pdftotext, pdfimages) | PDF properties, text, and image inventory | Document metadata and extracted content |
unzip / zipinfo | Archive and OOXML inspection | Container inventory without enabling macros |
jq | JSON filtering and formatting | Reproducible field extraction |
base64 | Base64 conversion | Decoded bytes/text |
| CyberChef | Visual transformation recipes | Shareable decode/parse recipe |
dig / whois | Authorized infrastructure attribution | DNS answers and registration data |
openssl s_client / openssl x509 | Certificate inspection | Subject, issuer, SANs, and validity |
mediainfo / ffprobe | Audio/video technical metadata | Codec, duration, streams, tags |
tesseract | OCR on supplied images | Candidate text requiring visual verification |
sqlite3 | Query a supplied SQLite database copy | Tables, schema, selected records |
ripgrep (rg) | Fast search across extracted text | Matching files and lines |
Tool availability differs by OS. The system owner approves installations; classroom students should use a prepared image rather than downloading binaries during the exercise.
Any file: first five actions
shasum -a 256 -- "artifact"
file -- "artifact"
stat -- "artifact"
xxd -l 64 -- "artifact"
strings -a -- "artifact" | head
Linux commonly uses sha256sum. stat flags differ between GNU and BSD systems. Work on a copy and record the operating system and tool versions when repeatability matters.
JPEG and PNG
exiftool -G1 -a -s -- "image.jpg"
exiftool -time:all -gps:all -IPTC:all -XMP:all -G1 -a -s -- "image.jpg"
exiftool -Make -Model -LensModel -Software -ImageWidth -ImageHeight -- "image.jpg"
| Need | Look for | Limitation |
|---|---|---|
| Device/lens | Make, Model, LensModel, serial tags | Editable; may identify a workflow, not a person |
| Capture time | DateTimeOriginal, CreateDate, OffsetTime* | Clock may be wrong; timezone may be absent |
| Location | GPS latitude/longitude/altitude/direction | Can be stale, copied, rounded, or fabricated |
| Attribution | IPTC/XMP creator, credit, rights | User-editable claims |
| Editing trail | Software, History, DerivedFrom | Absence does not prove “unedited” |
| Technical context | Dimensions, orientation, ICC profile | Usually context, not authorship |
| Embedded preview | ThumbnailImage/PreviewImage | Preview may differ from displayed pixels |
| Extra data | Verbose structure, xxd, strings | Extra bytes are not automatically meaningful |
pdfinfo -- "document.pdf"
pdftotext -layout -- "document.pdf" "document.txt"
pdfimages -list -- "document.pdf"
exiftool -G1 -a -s -- "document.pdf"
pdfinfo reports properties; pdftotext extracts a text layer; pdfimages inventories raster images. A scanned PDF may need approved OCR. Verify OCR against the page image.
DOCX, XLSX, and PPTX
These are normally ZIP-based OOXML containers.
file -- "brief.docx"
unzip -l -- "brief.docx"
exiftool -G1 -a -s -- "brief.docx"
Inspect docProps/core.xml, docProps/app.xml, _rels/, the main word/, xl/, or ppt/ tree, and media folders. Never enable macros. Treat author and application properties as leads.
Audio and video
mediainfo -- "clip.mp4"
ffprobe -hide_banner -- "clip.mp4"
exiftool -G1 -a -s -- "clip.mp4"
Look for duration, codecs, stream layout, creation tags, GPS, device/software, and embedded covers. Container timestamps may reflect export or transcode time rather than recording time.
Archives
file -- "bundle.zip"
zipinfo -- "bundle.zip"
unzip -l -- "bundle.zip"
List before extraction. Extract only into a dedicated working directory, reject path traversal, preserve the archive hash, and hash important extracted members.
Encodings and structured data
printf '%s' 'VEVTVA==' | base64 --decode
printf '%s' '54455354' | xxd -r -p
jq . -- "data.json"
Base64, hex, URL encoding, and timestamps are representations, not proof of authenticity or authorization. Preserve the original, record the exact recipe, and hash generated output.
Web and infrastructure context
| Need | Tool | Boundary |
|---|---|---|
| Visible statement | Browser | Record full URL, access time, exact excerpt |
| Delivered source | View Source/devtools | Separate source observation from rendered content |
| Response/header | Devtools or curl -I | Only authorized URLs; no fuzzing |
| DNS | dig | Query named domains; record resolver and time |
| Registration | RDAP/WHOIS | Privacy redaction and stale records are common |
| TLS certificate | openssl or browser viewer | Certificate proves a binding issued under a policy, not organizational intent |
| Archived page | Approved archive | Record capture date and archive URL; archived content can be incomplete |
Specialized tools: use only when justified
| Tool | Use | Guardrail |
|---|---|---|
binwalk | Identify embedded signatures in supplied firmware/media | A signature hit requires validation; extraction can create unsafe files |
oletools | Analyze legacy Office/OLE and macro indicators | Do not execute macros |
qpdf | Inspect/normalize PDFs | Operate on a working copy; transformations change hashes |
mat2 | Show/remove metadata for privacy preparation | Use for sanitized release copies, never the preserved original |
steghide / zsteg | Instructor-designed steganography exercises | Do not brute-force or apply to third-party content without authorization |
yt-dlp | Preserve authorized public media | Respect scope, terms, copyright, and data-handling rules |
Evidence rule
For every command record: evidence ID, original hash, working-copy path, command/tool version, time, output path/hash, direct observation, interpretation, and limitation.