Document Intelligence · Coauthoring2026

PolicyLens Document Intelligence Platform

An evidence-centric document intelligence platform for policy review, structured extraction, validation, and accelerated coauthoring.

PythonPyMuPDFpdfplumberHybrid RetrievalGroq LlamaPydantic
Project summary

Impact

3 days → 2 hours

policy review and coauthoring turnaround

Hiring signal

What this proves

Document intelligence architecture, constrained LLM extraction, evidence traceability, deterministic validation, business-rule execution, and workflow acceleration.

My role

Ownership

Lead developer · PDF normalization, evidence construction, hybrid retrieval, schema-constrained extraction, deterministic validation, backend integration, and audit artifacts

Status

Portfolio implementation · interactive demo

An interactive trace is available.

The problem

What needed to change

Policy review and coauthoring require reliable extraction from long, structurally inconsistent documents containing mixed sections, tables, references, footers, and business-rule exceptions. A generic PDF chat interface is insufficient because reviewers need structured fields, source-linked evidence, validation, and reproducible outputs.

My approach

How I built it

PolicyLens uses a staged processing architecture that normalizes PDFs through multiple parsers, anchors sections and tables, constructs evidence bundles, retrieves relevant context, performs schema-constrained LLM extraction, and applies deterministic Python rules for counts, scoring, invariants, and export-ready outputs.

Architecture judgment

Why this design

The language model is restricted to retrieved evidence, while deterministic Python logic owns calculations, classifications, and invariant checks. This separation improves reviewability, repeatability, and operational suitability compared with an unconstrained PDF chatbot.

Architecture

High-level system design

The complete execution path, service boundaries, data stores, security controls, validation stages, and operational telemetry.

Implementation

Key components

  • Structured extraction for policy review and coauthoring
  • Layered PDF parsing for text, layout, and tables
  • Strict evidence bundles that keep every field traceable
  • Hybrid retrieval for quickly isolating the right sections
  • LLM extraction, validation, and critique with structured output
  • Deterministic Python rules for invariants and formatting
  • Per-document cache and audit traces for reproducibility

Technology

Tech stack

PDF & Parsing

pymupdf4llmPyMuPDFpdfplumberTable Extraction

Agentic AI

GroqLlamaJSON ModeValidation Agent

Retrieval

BM25Sentence TransformersChromaDBHybrid Search

Engineering

PythonPydanticPandasTenacityCaching

Interactive trace

See the workflow run

policylens · policy coauthoring & extraction trace

Run the trace to see the main workflow stages.