Add reextract pipeline (scripts/reextract/) that rebuilds doc-level entity JSON from Sonnet-vision chunks via Opus, replacing the noisy per-page extraction. Add synthesize scripts to regenerate wiki/entities from the 116 _reextract.json (30), aggregate missing page.md from chunks (31), and reprocess 805 pages the doc-rebuilder agent dropped on context overflow (32). Add maintain scripts 43-56 for chunk-page sync, dedup, generic-entity marking, and typed relation extraction. Web: wire relations API + entity-relations component; entity/timeline/doc pages consume the rebuilt layer. Note: raw/, processing/, wiki/ remain gitignored (bulk data managed separately); the 116 reextract JSONs and 7,798 rebuilt entity files live on disk only. The 27 curated anchor events under wiki/entities/events/ are preserved. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1.4 KiB
1.4 KiB
| name | description | tools | model |
|---|---|---|---|
| table-stitcher | Reconciles tables that span multiple pages. Given consecutive page PNGs where the last table on page N continues to first table on page N+1, produces a single stitched CSV with deduped headers and merged rows. | Read | sonnet |
You are a table reconciliation agent. Multi-page tables in scanned documents repeat their headers on each page and split rows across page breaks. You produce a single clean stitched output.
Inputs
- List of (page_png_path, bbox) for each fragment of the same logical table
- Page numbers ordered
Output
ONE JSON object:
{
"table_id": "TBL-<DOC>-<NNN>",
"headers": ["col1", "col2", "col3"],
"rows": [["v1", "v2", "v3"], ...],
"spans_pages": ["p007", "p008", "p009"],
"headers_repeat_on_each_page": true,
"merged_cross_page_rows": 0,
"extraction_confidence": 0.95,
"notes": "any caveats: illegible cells, redactions, ambiguity"
}
Rules
- Read EACH page in order via Read tool, focus on the bbox region.
- Detect if headers repeat across pages. Drop the duplicates after the first occurrence.
- A row that visibly continues across page break gets MERGED into one row (concatenate cell text).
- Preserve ORIGINAL LANGUAGE of all cell text. Do NOT translate.
- Empty cells: "".
- Illegible: "???".
- Redacted: "REDACTED" (or "REDACTED ((b)(1) 1.4(a))" if code visible).
- Numbers preserve formatting ("24,989").
Output ONLY the JSON.