discadmin/disclosure-bureau
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
disclosure-bureau/scripts/maintain
History
Luiz Gustavo 55cac8a395
Some checks failed
CI / Web — typecheck + lint + build (push) Failing after 1m30s
Details
CI / Scripts — Python smoke (push) Failing after 32s
Details
CI / Web — npm audit (push) Failing after 37s
Details
W0+W1+W1.2: security hardening, observability, autocomplete, glitchtip, forgejo CI 
W0 — security hardening (5 fixes verified live on disclosure.top)
- middleware: gate /api/admin/* same as /admin/* (F1)
- imgproxy: tighten LOCAL_FILESYSTEM_ROOT from / to /var/lib/storage (F2)
- studio: real basic-auth label (bcrypt hash, middleware reference) (F3)
- relations: ENABLE ROW LEVEL SECURITY + public SELECT policy (F4)
- migration 0003: fold is_searchable + hybrid_search update into canonical (TD#2)

W1 — observability + resilience + autocomplete
- studio: HOSTNAME=0.0.0.0 so Next.js binds on loopback for healthcheck
- compose: PG_POOL_MAX=20, CLAUDE_CODE_OAUTH_TOKEN gated by separate env
- claude-code.ts: subprocess timeout configurable (CLAUDE_CODE_TIMEOUT_MS)
- openrouter.ts: retry with exponential backoff + Retry-After + in-memory
  circuit breaker (promotes FALLBACK after CB_THRESHOLD failures)
- lib/logger.ts: pino logger (NDJSON prod / pretty dev) + withRequest helper
- middleware: mints correlation_id, stamps x-correlation-id response header,
  emits structured http_request log per /api/* call
- messages/route.ts: switch to structured logger
- 60_meili_index.py: push documents + chunks into Meilisearch
- /api/search/autocomplete: parallel meili search (docs + chunks), 5-8ms p50
- search-autocomplete.tsx: debounced dropdown wired into search-panel

W1.2 — Glitchtip + Forgejo self-hosted
- compose: glitchtip-redis + glitchtip-web + glitchtip-worker (v4.2)
- compose: forgejo + forgejo-runner (server v9, runner v6) with group_add=988
- @sentry/nextjs SDK wired (instrumentation.ts + sentry.{client,server}.config.ts)
- /api/admin/throw smoke endpoint (gated by W0-F1 middleware)
- Synthetic event ingestion verified at glitchtip.disclosure.top
- forgejo.disclosure.top up, repo discadmin/disclosure-bureau created,
  runner registered (labels: ubuntu-latest, docker)
- .forgejo/workflows/ci.yml: typecheck + lint + build + npm audit + python
  syntax + compose validation

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-23 18:18:42 -03:00
..
41_strip_stubs.py phase-0: kill stubs, ship 20 curated anchor events, configure SMTP 2026-05-18 00:44:17 -03:00
42_sync_entity_stats.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
43_fix_chunk_page_from_source_png.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
44_sync_chunk_page_to_db.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
45_resync_index_json.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
46_text_backfill_mentions.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
47_mark_unsearchable_chunks.sql rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
48_hybrid_search_filter_unsearchable.sql rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
49_dedup_aggressive.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
50_dedup_fuzzy_trigram.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
51_remap_entity_mentions.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
52_mark_generic_entities.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
53_add_is_generic_to_db.sql rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
54_sync_is_generic.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
55_relations_schema.sql rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
56_extract_relations.py rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00
57_load_relations_from_json.py W0+W1+W1.2: security hardening, observability, autocomplete, glitchtip, forgejo CI 2026-05-23 18:18:42 -03:00
58_backfill_embeddings.py W0+W1+W1.2: security hardening, observability, autocomplete, glitchtip, forgejo CI 2026-05-23 18:18:42 -03:00
60_meili_index.py W0+W1+W1.2: security hardening, observability, autocomplete, glitchtip, forgejo CI 2026-05-23 18:18:42 -03:00
run_full_dedup_pipeline.sh rebuild entity layer from Sonnet-vision reextract pipeline 2026-05-21 12:20:24 -03:00