674 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Eric Gullickson	66314a0493	fix: OCR API error	2026-02-06 13:01:32 -06:00
egullickson	88db803b6a	Merge pull request 'feat: Add Grafana dashboards and alerting (#105)' (#112) from issue-105-add-grafana-dashboards into main ... Reviewed-on: #112	2026-02-06 17:44:04 +00:00
Eric Gullickson	462d306783	fix: resolve staging deployment issues with Traefik, Loki, and Alloy (refs #105) ... - Exclude blue-green.yml from staging Traefik by mounting dynamic-staging/ directory (only grafana.yml + middleware.yml) instead of dynamic/ which contains production-only blue-green routing config - Disable Loki healthcheck: distroless image has no /bin/sh so CMD-SHELL healthchecks cannot execute; Alloy and Grafana verify Loki connectivity - Fix Alloy healthcheck: replace wget (not in image) with bash /dev/tcp - Add Grafana staging domain override (logs.staging.motovaultpro.com) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 10:51:00 -06:00
Eric Gullickson	842b0eb945	docs: update config/CLAUDE.md with Grafana subdirectories (refs #111) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 10:32:58 -06:00
Eric Gullickson	4b2b318aff	feat: add Grafana alerting rules and documentation (refs #111) ... Configure Grafana Unified Alerting with file-based provisioned alert rules, contact points, and notification policies. Add stable UID to Loki datasource for alert rule references. Update LOGGING.md with dashboard descriptions, alerting rules table, and LogQL query reference. Alert rules: Error Rate Spike (critical), Container Silence for backend/postgres/redis (warning), 5xx Response Spike (critical). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 10:19:00 -06:00
Eric Gullickson	c891250946	feat: add Infrastructure Grafana dashboard (refs #110) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 10:11:38 -06:00
Eric Gullickson	0345e3976f	feat: add Error Investigation Grafana dashboard (refs #109) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 09:54:52 -06:00
Eric Gullickson	9e6f130fa6	feat: add API Performance Grafana dashboard (refs #108) ... Log-based dashboard with 6 panels: request rate, response time distribution (p50/p95/p99), HTTP status code distribution, request volume by endpoint, slowest endpoints, and status code breakdown. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 09:48:11 -06:00
Eric Gullickson	33e561e537	feat: add Application Overview Grafana dashboard (refs #107) ... Adds file-provisioned dashboard with 5 panels: - Container Log Volume Over Time (all 9 containers) - Error Rate Across All Containers (percentage stat) - Log Level Distribution Per Container (stacked bar chart) - Container Health Status (green/red per container) - Total Request Count Over Time (backend requests/min) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 08:24:08 -06:00
Eric Gullickson	6f1195d907	feat: add Grafana dashboard provisioning infrastructure (refs #106) ... Add file-based dashboard provisioning config and mount dashboards directory into Grafana container for auto-loading dashboard JSON files. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-06 08:19:28 -06:00
Eric Gullickson	cc32831d99	chore: Update SDLC instructions and contract	2026-02-06 08:15:42 -06:00
Eric Gullickson	10d604463f	Merge branch 'main' of 172.30.1.72:egullickson/motovaultpro	2026-02-05 21:49:45 -06:00
Eric Gullickson	87ee498af7	chore: update docs	2026-02-05 21:49:35 -06:00
egullickson	1580fadcf3	Merge pull request 'fix: rename ipWhiteList to ipAllowList for Traefik v3 (#103)' (#104) from issue-103-fix-grafana-ipwhitelist into main ... Reviewed-on: #104	2026-02-06 03:21:47 +00:00
Eric Gullickson	38cc8ba5c2	fix: remove broken request-id middleware with invalid Go template (refs #103) ... The request-id middleware used {{ .Request.Host }} which is not available at config load time in the file provider. This template error blocked the entire file provider from loading, preventing all file-based middlewares (including grafana-ipwhitelist) from being registered. The middleware was unused (not referenced by any router or chain) and the backend already generates X-Request-Id via randomUUID(). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 20:54:49 -06:00
Eric Gullickson	9ed4afb9a8	fix: rename ipWhiteList to ipAllowList for Traefik v3 compatibility (refs #103) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 20:40:28 -06:00
egullickson	b812282d69	Merge pull request 'chore: upgrade logging stack - mirrors, Alloy, Loki, Grafana (#96, #97, #98, #99)' (#102) from issue-96-update-mirror-base-images into main ... Reviewed-on: #102	2026-02-06 02:16:50 +00:00
Eric Gullickson	8331bde4b0	docs: update 5-container refs to 9-container architecture (refs #101) ... Update all documentation to reflect the current 9-container architecture (6 application + 3 logging) after the logging stack upgrades. Add missing OCR, Loki, Alloy, and Grafana services to context.json. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 20:11:31 -06:00
Eric Gullickson	5fca156ff2	chore: upgrade OCR base image from python 3.11-slim to 3.13-slim (refs #100) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 20:00:40 -06:00
Eric Gullickson	1c50c0c740	fix: update grafana images	2026-02-05 19:49:06 -06:00
Eric Gullickson	09f856958c	chore: upgrade Grafana 10.0.0 to 12.4.0 (refs #99) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 19:36:00 -06:00
Eric Gullickson	fc2dc21547	chore: upgrade Loki 2.9.0 to 3.6.1 with tsdb/v13 schema (refs #98) ... - Update Loki image from 2.9.0 to 3.6.1 in docker-compose.yml - Migrate schema from v11 to v13, store from boltdb-shipper to tsdb - Update storage_config to use tsdb_shipper with new index paths - Remove deprecated shared_store config (removed in Loki 3.0) - Disable structured metadata (not needed for current setup) - Preserve 30-day retention policy (720h) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 19:26:08 -06:00
Eric Gullickson	ccdcf9edeb	chore: add healthcheck to mvp-alloy service (refs #97) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 19:08:16 -06:00
Eric Gullickson	1b20673ff6	chore: replace Promtail with Grafana Alloy for log collection (refs #97) ... Promtail 2.9.0 embeds Docker client API v1.42 which is incompatible with Docker Engine v29 (minimum API v1.44). Grafana Alloy v1.12.2 resolves this by using a compatible Docker client. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 19:04:41 -06:00
Eric Gullickson	ce6b6cf7cf	chore: update base image versions in mirror script (refs #96) ... Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	2026-02-05 18:26:23 -06:00
Eric Gullickson	bac4d340bc	fix: Prod deployment fixes	2026-02-04 21:31:39 -06:00
Eric Gullickson	af1edd9ec6	chore: sync prod deploy timers	2026-02-04 21:11:36 -06:00
egullickson	193a13f2a9	Merge pull request 'docs: add unified logging system documentation and CI/CD integration (#87)' (#94) from issue-87-cicd-logging-docs into main ... Reviewed-on: #94	2026-02-05 02:57:04 +00:00
Eric Gullickson	72275096f8	docs: add unified logging system documentation and CI/CD integration (refs #87) ... - Update staging workflow to use LOG_LEVEL=DEBUG - Create docs/LOGGING.md with unified logging documentation - Delete docs/UX-DEBUGGING.md (replaced by LOGGING.md) - Update architecture to 9-container (6 app + 3 logging) - Update CLAUDE.md, README.md, docs/README.md, docs/CLAUDE.md - Update docs/PLATFORM-SERVICES.md deployment section Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-04 20:50:20 -06:00
egullickson	9c90a1ca84	Merge pull request 'feat: add Promtail, Loki, and Grafana log aggregation stack (#86)' (#93) from issue-86-promtail-loki-grafana into main ... Reviewed-on: #93	2026-02-05 02:47:21 +00:00
Eric Gullickson	9aa1ad954f	fix: use correct grafana/ namespace in mirrored image paths (refs #86) ... Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-04 20:40:23 -06:00
Eric Gullickson	e83385d729	chore: use mirrored registry for logging stack images (refs #86) ... - Update Loki, Promtail, Grafana to use REGISTRY_MIRRORS - Add grafana/loki, grafana/promtail, grafana/grafana to mirror script Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-04 20:19:22 -06:00
Eric Gullickson	1cf54fb254	feat: add Promtail, Loki, and Grafana log aggregation stack (refs #86) ... - Add Promtail for Docker log scraping with container discovery - Add Loki for log storage with 30-day retention - Add Grafana with Loki datasource auto-provisioned - Add IP whitelist middleware restricting Grafana to RFC1918 ranges - Container count: 6 → 9 Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-04 20:16:53 -06:00
egullickson	915f15c610	Merge pull request 'feat: Frontend Logger Module (#84)' (#92) from issue-84-frontend-logger-module into main ... Reviewed-on: #92	2026-02-05 02:13:11 +00:00
Eric Gullickson	241478ed80	feat: add frontend logger module with level filtering and sanitization (refs #84) ... - Create centralized logger utility at frontend/src/utils/logger.ts - Support debug/info/warn/error levels controlled by VITE_LOG_LEVEL - Sanitize sensitive data (tokens, passwords, secrets) in log output - Graceful fallback to 'info' level for invalid VITE_LOG_LEVEL values - Add VITE_LOG_LEVEL to ImportMetaEnv type definitions Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-04 20:05:39 -06:00
Eric Gullickson	cd843e8bdd	chore: update container images	2026-02-04 19:54:35 -06:00
Eric Gullickson	df24e89311	chore: update deploy timings	2026-02-04 19:40:47 -06:00
Eric Gullickson	1226dd986d	fix: adjust backend start_period to 90s ... Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 21:20:27 -06:00
Eric Gullickson	83224cf207	fix: increase backend start_period to 120s for migrations ... The 60s start_period was too short - migrations can take 70+ seconds. Docker was marking the container unhealthy before migrations completed. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 21:19:48 -06:00
Eric Gullickson	26196d34ea	chore: unify health check timers across compose and workflows ... Docker Compose health checks (all services): - interval: 5s (was 10-30s) - timeout: 5s (unified) - backend start_period: 60s (was 30-180s) Gitea workflow health check loops: - Docker healthcheck: 48 attempts x 5s = 4 min (was 24 x 10s) - Backend health: 12 attempts x 5s = 60s (was 6 x 10s) - External health: 12 attempts x 5s = 60s (was 6 x 10s) - Initial waits: 5s (was 10-15s) Same total wait times, faster detection of success/failure. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 21:10:47 -06:00
Eric Gullickson	88db25019f	chore: update prod check loops	2026-02-03 20:56:27 -06:00
Eric Gullickson	40f2cace29	chore: update prod healthchecks	2026-02-03 20:55:33 -06:00
Eric Gullickson	efbbe34080	fix: add backend health check step to production workflow ... Add "Wait for backend health" step using docker exec to verify backend is responding before attempting external health check. Matches staging workflow pattern. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 20:42:59 -06:00
egullickson	58eec46f72	Merge pull request 'feat: migrate backend logging from Winston to Pino with correlation IDs (#82)' (#91) from issue-82-pino-migration into main ... Reviewed-on: #91	2026-02-04 02:24:31 +00:00
Eric Gullickson	6c4d8e47f9	chore: align production verify loop with staging (refs #82) ... Add Docker healthcheck loop to production verify-prod job matching staging's 24 attempts x 10 seconds = 4 minutes max wait for backend migrations. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 20:11:40 -06:00
Eric Gullickson	2a34f8225e	feat: migrate backend logging from Winston to Pino with correlation IDs (refs #82) ... - Replace Winston with Pino using API-compatible wrapper - Add LOG_LEVEL env var support with validation and fallback - Add correlation ID middleware (X-Request-Id from Traefik or UUID) - Configure PostgreSQL logging env vars (POSTGRES_LOG_STATEMENT, POSTGRES_LOG_MIN_DURATION) - Configure Redis loglevel via command args Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 20:04:30 -06:00
egullickson	3899cb3935	Merge pull request 'chore: Docker Logging Configuration + Rotation (#85)' (#90) from issue-85-docker-logging-config into main ... Reviewed-on: #90	2026-02-04 02:00:22 +00:00
Eric Gullickson	ceaabee7a0	chore: add Docker log rotation to all services (refs #85) ... Add logging configuration with json-file driver and rotation to all 6 services: - mvp-traefik - mvp-frontend - mvp-backend - mvp-ocr - mvp-postgres - mvp-redis Configuration: - max-size: 10m (10MB per log file) - max-file: 3 (keep 3 rotated files) - Total max storage: 6 x 30MB = 180MB Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 19:49:28 -06:00
egullickson	5593459090	Merge pull request 'chore: configure Traefik X-Request-Id header forwarding (#83)' (#89) from issue-83-traefik-request-id into main ... Reviewed-on: #89	2026-02-04 01:47:45 +00:00
Eric Gullickson	2ecefc1e10	chore: configure Traefik X-Request-Id header forwarding (refs #83) ... - Add X-Request-Id to access log fields for request correlation - Add request-id middleware documenting backend UUID generation - Add X-Request-Id to CORS allowed headers Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-02-03 19:41:19 -06:00