JoeBot/HOA_Financial_Platform
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add shadow AI benchmarking for admin model comparison #12

Merged
JoeBot merged 1 commits from feature-shadowAI into main 2026-04-05 07:54:12 -04:00
Conversation 1 Commits 1 Files Changed 16 +2461 -6
JoeBot commented 2026-04-05 07:45:39 -04:00
Owner
Copy Link

Add a new admin-only feature that allows the platform owner to benchmark
the production AI model against up to 2 alternate models (any OpenAI-compatible
API) using real tenant data, without impacting users.

Backend:

  • Shared AI caller utility (ai-caller.ts) for OpenAI-compatible endpoints
  • Shadow AI module with service, controller, and 3 entities
  • 6 admin API endpoints for model config CRUD, run trigger, and history
  • Auto-creates shadow_ai_models, shadow_runs, shadow_run_results tables
  • Exposes health-scores and investment-planning prompt builders for reuse

Frontend:

  • New admin page at /admin/shadow-ai with 3 tabs:
    • Model Configuration (production + 2 alternate slots)
    • Run Comparison (tenant select, feature select, side-by-side results)
    • History (filterable run log with detail drill-down)
  • Full side-by-side output display with diff highlighting
  • Sidebar navigation link for AI Benchmarking

Co-Authored-By: Claude Opus 4.6 noreply@anthropic.com

Add a new admin-only feature that allows the platform owner to benchmark the production AI model against up to 2 alternate models (any OpenAI-compatible API) using real tenant data, without impacting users. Backend: - Shared AI caller utility (ai-caller.ts) for OpenAI-compatible endpoints - Shadow AI module with service, controller, and 3 entities - 6 admin API endpoints for model config CRUD, run trigger, and history - Auto-creates shadow_ai_models, shadow_runs, shadow_run_results tables - Exposes health-scores and investment-planning prompt builders for reuse Frontend: - New admin page at /admin/shadow-ai with 3 tabs: - Model Configuration (production + 2 alternate slots) - Run Comparison (tenant select, feature select, side-by-side results) - History (filterable run log with detail drill-down) - Full side-by-side output display with diff highlighting - Sidebar navigation link for AI Benchmarking Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
JoeBot added 1 commit 2026-04-05 07:45:40 -04:00
feat: add shadow AI benchmarking for admin model comparison 5ae6f672be 
Add a new admin-only feature that allows the platform owner to benchmark
the production AI model against up to 2 alternate models (any OpenAI-compatible
API) using real tenant data, without impacting users.

Backend:
- Shared AI caller utility (ai-caller.ts) for OpenAI-compatible endpoints
- Shadow AI module with service, controller, and 3 entities
- 6 admin API endpoints for model config CRUD, run trigger, and history
- Auto-creates shadow_ai_models, shadow_runs, shadow_run_results tables
- Exposes health-scores and investment-planning prompt builders for reuse

Frontend:
- New admin page at /admin/shadow-ai with 3 tabs:
  - Model Configuration (production + 2 alternate slots)
  - Run Comparison (tenant select, feature select, side-by-side results)
  - History (filterable run log with detail drill-down)
- Full side-by-side output display with diff highlighting
- Sidebar navigation link for AI Benchmarking

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
JoeBot commented 2026-04-05 07:46:12 -04:00
Author
Owner
Copy Link

.

.
JoeBot force-pushed feature-shadowAI from 5ae6f672be to 4797669591 2026-04-05 07:51:05 -04:00 Compare
JoeBot merged commit 827eef4f49 into main 2026-04-05 07:54:12 -04:00
JoeBot deleted branch feature-shadowAI 2026-04-05 07:54:12 -04:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
JoeBot
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: JoeBot/HOA_Financial_Platform#12
No description provided.
Delete Branch "feature-shadowAI"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?