Skip to content

Dashboards & Analytics ​

GhostAI provides comprehensive dashboards for monitoring PII protection, compliance, and business metrics.

Available Dashboards ​

DashboardPurposeAccess
AnalyticsPII detection patterns and trendsAll users
ExecutiveBoard-ready reports, cost avoidanceAdmin+
MetricsBusiness KPIs, MRR, conversionAdmin+
UsageQuotas, API usage trackingAll users
Detection AccuracyFalse positive rates, tuningAdmin+
Observer / GrowthPlatform adoption and growth metricsObserver role or share link
AI ProtectionAI-powered PII detection policy and metricsOrg admins
SIEM HealthSIEM delivery success rate, latency, error trends, gap detectionAdmin+
PII DashboardDetection rates, SLA tracking, and entity inventory (Overview / SLA / Inventory sub-views)Admin+ (PII Dashboard)

Analytics Dashboard ​

Overview Metrics ​

  • Total PII Protected: Lifetime count of detected items
  • Sessions: Number of conversations
  • Messages Processed: Total messages scanned
  • Protection Rate: Percentage with PII detected

Charts & Visualizations ​

PII by Entity Type ​

PERSON        ████████████████████ 35%
EMAIL         ██████████████ 24%
PHONE         ████████████ 20%
US_SSN        ███████ 12%
CREDIT_CARD   █████ 9%

Detection Trend (30 days) ​

        │
   500  │    ╭────────╮
        │   ╱          ╲        ╭──
   250  │──╯            ╲──────╯
        │
     0  └─────────────────────────────
        Day 1              Day 30

Compliance Distribution ​

┌─────────┬────────┬────────┬────────┐
│  HIPAA  │ PCI-DSS│  GDPR  │  SOX   │
│   42%   │   28%  │   20%  │   10%  │
└─────────┴────────┴────────┴────────┘

Filters ​

  • Date Range: Custom, 7d, 30d, 90d, YTD
  • Entity Type: Filter by specific types
  • User: Filter by user (admin only)
  • Session: Filter by conversation

Executive Dashboard ​

Hero Metrics ​

MetricDescription
Cost AvoidedEstimated breach cost savings
PII ProtectedTotal items protected
Compliance Score0-100 organizational score

Financial Risk Exposure ​

The Financial Risk Exposure card quantifies the dollar-value risk of detected PII in board-ready terms.

MetricDescription
Records at RiskTotal PII records detected across all sessions
Gross ExposureRecords × industry-specific per-record cost (e.g., $120 for Financial, $150 for Healthcare)
Breach-Adjusted RiskGross exposure × 10% breach probability — the risk-weighted estimate
High-Risk RecordsCount and percentage of high-sensitivity entity types (SSN, credit card, passport, bank account, secrets, medical PHI)

The per-record cost is determined by the organization's industry vertical using VERTICAL_BASE_COSTS:

VerticalCost per Record
Healthcare$150
Financial$120
Legal$130
Government$140
Technology$100
Default$100

Compliance Score ​

The compliance score is a 0-100 metric that measures how fully your organization has configured the security and compliance features available in GhostAI. It appears in the Admin Dashboard header alongside a letter grade.

Scoring Categories ​

CategoryMax PointsHow Points Are Earned
SSO Configuration25 (+5 bonus)25 points for configuring SAML SSO; +5 bonus if SSO enforcement is enabled
Data Residency1515 points for a custom region; 10 points for the default region (US East); 0 if not configured
Multiple Admins1010 points if 2+ accepted admins/owners; 5 points for a single admin
PII Protection25Always awarded — PII protection is always enabled
Audit Logging25Always awarded — audit logging is always enabled

Because PII protection and audit logging are always on and every organization has at least one admin, the baseline score for any organization is 55.

Grade Scale ​

ScoreGradeLevelDescription
90–100AExcellentMeets enterprise compliance requirements
80–89BGoodMeets most compliance requirements
70–79CFairBasic compliance achieved
60–69DNeeds ImprovementSeveral areas need attention
Below 60FNeeds AttentionAction needed to improve compliance

Improving Your Score ​

The dashboard provides actionable recommendations when your score is below 100:

  • Configure SSO — Set up SAML 2.0 with your identity provider and optionally enforce it for all users.
  • Set data residency — Choose a specific data region to satisfy regional compliance regulations.
  • Add additional admins — Invite at least one more admin or owner for operational redundancy.

Cost Avoidance Calculator ​

Based on industry benchmarks:

VerticalCost per RecordYour Savings
Healthcare$150$XXX,XXX
Financial$120$XXX,XXX
Legal$130$XXX,XXX
Technology$100$XXX,XXX

Risk Radar Chart ​

Visual representation of risk exposure by category:

  • Identity (SSN, licenses)
  • Financial (cards, accounts)
  • Contact (email, phone)
  • Healthcare (PHI)
  • Code & IP (secrets, code)
  • Location (addresses, GPS)

Board-Ready PDF Export ​

Generate 4-page executive report:

  1. Executive Summary: Key metrics, compliance status
  2. Protection Details: Entity breakdown, trends
  3. Risk Assessment: Radar chart, top risks
  4. Recommendations: Action items, improvements

Business Metrics Dashboard ​

Revenue Metrics ​

MetricDescription
MRRMonthly Recurring Revenue
ARRAnnual Recurring Revenue
ARPUAverage Revenue Per User
LTVCustomer Lifetime Value

Conversion Funnel ​

Visitors      ████████████████████ 10,000
Signups       ████████████ 2,400 (24%)
Trials        ████████ 960 (40%)
Paid          ██████ 384 (40%)
Enterprise    ██ 48 (12.5%)

Churn Analysis ​

  • Monthly churn rate
  • Churn by tier
  • Churn reasons
  • At-risk customers

Tier Distribution ​

┌──────────┬──────────┬──────────┬──────────┬──────────┐
│ Starter  │ Personal │   Team   │ Business │Enterprise│
│   1,200  │    450   │    200   │    180   │    24    │
└──────────┴──────────┴──────────┴──────────┴──────────┘

Usage Dashboard ​

Quota Tracking ​

ResourceUsedLimitRemaining
API Requests15,43225,0009,568
Storage2.4 GB10 GB7.6 GB
Team Members8102
Sessions342∞∞
API Requests (Last 7 Days)
Mon  ████████████ 2,100
Tue  ██████████████ 2,450
Wed  ████████████████ 2,800
Thu  ████████████████████ 3,200
Fri  ██████████████ 2,400
Sat  ████ 800
Sun  ██ 420

Rate Limiting Status ​

  • Current rate: 120 req/min
  • Limit: 500 req/min
  • Burst capacity: 1000 req/5min

Detection Accuracy Dashboard ​

False Positive Rates ​

Entity TypeFP RateRecommended Threshold
PERSON12%Increase to 0.7
DATE_TIME8%Keep at 0.5
US_SSN2%Keep at 0.5
EMAIL1%Keep at 0.5

Threshold Tuning ​

Interactive slider for each entity type:

PERSON      [====|======] 0.5  →  Recommendation: 0.7
DATE_TIME   [====|======] 0.5  →  Recommendation: 0.5
US_SSN      [==|========] 0.3  →  Recommendation: 0.3

Feedback Summary ​

  • Total feedback: 1,234
  • False positives reported: 156
  • False negatives reported: 23
  • Feedback applied: 89%

Observability Dashboards (Grafana) ​

GhostAI includes pre-built Grafana dashboards for infrastructure monitoring when the observability stack is enabled.

Setup ​

bash
# Start the observability stack
cd infrastructure/docker
docker-compose -f docker-compose.observability.yml up -d

# Enable telemetry in backend
OTEL_ENABLED=true

# Access Grafana
open http://localhost:3001  # admin/admin

GhostAI Overview Dashboard ​

Real-time application performance metrics:

PanelMetrics
Request RateRequests per second by endpoint
Error Rate4xx and 5xx responses
API Latencyp50, p95, p99 response times
PII DetectionDetection latency by detector
LLM PerformanceTime to first token, total latency
Active SessionsCurrent session count

Key Metrics ​

MetricDescriptionAlert Threshold
ghostai_http_requests_totalTotal HTTP requestsN/A
ghostai_http_request_duration_secondsRequest latencyp95 > 5s
ghostai_pii_detection_duration_secondsPII detection timep95 > 500ms
ghostai_llm_time_to_first_token_secondsStreaming TTFTp95 > 1s
ghostai_pii_entities_detected_totalPII found by typeN/A

Alerts ​

Pre-configured alerts in Prometheus:

  • HighErrorRate: 5xx errors exceed 5%
  • SlowAPIResponses: p95 latency > 5 seconds
  • SlowPIIDetection: p95 detection > 500ms
  • LLMAPITimeouts: Timeout rate > 0.1/sec
  • ServiceDown: Backend unreachable

Distributed Tracing (Jaeger) ​

Access Jaeger for request tracing:

http://localhost:16686

Search traces by:

  • Service name: ghostai-backend, ghostai-frontend
  • Operation: chat.stream, pii.detection, llm.request
  • Tags: user.id, session.id, model

Accessing Dashboards ​

Via UI ​

  1. Click Analytics in sidebar → Analytics Dashboard
  2. Click Executive in sidebar → Executive Dashboard
  3. Click Metrics in sidebar (admin) → Business Metrics
  4. Click Usage in sidebar → Usage Dashboard

Via API ​

bash
# Get analytics data
curl http://localhost:8000/api/analytics \
  -H "Authorization: Bearer YOUR_TOKEN"

# Get executive summary
curl http://localhost:8000/api/executive-summary?period=30d \
  -H "Authorization: Bearer YOUR_TOKEN"

# Export board report
curl http://localhost:8000/api/reports/board?format=pdf \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -o board-report.pdf

Configuration ​

Dashboard Refresh ​

json
{
  "dashboards": {
    "auto_refresh": true,
    "refresh_interval_seconds": 300,
    "cache_duration_seconds": 60
  }
}

Data Retention ​

Configure how long dashboard data is retained:

TierRetention
Starter7 days
Personal30 days
Team60 days
Business90 days
EnterpriseCustom

Exporting Data ​

Available Formats ​

  • PDF: Formatted reports
  • CSV: Raw data for analysis
  • JSON: API-friendly format
  • Excel: Spreadsheet format

Scheduled Reports ​

Scheduled report delivery is available from the admin UI and documented in Scheduled Reports. Set up automatic report delivery:

  1. Open Admin → Scheduled Reports (or use the Scheduled Reports admin feature from your deployment’s admin navigation)
  2. Select report type
  3. Choose schedule (weekly/monthly)
  4. Add recipients

Team Management Dashboard ​

The Admin Dashboard → Team provides a comprehensive suite of team management tools:

Pending Invites ​

View all pending invitations with status, expiry dates, and batch actions (resend all, cancel all).

Allowed Domains ​

Manage email domains for automatic membership. Add domains, toggle auto-join, and verify ownership via DNS TXT records.

Create shareable team join URLs with configurable role, expiry, maximum uses, and optional admin approval. Review and approve/deny pending join requests.

Welcome Message ​

Customize the welcome message that new team members see when they first join the organization. Live preview available.

Setup Checklist (Top-Level + Banner) ​

The setup checklist is now available in two complementary views:

  1. Setup — A dedicated top-level section in the Admin Dashboard (next to Users, Team, SSO, etc.) with a detailed step-by-step checklist. Each step shows its label, description, and completion status alongside a progress summary card with percentage and completed/total count. Ideal for walking through initial organization configuration.

  2. Dismissible Banner — A compact banner at the very top of the Admin Dashboard (above all sections) showing a progress bar with completion percentage and incomplete-step pills for at-a-glance visibility. The banner auto-hides when all steps are complete, or admins can dismiss it for the session.

SCIM Provisioning ​

Connect your Identity Provider (Okta, Azure AD, OneLogin) for automated user lifecycle management. Generate and manage SCIM bearer tokens.

Activity Feed ​

Real-time audit log of all team and administrative actions. Color-coded action types with human-readable labels and relative timestamps.

Team Activity Feed ​

The activity feed (Admin Dashboard → Team → Activity) shows real-time events including:

ActionDescription
user.invitedTeam member invited
user.joinedUser accepted invitation
user.offboardedUser offboarded (data transferred, keys revoked)
role.changedUser role updated
domain.addedAllowed domain added
link.createdInvite link generated
scim.provisionedUser provisioned via SCIM
policy.updatedOrganization policy changed

Platform Admin Console ​

The Platform Admin Console provides cross-tenant platform administration. Access it via the sidebar (Platform Admin icon). Requires Platform Admin or Cloud Admin role.

Organizations ​

ColumnDescription
OrganizationName and slug
ParentParent org (for sub-organizations)
OwnerOwner email
LicenseSubscription tier dropdown (Starter, Personal, Team, Business, Enterprise) — editable
UsageRequests used / limit with color-coded progress bar
RegionData residency region
SeatsMembers / seats limit
Sub-OrgsCount of sub-organizations

Click View to open the organization detail modal with:

  • Slug, data region, owner, and creation date
  • Usage & Limits section with plan tier dropdown, requests progress bar, and seats progress bar
  • Parent organization (if applicable)
  • Sub-organizations list
  • Members list with roles

License changes are made at the organization level, not per-user. Changing an org's tier updates usage limits for all members.

Users ​

ColumnDescription
UserName and email
OrgsNumber of organizations
SessionsNumber of chat sessions
LicenseRead-only tier badge (inherited from organization)
RolePlatform role dropdown (None, Platform Admin, Cloud Admin, MSP Admin, Consumer Admin, Observer)

Click View to open the user detail modal with email verification status, platform role dropdown, creation date, and organization memberships.

Admins ​

Displays all users with platform roles, grouped into sections:

  • Admin Configuration — Shows which emails are configured for initial admin setup via PLATFORM_ADMIN_EMAIL and CLOUD_ADMIN_EMAIL environment variables
  • Platform Admins — Users with full platform control (demote available)
  • Cloud Admins — Users managing tenants and billing (promote to Platform Admin, demote)
  • MSP Admins — Users managing sub-tenants (promote to Cloud Admin, demote)
  • Admin Role Reference — Quick reference of what each role can do

See Roles & Permissions for detailed role documentation.

Chat Flow Debugger (Platform Admin Console) ​

The Chat Flow Debugger is a diagnostic tool accessible from Platform Admin Console → Chat Debug. It captures and visualizes the full lifecycle of every chat request — like "Chrome DevTools Network tab" but for chat flows.

What it Captures ​

Every chat request is traced through the full pipeline:

StageEvent TypeDetails Captured
PII Detectionpii_detectEntity count, detection time, code policy
Tokenizationpii_tokenizeToken count
Tool Resolutiontools_resolvedAvailable tools, user-enabled tools, final set
LLM Requestllm_requestModel, provider, tool count, message count
First Tokenllm_first_tokenTime to first token (TTFT), tool round
Tool Executiontool_call / tool_resultTool name, arguments, execution time, result preview
Provider Fallbackfallback_no_toolsError message, tools stripped (when provider rejects tool use)
DetokenizationdetokenizeResponse length, token restoration
Completionllm_doneTotal time, response length, tool rounds
ErrorerrorError message and type

Using the Debugger ​

  1. Open Platform Admin Console (sidebar → Platform Admin)
  2. Click Chat Debug
  3. Recent traces appear on the left, color-coded:
    • Green = Success
    • Yellow = Tool fallback (tools stripped by provider)
    • Red = Error
  4. Click a trace to see the timeline waterfall on the right
  5. Click any event row to expand the full JSON detail payload

Filters ​

  • All / Errors / Tool Calls / Fallback — quick filter buttons
  • Session ID — text filter for a specific session
  • Auto-refresh — polls every 2 seconds when enabled

API Endpoints ​

bash
# List recent traces
curl http://localhost:8000/api/admin/chat-debug/traces?limit=50

# Get full trace detail
curl http://localhost:8000/api/admin/chat-debug/traces/{trace_id}

# Clear all traces
curl -X DELETE http://localhost:8000/api/admin/chat-debug/traces

Troubleshooting Common Issues ​

SymptomWhat to Look For
Chat stuck at "Thinking"Check for error events, missing llm_first_token
Web search not workingLook for fallback_no_tools — provider may not support tool calling
Slow responsesCompare llm_request → llm_first_token timing (TTFT)
PII not detectedCheck pii_detect entity count and detection time
Tool calls failingExpand tool_result events for error details

File Pipeline Debugger ​

The File Pipeline Debugger is an end-to-end diagnostic tool for platform admins that tests the complete file processing pipeline in a single run — from backend health through upload, RAG indexing, PII scan, chat stream, and memory impact.

Access ​

Platform Admin Console → Upload Test tab

7-Phase Diagnostic ​

PhaseWhat It TestsKey Output
0. Health Pre-flight/health, /health/ready, /health/pii-modelPII model status, DB connectivity, LLM availability
1. UploadCompress + upload flowUpload duration, file ID, content type
2. RAG Indexing PollPolls metadata for is_indexed and chunk_countIndexing completion time, chunk count, RAG config (embedding model, chunk sizes, hybrid flag)
3. PII Scan + PreviewPII scan + text extraction previewEntity count, extracted text length, security findings
4. Chat Stream TestPOST /api/chat/stream with attachmentSSE events, TTFT, RAG retrieval metrics (chunks retrieved, top score, search mode, fallback status)
5. Chat TraceFetches diagnostic trace for the test sessionPII/LLM/tool timing, attachment prep detail, RAG retrieval breakdown
6. Memory Delta/health/file-pipeline before vs. afterWorker RSS delta, OOM risk assessment

Error Classification ​

The debugger automatically classifies failures with color-coded badges:

BadgeMeaning
OOM (502)Worker ran out of memory and was killed
Timeout (504)Request exceeded ALB/CloudFront timeout
Unavailable (503)Backend not ready or overloaded
Rate Limit (429)LLM provider rate limit exceeded
Auth Error (401/403)Authentication or authorization failure
Scan TimeoutPII scan exceeded 30 seconds
SSE ErrorBackend sent an error event in the stream

Additional Features ​

  • Visual timing waterfall — horizontal bar chart showing each phase's duration proportionally
  • Configurable chat prompt — default "Summarize this file", editable for testing specific RAG scenarios
  • Test file cleanup — delete the test file after the run to avoid cluttering storage
  • Export — "Copy as JSON" or "Copy as text" for support tickets

Troubleshooting Guide ​

For detailed diagnosis of file pipeline failures, see the File Pipeline Troubleshooting guide.

Observer / Growth Dashboard ​

The Observer Growth Dashboard provides a read-only, presentation-grade view of platform adoption and growth metrics. It is designed for sharing with VCs, board members, investors, and external stakeholders.

Access Methods ​

MethodHow
Sidebar buttonUsers with Observer role (or Platform Admin) see a "Growth Dashboard" button in the sidebar
Share linkPlatform admins generate time-limited links from Analytics → Observer Dashboard Share Links
Direct URL/observer (authenticated) or /observer?token=TOKEN (public)

Metrics Displayed ​

Hero Metrics Row ​

MetricDescription
Total UsersTotal registered users with 30-day new signup count
Active Users (7d)Users active in the last 7 days with % of total
MRRMonthly Recurring Revenue with ARR below
K-FactorViral coefficient from referral program
Conversion RateTrial-to-paid conversion with churn rate below
OrganizationsTotal orgs with 30-day new org count

Charts ​

  • User Growth — 90-day bar chart of daily new user signups
  • Organization Growth — 90-day bar chart of daily new organization creation

Tier Distribution ​

Horizontal bar breakdown showing user counts per subscription tier (Starter, Personal, Team, Business, Enterprise).

Referral Funnel ​

Visual funnel showing Signups → Activated → Converted with activation rate, conversion rate, and K-factor metrics.

Platform admins manage share links from Platform Admin Console → Analytics:

  1. Enter a label (e.g., "Sequoia Q1 Review") and select expiry (7–365 days)
  2. Click Generate Link
  3. Copy the link to share
  4. View access counts and revoke links as needed

API Endpoints ​

bash
# Get dashboard data (authenticated or with token)
GET /api/observer/dashboard
GET /api/observer/dashboard?token=TOKEN

# Create share token (platform admin only)
POST /api/observer/share-tokens

# List share tokens
GET /api/observer/share-tokens

# Revoke share token
DELETE /api/observer/share-tokens/{token_id}

Auto-Refresh ​

The dashboard auto-refreshes every 60 seconds to keep metrics current during live presentations.

Best Practices ​

  1. Review weekly: Check analytics for trends
  2. Export monthly: Generate compliance reports
  3. Act on recommendations: Apply threshold changes
  4. Share with stakeholders: Use executive dashboard or Observer Growth Dashboard share links
  5. Monitor usage: Stay within quotas
  6. Check team activity: Review the activity feed for unexpected changes
  7. Complete setup checklist: Use Setup for a detailed walkthrough, or glance at the banner at the top of the Admin Dashboard for quick progress
  8. Debug chat issues: Use the Chat Flow Debugger to diagnose streaming, tool execution, and provider fallback issues
  9. Performance visibility: Every assistant message includes an expandable Performance Waterfall (click "Thought for X seconds" → "Advanced details") showing a 9-phase latency breakdown with GhostAI stack vs External LLM percentages — no admin access required

Next Steps ​


Referral Dashboard ​

The Referral Dashboard is accessible from the sidebar (Refer & Earn) and provides users with:

  • Referral Link — Unique shareable link with copy-to-clipboard and social share buttons
  • Stats Grid — Signup, activation, conversion counts, and credits earned
  • Milestone Progress — Visual progress bar toward next milestone (3, 10, 25, 50 referrals)
  • Leaderboard — Top referrers ranked by activations
  • Rewards Ledger — History of earned credits and account credits
  • Recent Referrals — Table of referred users with status badges

API Endpoint ​

GET /api/referral/stats — Returns all dashboard data for the authenticated user.


Launch War Room ​

A standalone real-time dashboard for monitoring referral launches on a large screen or TV.

Running the Dashboard ​

bash
python infrastructure/scripts/launch-dashboard.py --api-url http://localhost:8000 --token JWT_TOKEN --port 9090

Display Panels ​

  • Hero Counters — Total signups, activations, conversions, credits granted, K-factor
  • Signup Velocity — Bar chart of signups per hour (last 48 hours)
  • Funnel — Visual funnel from signup → activation → conversion
  • Leaderboard — Top 8 referrers with rank and count
  • Live Event Feed — Real-time stream of signup/activation/conversion events

API Endpoint ​

GET /api/referral/war-room — Returns aggregated metrics for the dashboard poller.


Stress Test War Room ​

Standalone real-time dashboards for monitoring infrastructure during stress and load tests. Two variants exist: one for AWS deployments and one for local Docker Compose deployments. Both serve a dark-mode web UI with gauges, charts, and a k6 metrics receiver.

AWS Stress Test Dashboard ​

Monitors AWS infrastructure (ECS, RDS, ALB, WAF) via CloudWatch.

bash
source securechat/backend/.venv/bin/activate
python infrastructure/scripts/stress-dashboard.py [--port 9090] [--region us-west-2]
PanelMetrics
GaugesECS CPU, ECS Memory, RDS Connections, WAF Blocked
Mini StatsRDS CPU, Burst Balance, ALB Active Conns, WAF Allowed
ChartsALB Request Count, Response Time, 5XX Errors, RDS Latency
k6 SectionAuto-appears when k6 pushes metrics to POST /api/k6

Requires: pip install boto3 and valid AWS credentials.

Local Stress Test Dashboard ​

Monitors Docker containers (ghostai-backend, ghostai-postgres, ghostai-redis) via the Docker SDK.

bash
source securechat/backend/.venv/bin/activate
python infrastructure/scripts/stress-dashboard-local.py [--port 9090] [--target http://localhost:8000]
PanelMetrics
GaugesBackend CPU, Backend Memory, Postgres Connections, Postgres CPU
Mini StatsPostgres Memory, Redis Memory, Redis Clients, Health Latency
ChartsBackend Response Time, Backend CPU/Memory, Postgres CPU/Memory, Postgres Connections
Status BarPer-container status (backend, postgres, redis, frontend), Health check result
k6 SectionAuto-appears when k6 pushes metrics to POST /api/k6 (same as AWS variant)

Requires: pip install docker and a running Docker daemon.

Gracefully degrades when containers are missing (e.g., no Redis when using the simpler securechat/docker-compose.yml).

Native Stress Test Dashboard ​

Monitors locally-running processes (uvicorn backend, Vite frontend) and SQLite via psutil. Designed for the native (no containers) deployment target.

bash
source securechat/backend/.venv/bin/activate
python infrastructure/scripts/stress-dashboard-native.py \
    [--port 9093] \
    [--target http://localhost:8000] \
    [--db-path securechat/backend/data/ghostai.db] \
    [--pid-dir ~/.config/ghostai/pids]
PanelMetrics
GaugesBackend CPU, Backend Memory (RSS MB), System CPU, System Memory
Mini StatsSQLite DB Size, Backend Threads, Backend Open FDs, Health Latency
ChartsBackend Response Time, Backend CPU/Memory, System CPU/Memory, SQLite DB Size
Status BarBackend process (PID), Frontend process (PID), Health check result, DB path
k6 SectionAuto-appears when k6 pushes metrics to POST /api/k6 (same as other variants)

Requires: pip install psutil.

Auto-discovers the backend process via PID files (~/.config/ghostai/pids/backend.pid) or by scanning for uvicorn app.main in running processes. Gracefully degrades when processes or the SQLite file are not found.

k6 Integration ​

All three dashboards expose POST /api/k6 to receive live metrics from the k6 test runner. When k6 begins pushing data, the dashboard automatically shows virtual user counts, HTTP failure rates, chat latency p95, and TTFB p95.


AI Protection Dashboard ​

The AI Protection tab is available to organization admins under Admin → Security → AI Protection. It provides visibility and control over AI-powered PII detection across your organization.

Protection Status ​

Shows the health and configuration of the private (in-environment) detection model. Displays model name, runtime (CPU/GPU), deploy mode, and whether the model is loaded. When a remote inference service is used, shows the active model, endpoint, and GPU details.

Detection Policy ​

Org-wide defaults for the detection model and verification mode. Admins can choose:

  • Detection Model: Private Model (in-environment, data never leaves your network), Cloud API, or Custom Endpoint
  • Verification Mode: Verify All, Suspicious Only, or Off

Each setting can be locked so users cannot override the org default. Locked settings display a notice to users explaining the policy.

Protection Metrics ​

Aggregated metrics over 7d, 30d, or 90d:

  • Sessions protected, entities detected, active users
  • Detection model usage split (private vs cloud vs custom)
  • Entity breakdown by type (PII categories; only enabled entity types are shown)

User Detection Overview ​

Table of all users with detection activity, showing each user's active detection model, entities detected, and whether they match the org default (Compliant) or use an override.


Admin Dashboard: RAG / File Intelligence ​

The Admin Dashboard includes a dedicated RAG / File Intelligence section for platform administrators to configure retrieval settings organization-wide.

Available Controls ​

SettingDescription
Hybrid SearchToggle BM25 + semantic search with Reciprocal Rank Fusion
HNSW ANNEnable HNSW approximate nearest neighbor for files with >100K chunks
Chunk-Level PII CacheCache PII detection results per chunk to avoid redundant scanning
Streaming IngestionStream large text files (>50 MB) into the index without full memory load
Embedding DeviceSelect hardware for vector embeddings: Auto-detect, CPU, CUDA (NVIDIA), or MPS (Apple Silicon)
RAG Indexing ThresholdFile size above which automatic chunking and indexing activates (default: 1 MB)
Streaming ThresholdFile size above which streaming ingestion activates (default: 50 MB)

Observability ​

RAG operations emit Prometheus metrics and OpenTelemetry spans:

  • ghostai_rag_retrieval_total — retrieval count by file type and search mode
  • ghostai_rag_retrieval_duration_seconds — end-to-end retrieval latency
  • ghostai_rag_chunks_retrieved — chunks returned per query
  • ghostai_rag_top_similarity_score — top match score per query
  • ghostai_rag_budget_utilization — fraction of context budget consumed
  • ghostai_rag_indexing_duration_seconds — file indexing duration
  • ghostai_rag_pii_cache_hits_total / ghostai_rag_pii_cache_misses_total — PII cache effectiveness

These metrics are available on the /metrics endpoint and can be scraped by Prometheus or viewed in Grafana.

SOC 2 Type II Certified | BAA Available | HIPAA-Ready