Production Deployment Checklist
Migrating coomia-dip from development to production involves much more than changing configurations. Production environments require high availability, security hardening, performance tuning, monitoring and alerting, backup and recovery planning. This tutorial provides a comprehensive pre-launch checklist to systematically prepare your production deployment.
“Series: S12 Developer Tutorials · Article 19 | Level: Intermediate | Reading Time: 15 min
Production Deployment Checklist
#Introduction
Migrating coomia-dip from development to production involves much more than changing configurations. Production environments require high availability, security hardening, performance tuning, monitoring and alerting, backup and recovery planning. This tutorial provides a comprehensive pre-launch checklist to systematically prepare your production deployment.
#1. Infrastructure
#1.1 Hardware & Resources
| Component | Minimum | Recommended | HA Config |
|---|---|---|---|
| Control Layer | 4C/8G/50G | 8C/16G/100G | 3 nodes |
| Data Layer | 8C/32G/200G | 16C/64G/500G | 3 nodes |
| Intelligence Layer | 4C/16G/50G | 8C/32G/100G | 2 nodes |
| Doris FE | 4C/8G/50G | 8C/16G/100G | 3 nodes |
| Doris BE | 8C/32G/500G | 16C/64G/1T | 3+ nodes |
| Kafka | 4C/8G/200G | 8C/16G/500G | 3 nodes |
#1.2 Network
- Inter-service latency < 1ms (same datacenter)
- gRPC ports (50051-50059) accessible between services
- External API via load balancer (Nginx/Kong)
- TLS certificates configured
- DNS records configured
#2. Security Hardening
#2.1 Authentication & Authorization
- OAuth2/OIDC provider integrated (Keycloak/Auth0/Enterprise AD)
- JWT signing keys generated and securely stored
- API token rotation policy (recommend 90 days)
- RBAC roles defined (SuperAdmin/TenantAdmin/Developer/Viewer)
- Least privilege principle verified
#2.2 Network Security
- TLS 1.3 for all external communication
- mTLS for internal gRPC
- Database ports not externally exposed
- API rate limiting configured
- CORS policies set
- Security headers (HSTS, CSP, X-Frame-Options)
#2.3 Data Security
- Database passwords via secret management (Vault/KMS)
- Sensitive fields encrypted at rest
- Audit logging enabled
- Data classification labels defined
#3. High Availability
#3.1 Control Layer HA
control-Layer:
replicas: 3
readinessProbe:
grpc:
port: 50051
livenessProbe:
grpc:
port: 50051
#3.2 Database HA
- Doris FE: 3 nodes (1 Leader + 2 Followers)
- Doris BE: 3+ nodes with replication factor 3
- PostgreSQL with primary-replica replication
#3.3 Message Queue HA
- Kafka: 3+ brokers, replication factor 3, min ISR 2
#4. Monitoring & Alerting
#4.1 Core Alerts
groups:
- name: coomia-dip-alerts
rules:
- alert: HighErrorRate
expr: rate(grpc_server_handled_total{grpc_code!="OK"}[5m]) > 0.01
for: 5m
- alert: HighLatency
expr: histogram_quantile(0.99, rate(grpc_server_handling_seconds_bucket[5m])) > 2
for: 5m
- alert: DiskSpaceWarning
expr: (node_filesystem_avail_bytes / node_filesystem_size_bytes) < 0.2
for: 10m
#4.2 Business Metrics
- Active users dashboard
- API call volume trends
- Query performance distribution (P50/P95/P99)
- Action execution success rate
#4.3 Log Management
- Structured logging (JSON)
- Log aggregation (ELK/Loki)
- Retention policy (30 days hot + 1 year cold)
- PII masking
#5. Backup & Recovery
#5.1 Backup Strategy
| Data | Frequency | Retention | Method |
|---|---|---|---|
| Doris data | Daily full + real-time incremental | 30 days | Doris Backup |
| Ontology Schema | On change | Permanent | Git |
| Kafka data | Real-time (topic replicas) | 7 days | Built-in |
| Temporal history | Daily | 90 days | pg_dump |
#5.2 Recovery Drills
- Backup integrity verification automated
- Recovery to test environment tested
- RTO and RPO documented and validated
#6. Performance Baseline
#6.1 Targets
| Operation | P50 | P95 | P99 | TPS |
|---|---|---|---|---|
| Object read | < 5ms | < 20ms | < 50ms | > 5000 |
| Object write | < 10ms | < 50ms | < 100ms | > 2000 |
| Simple OQL | < 20ms | < 100ms | < 200ms | > 1000 |
| Complex JOIN | < 100ms | < 500ms | < 1s | > 200 |
#7. Launch Runbook
#7.1 Deployment Flow
- All tests passing (unit + integration + E2E)
- Security scan passing (dependency + container image)
- Configuration review complete (two-person review)
- Backup strategy verified
- Monitoring alerts configured and tested
- Canary deployment plan ready
- Rollback plan prepared
- On-call contacts updated
#7.2 Post-Launch Verification
- Core functionality smoke test passed
- Performance metrics within baseline
- No abnormal error logs
- Monitoring dashboards showing normal data
- External system integrations verified
#Summary
This checklist covers six critical areas for coomia-dip production deployment: infrastructure, security hardening, high availability, monitoring and alerting, backup and recovery, and performance baselines. Systematically checking each item before launch significantly reduces production incident risk. Remember: launch is not the end -- it is the beginning of operations.
Next: [S12-20] Performance Tuning Practical Guide Previous: [S12-18] Multi-Tenant Isolation & Configuration Guide