Frontend
- React (UI)
- Redux
- TypeScript
- Unit Tests → Jest
- End-to-end automation → Katalon (tracked in Azure DevOps)
Backend
- FastAPI (REST APIs)
- Unit Tests → Pytest
Async Processing
- Celery (distributed task queue)
- RabbitMQ (message broker)
- Redis (cache + short-lived state)
- Celery Beat for scheduled jobs
Job Execution
- MLE SDK (TestOps SDK) packaged as containers
- Launched as PySpark jobs on AKS Jobs
- Databricks can also run experiments using the SDK
Data Layer
- Azure Databricks Delta Share (datasets from multiple zones)
- Azure SQL Server (application metadata)
- SQL Warehouse (analytics workloads)
- Containerized + stored in Azure Container Registry (ACR)
- Deployed to Azure Kubernetes Service (AKS)
- Istio service mesh for N/S and E/W traffic
- Azure API Gateway / Application Gateway as WAF
- Secrets in Azure Key Vault
- CI/CD with GitHub Actions
- Monitoring → Datadog (resource utilization)
- Security → SonarQube, Snyk (SAST + SCA), APIRO
Process
- Scrum ceremonies in Azure DevOps
(planning, backlog, standups, demo, retro)
- QA automation → Katalon
- Load testing → JMeter