Project overview

• Design and implement a hybrid testing and monitoring ecosystem integrating Azure DevOps (cloud-based CI/CD automation) with on-premise observability tools (Prometheus, Grafana, Loki, Alertmanager).
• Target system: .NET backend API; create a continuous quality feedback loop combining functional testing, performance testing and real-time monitoring within a single automated workflow.
• Number of interns: 18. Duration: Between 4 to 6 Months. Project Ref: CED-QA-001.

Key objectives

• Automate API functional and performance testing through Azure DevOps pipelines using YAML pipeline definitions.
• Enable real-time visualization and alerting using on-premise Grafana and Prometheus (with Pushgateway) and alerts via Alertmanager.
• Establish a secure hybrid connection between cloud orchestration (Azure DevOps) and internal monitoring infrastructure (VPN / Private Link).
• Create a self-healing CI/CD process that automatically re-triggers tests when performance or functional regressions are detected.

Responsibilities / Tasks

• Implement and maintain Azure DevOps pipelines (YAML) to run functional tests (Postman/Newman) and performance tests (Apache JMeter) as part of CI/CD.
• Instrument the .NET API to expose metrics and logs; push metrics to Prometheus (Pushgateway) and logs to Loki for centralized observability.
• Configure Grafana dashboards for real-time visualization and create alert rules in Alertmanager; link alerts to pipeline triggers that re-run relevant tests on regressions.
• Integrate secure connectivity (VPN/Private Link) and ensure pipeline agents/scripts can access on-premise monitoring endpoints.

Technical environment & tools

• CI/CD: Azure DevOps Pipelines (YAML), Azure DevOps cloud orchestration.
• Testing: Postman + Newman CLI for functional API tests; Apache JMeter for performance testing; YAML for pipeline definitions.
• Observability: Prometheus, Pushgateway, Grafana, Loki, Alertmanager for metrics, dashboards, logs and alerting.
• Application stack: .NET API backend; hybrid cloud/on-prem architecture; use of VPN / Private Link for secure hybrid connectivity.

Expected deliverables

• Fully automated Azure DevOps pipelines that run functional and performance tests and publish results/metrics to the observability stack.
• Grafana dashboards and Alertmanager rules providing real-time visualization and alerting tied to CI/CD actions.
• Documentation detailing setup, pipeline definitions (YAML), test suites (Postman collections, JMeter plans), and steps for secure hybrid connectivity.
• A self-healing CI/CD workflow that re-triggers tests and reports actions when regressions are detected.

Required skills / knowledge

• Experience with Azure DevOps Pipelines and YAML-based pipeline definitions.
• Testing tools: Postman/Newman, Apache JMeter; familiarity with API functional and performance testing.
• Observability: Prometheus, Pushgateway, Grafana, Loki, Alertmanager.
• Networking/security basics for VPN / Private Link and hybrid integrations; familiarity with .NET API instrumentation.