Senior Observability Platform Engineer Alerting

The Opportunity:
The Senior Observability Platform EngineerGrafana Alerting and SRE Focus is responsible for turning telemetry into actionable dashboards alerts service-level objectives incident workflows and reliable operational outcomes. This role combines telemetry alert engineering platform reliability engineering incident-management support and observability user enablement. The role ensures that platform operators engineers security teams leadership and FinOps stakeholders can use data effectively through governed dashboards actionable alerts and repeatable operational processes.

Responsibilities:

• Grafana Engineering and Visualization
  • Deploy administer secure and maintain Grafana as the primary visualization and alerting interface.
  • Build and maintain role-based dashboards for platform engineering SRE security operations application teams FinOps and leadership.
• Alerting and Incident Workflow Engineering
  • Design implement tune and maintain alerts for availability performance saturation errors security events telemetry gaps storage issues and SLO violations.
  • Establish alert standards severity definitions deduplication grouping inhibition routing escalation silencing suppression and maintenance-window practices.
• SRE Service Health and Operational Readiness
  • Define implement and maintain SLIs SLOs error budgets service-health standards and reliability reporting for and onboarded services.
  • Build and maintain meta-monitoring dashboards including pipeline throughput dropped samples query latency ingestion rate storage utilization node health alerting status and identity-provider health.
• Query Analysis and Consumer Enablement
  • Write and optimize PromQL LogQL TraceQL Elastic Query DSL/KQL or other relevant query languages based on the approved platform architecture.
  • Partner with application teams to build RED-method dashboards service-level monitoring trace-to-log correlation and deployment-aware operational views
• Security Governance and Delivery Practices
  • Work with IAM security and data-governance stakeholders to implement appropriate dashboard query and administrative access controls.
  • Ensure sensitive telemetry is displayed and accessed in accordance with approved data-handling and least-privilege requirements.

Qualifications:

Required:

• Bachelors degree in Computer Science Information Technology Engineering or a related field; equivalent experience may substitute.
• 7 years of experience in SRE observability engineering monitoring engineering platform operations DevOps or production support.
• 3 years of advanced Grafana administration dashboard development and alerting experience.
• Strong experience defining and operating SLIs SLOs error budgets alerting standards incident response and post-incident improvement processes.
• Demonstrated ability to create usable dashboards and alerts from metrics logs traces and event data.
• Proficiency in PromQL and/or LogQL; experience with Elastic Query DSL/KQL is strongly desired.
• Experience integrating alerts with ServiceNow GitLab webhooks ticketing systems and enterprise notification workflows.
• Experience with Kubernetes or OpenShift and cloud-native operational troubleshooting.
• Hands-on experience with Git GitLab CI/CD Grafana provisioning GitOps and configuration-as-code.

Desired:

• Experience with Grafana Enterprise including advanced RBAC reporting incident-management features and offline licensing in disconnected environments.
• Experience with Elastic Prometheus/Mimir Loki Tempo OpenTelemetry and Grafana Alloy.
• Experience building dashboards for security operations cloud cost management OpenCost or executive operational reporting.
• Experience in air-gapped classified DoD federal or other highly regulated environments.
• Familiarity with NIST SP 800-53 NIST SP 800-137 ICD 503 RMF/ATO evidence and FIPS constraints.

What You Can Expect:

A culture of integrity.

At CACI we place character and innovation at the center of everything we do. As a valued team member youll be part of a high-performing group dedicated to our customers missions and driven by a higher purpose to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers - every day. Youll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together we will advance our nations most critical missions build on our lengthy track record of business success and find opportunities to break new ground in your career and in our legacy.

Pay Range:

There are a host of factors that can influence final salary including but not limited to geographic location Federal Government contract labor categories and contract wage rates relevant prior work experience specific skills and competencies education and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI you will receive comprehensive benefits such as; healthcare wellness financial retirement family support continuing education and time off benefits.

Since this position can be worked in more than one location the range shown is the national average for the position.

The proposed salary range for this position is:

CACI is anEqualOpportunity Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation age national origin disability status as a protected veteran or any otherprotectedcharacteristic.