Observability Engineer

JOB DESCRIPTION OBSERVABILITY ENGINEER
Role Summary
The Observability Engineer is responsible for ensuring the reliability performance and trustworthiness of the High Value Content Cache (HVCC) ecosystem. HVCC aggregates unstructured data from multiple source systems stores extracted metadata in Postgres maintains HTML renditions in Amazon S3 and syncs data to Snowflake using Fivetran with orchestration powered by Amazon MWAA (Airflow).
This role builds and operates endtoend observability across data pipelines infrastructure users and cost using enterprisegrade observability tools such as Acceldata or equivalent.

Key Responsibilities

Data Observability
Monitor data quality across completeness accuracy timeliness uniqueness and detect anomalies/outliers.
Validate availability and correctness of HTML renditions in S3 and metadata stored in Postgres.
Ensure freshness and integrity of data moving from Postgres Snowflake via Fivetran.
Pipeline Observability (Fivetran MWAA)
Track schema changes volume shifts load frequency and performance behavior across data pipelines.
Monitor Airflow DAGs in MWAA for failures retries dependency issues and timing deviations.
Detect abnormal ingestion patterns from upstream HVCC source systems.
Infrastructure Observability (AWS Databases)
Monitor performance of Postgres (locks slow queries storage) S3 (latency storage growth) and Snowflake (warehouse performance scaling events).
Monitor Snowflake credit consumption AWS resource usage S3 storage growth and Fivetran consumption tiers.
Track SLA adherence
Required Skills & Experience
Strong understanding of data observability principles (freshness schema volume lineage distribution).
Experience with Postgres S3 Snowflake Fivetran Airflow/MWAA.
Ability to interpret system metrics logs lineage graphs and platform alerts.
Preferred Qualifications
Experience with observability platforms such as Acceldata Splunk Databand or similar.
Background in data engineering SRE platform engineering or cloud ops.
Familiarity with schema evolution SLA management and cost optimization.
Impact of the Role
This role ensures HVCC remains a highintegrity highly observable resilient and costefficient data platform enabling reliable content delivery analytics readiness and operational excellence across the enterprise.