Senior Data Engineer

Title: Senior Data Engineer

Client Location: Atlanta GA(Hybrid)

Type: Contract

Position Overview:

• We are seeking a Senior Data Engineer to join the core Symphony platform team in an onshore capacity. This is a hands-on development role focused on building maintaining and optimizing data pipelines and warehousing solutions.
• The engineer will work within a local-first development model and is expected to be a strong independent contributor capable of owning complex workstreams.

Key Responsibilities:

• Design develop and maintain data pipelines using Scala and SQL on Apache Spark
• Monitor and support Phase 1 pipelines post go-live
• Investigate and remediate pipeline failures data quality issues and performance bottlenecks
• Lead refactoring and cleanup of existing Phase 1 code
• Optimize existing solutions for performance and scalability
• Build and contribute to reusable patterns and automation frameworks
• Work within metadata-driven architecture
• Ensure pipelines are used strictly for scheduling - ETL logic must remain in code
• Manage code using GitHub version control
• Contribute to discovery sessions to derive requirements directly from data

Required Skills & Experience:

• 8 10 years of hands-on data engineering experience
• Strong understanding of Apache Spark and its core concepts
• Proficiency in Scala and/or Java - code-first approach required
• Advanced SQL skills
• Experience with Azure Synapse
• Working knowledge of GitHub for source control
• Experience with data warehousing and large-scale data integration

Nice to Have:

• Experience with Microsoft Fabric
• Background in marketing data or consumer goods analytics
• Familiarity with metadata-driven architectures

Non-Negotiables:

• Must be a hands-on builder
• Must be available to mobilize immediately
• Must commit to 4 days/week onshore