Sr. BI Data Engineer
Boston, MA - USA
Job Summary
As a Senior BI Data Engineer you will design build and optimize enterprise-scale data solutions that power analytics and business decision-making across Boston Beer. You will work hands-on with Databricks Azure data services and modern data engineering practices to deliver reliable scalable and high-performing data this role youll partner with stakeholders across multiple business functions while helping drive platform modernization engineering excellence and technical innovation.
Responsibilities
- Design build and support scalable Databricks Lakehouse data pipelines using Apache Spark Delta Lake Structured Query Language (SQL) and Python.
- Lead technical design and delivery for complex data initiatives that span multiple systems platforms and business functions.
- Diagnose production issues perform root cause analysis evaluate technical alternatives and implement solutions that improve reliability scalability and maintainability.
- Develop reusable frameworks and engineering practices for data ingestion transformation orchestration testing monitoring data quality and production support.
- Administer and support Databricks platform capabilities including workspace configuration Unity Catalog permissions management and data governance.
- Design and manage production workflows including scheduling dependency management monitoring alerting and failure recovery.
- Implement continuous integration and continuous deployment (CI/CD) processes using Azure DevOps Git-based development workflows and Databricks Asset Bundles.
- Collaborate with business stakeholders analytics teams and technology partners to define requirements and deliver impactful data solutions.
- Optimize data pipelines compute resources and storage for performance observability reliability and cost efficiency while supporting modernization of legacy SQL Server solutions.
- Mentor engineers conduct code and design reviews and contribute to continuous improvements in engineering standards and practices.
- Work in a standard office environment with occasional travel as needed to support business objectives and team collaboration.
Qualifications
- Bachelors degree in Computer Science a closely related field or equivalent practical experience.
- 7 years of experience in data engineering data warehousing data integration analytics engineering or related technology roles.
- 3 years of hands-on Databricks development experience supporting production environments.
- Strong expertise with Databricks Lakehouse Apache Spark Delta Lake Databricks Workflows Unity Catalog and distributed data processing.
- Experience working with Microsoft Azure data services including Azure Data Factory Azure Data Lake Storage and Azure Key Vault.
- Advanced SQL and Python skills with experience building operating and optimizing complex ETL/ELT pipelines and analytical data models.
- Experience with modern DevOps and data engineering practices including Git-based development automated testing CI/CD orchestration monitoring security governance and production support.
- Demonstrated ability to lead technical solution design evaluate technical trade-offs and independently deliver complex data initiatives.
- Strong communication and collaboration skills with experience providing technical guidance to engineering teams.
- Experience with advanced Databricks capabilities including Databricks Asset Bundles workspace administration platform configuration and governance.
- Experience with Power BI semantic modeling reporting enablement and analytics consumption patterns.
- Experience modernizing legacy SQL Server data solutions to cloud-based platforms.
- Familiarity with artificial intelligence (AI) machine learning (ML) feature engineering or model-ready data products.
- Knowledge of SAP Salesforce Supply Chain Manufacturing or consumer packaged goods business processes.
Level: L6
- Tuition reimbursement
- Fertility/adoption support
- Free financial coaching
- Health & wellness program and discounts
- Professional development & training
- Free beer!
Required Experience:
Senior IC