Senior Data Engineer - New
Senior Data Engineer - New
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Department: Office of the Chief Information Officer
SUMMARY
The Senior Data Engineer designs builds and maintains our data infrastructure across Amazon Web Services (AWS) and Google Cloud platforms. This individual works on implementing scalable data pipelines optimizing data workflows and ensuring data quality and accessibility across our multi-cloud environment. This role serves as a technical resource and educator helping the P&DSG (Promotion & Design Services Group) analytics business users optimize their use of data systems.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Data Protection & GDPR Compliance
- Design and implement data protection measures across all data systems
- Maintain records of processing activities for data workflows
- Implement and monitor data retention policies and deletion schedules
- Ensure data minimization principles are followed in all data systems
- Create and maintain documentation for data protection procedures
- Implement cross-border data transfer mechanisms compliant with GDPR
- Coordinate with legal teams on privacy notices and consent management
- Establish processes for breach detection investigation and reporting
- Train engineering teams on GDPR requirements and best practices
Data Transformation
- Develop and maintain data transformation workflows
- Create reusable transformation patterns and modular code for complex business logic
- Implement data cleansing standardization and enrichment processes
- Design and maintain data documentation and lineage tracking
- Optimize transformation jobs for cost and performance
- Implement version control and testing for transformation code
- Migrate and cleanse outdated redundant or inactive records in legacy systems
Data Warehouse Management
- Design implement and optimize data warehouse architectures in Google BigQuery
- Develop and maintain dimensional data models and fact tables
- Provide technical guidance and education to analytics business users on these models and tables
Data Management Support for Business Intelligence
- In support of analytics business users:
- Assist with the creation and optimization of models
- Design reusable reporting components and custom visualizations
- Create efficient partitioning and clustering strategies to optimize query performance
- Implement slowly changing dimensions (SCD) and historical data tracking
- Establish data quality monitoring and validation processes
- Design and maintain data marts for specific business domains
- Educate and serve as a technical consultant to help analytics business users improve their SQL and data access techniques
STAFF MANAGEMENT AND JOB CONTACTS
Reporting Relationships
Supervisor: Manager Engineering
Supervises: None
Regular Contacts
This position has regular contact and will partner with senior management in OGC (Office of the General Counsel) and with MBEL (Mary Baker Eddy Library) as well as with security (CISO Info Security Manager) TFCCS employees TFCCS Service Centers Vendors fellow Database Administrators and System Administrators Network Administrators the Support Desk Department Managers and the Project Management Office. This position also maintains a key partnership with the P&DSG Head of Digital Analytics & Promotion and their team members who are the business users.
JOB REQUIREMENTS
Education/Experience
- Bachelors degree in Computer Science Engineering or equivalent experience.
- Experience as a data Engineer or similar experience or relevant software development experience.
Knowledge/Skills
- Proven expertise with Google Cloud Platform services including BigQuery Dataflow Cloud Storage and Cloud Functions
- Proficiency in SQL data modeling and query optimization techniques
- Experience with data streaming and batch processing frameworks
- Knowledge of data warehouse design and dimensional modeling
- Experience with version control systems (e.g. Git BitBucket)
- Knowledge of serverless framework tools and best practices for deployment and management
- Understanding of Agile methodologies.
- Excellent problem-solving and communication skills
- Ability to translate complex technical concepts for analytics business user understanding
- Strong troubleshooting and technical consulting abilities
Preferred Qualifications:
- Knowledge of cloud services (AWS Azure or Google Cloud)
- Experience with serverless architecture and Javascript
- Familiarity with performance testing and load testing tools
- Experience in technical training or user education roles
Work Environment
Strong preference for onsite work in Boston but may possibly work remotely with periodic visits to the Boston office as needed.
Engagement with Christian Science
- Mother Church membership preferred.
- Primary Class instruction preferred.
Background Checks
This position is required to complete a background check to be hired and annual background checks thereafter.
In compliance with federal law all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.
Required Experience:
Senior IC
Employment Type
Full-Time
