Data Engineer
Boston, NH - USA
Job Summary
At the MBTA we envision a thriving region enabled by a best-in-class transit system. Our mission is to serve the public by providing safe reliable and accessible transportation. MBTAs Core Values are built around safety service equity sustainability and culture. Each employee that works for the MBTA performs their roles based on our vision mission and values. This includes attendance participation and contribution in local safety committee meetings as needed.
Job Summary
The Data Engineer will be responsible for expanding enhancing and maintaining MBTAs data warehouse and related infrastructure for effective utilization by internal and external stakeholders. The position will be a vital partner in implementing the MBTAs broader data strategy. The role involves data warehouse management (including SQL-based programming to structure data flows and data sources providing input on data architecture as well as managing the Extract Transform and Load (ETL) process automated data flows error handling and other related tasks) and working closely with other members of the Information Management and Technology teams team to promote effective data utilization. This individual will ensure a positive end-user experience application availability and address errors efficiently as well as oversee the mapping of data sources data movement interfaces and analytics with the goal of ensuring data quality.
Duties & Responsibilities
- Design develop and document ETL processes technical architecture data pipelines and performance.
- Develop integration process data flows and data mapping analyses.
- Address application and data-related problems regarding systems integration compatibility and multiple-platform integration.
- Develop and promote data integration methodologies and standards.
- Develop and implement key components as needed to create testing criteria to guarantee the fidelity and performance of application and data architecture.
- Identify and develop opportunities for code and data reuse migration or retirement of systems.
- Work independently and collaboratively to identify issues perform root-cause analysis that would lead to proper and timely issue resolutions.
- Take ownership over data flow errors communicating about them and working to resolve them as efficiently as possible.
- Establish methods and procedures for tracking data quality completeness redundancy and improvement.
- Work closely with the rest of the Business Intelligence team and other internal stakeholders to understand the needs of the business and build data resources to best meet those needs.
- Perform all other duties and projects that may be assigned.
Minimum Requirements & Qualifications
- Bachelors Degree from an accredited institution in Computer Science Information Systems Business Administration or another related field.
- Three (3) years of experience in data engineering or a related role.
- Experience working within an application or Database Production support role and/or experience with scripting and object-oriented programming languages and/or experience with Relational Databases.
- Experience using ETL tools in a data analyses data engineering or similar role.
- Business Intelligence (BI) knowledge with exposure to BI from an ETL perspective.
- Demonstrable experience SQL and core data management principles (such as ETL/ELT data warehousing architecture query design and performance tuning).
- Experience defining/modeling/implementing an Enterprise Data Warehouse using best practices.
- Experience with database schema objection management data modeling & architecture and data warehouse design.
- Experience with interactive reporting platforms (Tableau Power BI etc.).
- Proven track record of self-starting and growth in related field(s).
- Developing and maintaining formal documentation that describes data and data structures including data modelling.
- Superior attention to detail skills and an ability to think critically and conceptually.
- Team oriented and flexible with proven track record in collaborating with multiple stakeholders.
- Strong verbal and written skills.
- Ability to quickly learn new technologies.
Substitutions Include
- A High School Diploma or GED with an additional seven (7) years of directly related experience substitutes for the Bachelors degree requirement.
- An Associates degree from an accredited institution an additional three (3) years of directly related experience substitutes for the Bachelors degree requirement.
- A Masters degree in a related subject substitute for two (2) years of general experience.
- A nationally recognized certification or statewide/professional certification in a related field substitutes for one year of experience
Preferred Experience and Skills
- Hands-on experience and expertise in Advanced SQL Advanced Python programming AWS Services (such as S3 Redshift Glue ETL IAM DMS Appflow VPC and others) SnowFlake FiveTran Informatica KAFKA Airflow Oracle Cloud and other open-source tools.
- Six (6) years of DWH experience.
- Three (3) years of exposure to Business Intelligence (BI) from an ETL perspective.
- Six (6) years of ETLdevelopment experience.
- Three (3) years of Cloud based technological experience.
- Proficiency with interactive reporting platforms (Tableau Power BI etc.).
- Proven success with documentation of processes distributing to end-users and supporting those users.
- Five (5) years experience with advanced data management systems (e.g. PostgreSQL etc.).
- Deep expertise in data modeling and structuring using Python/R.
- Experience with systems migration experience is highly desirable.
- Experience in high volume data environments.
Job Conditions:
- Ability to effectively read comprehend communicate and respond to instructions orders signs notices inquiries English.
- Be at least eighteen (18) years of age except if participating in an approved high school internship / co-op program.
- Ability to commute to assigned work locations in the Boston MA metro area as required by the role.
- Ability to provide internal and external customers with courteous and professional experiences.
- Ability to work effectively independently and as part of a diverseworkforce team (or supervise if required).
- Ability to uphold the rights and interests of the MBTA while building and maintaining effective relationships with employees and co-workers.
- Ability to adhere to rules regulations collective bargaining agreements (if applicable) and policies of the MBTA including the EEO anti-discrimination anti-harassment and anti-retaliation policies.
- Have a satisfactory work record for the two (2) years immediately prior to the closing date of this posting (unless if current student or recent graduate) including overall employment job performance discipline and safety records (infractions and/or offenses occurring after the closing of the posting and before the filling of a vacancy may preclude a candidate from consideration for selection).
- Ability to pass a Criminal Offender Record Information (CORI) check comprehensive background screening and / or medical Clinic screening potentially including physical examination and drug and alcohol screenings.
- Ability to work all shifts and / or locations assigned directed or necessary for this position including (for some transit / operations roles) up to twenty-four (24) hours per day seven (7) days per week as necessary to accommodate severe weather conditions emergencies or any other circumstances that may potentially impact service or the safety of service.
- Intern / co-op staff must be enrolled full or part-time in an accredited educational program and maintain a cumulative GPA of at least 2.5 for the entire duration of the internship / co-op. Additionally interns / co-ops must have valid work authorization and U.S. Social Security Numberprior to starting pre-employment screenings / pre-boarding working in their positions and throughout the duration of their program.
Disclaimers and Definitions:
- General Disclaimer: The statements contained in this job description are intended to describe a summary general nature and complexity of typical job functions and do not represent an exhaustive list of all duties tasks and responsibilities required of staff assigned to this position.
- Application Completion: It is each applicants responsibility to ensure application details are entered completely and correctly including updated work and education histories (past and current). Incomplete applications may not be considered. Attachments do not substitute for application fields. The recruitment team does not have access to existing employee data / history.
- Application Deadlines:Applicants should apply as soon as possible as the MBTA may stop considering applicants after a sufficiently large applicant pool is established.
- Work Environment:The physical demands and work environment characteristics described here-in are representative of those an employee may encounter while performing the essential functions of this job. Reasonable accommodations can be made to enable individuals with disabilities to perform essential functions. See job description for role-specific requirements.
- Work Eligibility:All employees must be legally authorized to work in the United States and on an unrestricted MBTA does not have an employer work sponsorship program. However if you have unrestricted work authorization or are sponsored by a separate entity you are welcome to all persons hired will require a U.S. Social Security Number prior to starting the position and employees will be required to complete a Form I-9 to verify their identity and eligibility to work in the U.S.
- Interviews:Candidates should ensure they arrive on time are prepared can remain for the duration and if remote are in a quiet place without distraction for the interview. Candidates who do not attend their interview without advance authorization including an email confirmation of a rescheduled time/date from Human Resources will be considered a no-show and disqualified from consideration for the position. Related to rescheduling on a one-time basis and due to something emergent you may be allowed to reschedule the addition Human Resources may require documentation supporting the request. However should you need to reschedule you will need to contact your Recruiter directly by email.
- Safety Sensitive Positions:Employees working in this classification will be subject to periodic physical examinations plus random drug and alcohol testing.
- On-call or 24/7 Positions:Employees working in this classification must be available to respond to page / text / call and report to work as determined by assigned department or the Authority.
- Essential / Emergency Staff:During declared states of emergency employees working in this classification are required to report to work for their assigned work hours or as directed by management.
- ADA Accommodations: The MBTA makes reasonable accommodations for applicants with disabilities. If you require an accommodation during this process please contact the MBTAs ADA Unit at or .
- Diversity Equity and Inclusion:The MBTA is an Equal Employment Opportunity Employer. For terms descriptions and definitions related to diversity equity inclusion veteran status and immediate family members that you may find on the application form please visit / Co-Op Benefits: Employees taking part in an internship orco-opat the MBTA are eligible to receive accrued paid sick leave as well as a monthly transportation pass based on the city from which the intern / co-opcommutes to workat no cost. However no additional benefits are currently offered for interns orco-ops.
Required Experience:
IC