Data Engineer
Share
Job Location:
Pittsburgh, PA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Work Schedule
Standard (Mon-Fri)Environmental Conditions
OfficeJob Description
How will you make an impact
Thermo Fisher Scientific is seeking a Data Engineer to work with the Data Science Center of Excellence and Data Architecture team! The data platform is primarily based on Oracle Exadata database AWS Redshift and Databricks-based Delta and Unity Catalog technologies toward Lakehouse transition to enable Data Science Data Analytics Customer Analytics and Data Services for critical Application and Business enablement.
What will you do
- Design develop test deploy support enhance data integration solutions seamlessly to connect and integrate Thermo Fisher enterprise systems in our Data Science and Enterprise Data Platform.
- Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions integrate modern capabilities.
- Facilitate capturing requirements and process mapping workshops review business/functional requirement documents author technical design documents testing plans and scripts.
- Assist with implementing standard operating procedures facilitate review sessions with functional owners and end-user representatives and leverage technical knowledge and expertise to drive improvements.
- Defining designing and documenting reference architecture and leading the implementation of BI and analytical solutions.
- Follow agile development methodologies to deliver solutions and product features by following DevOps practices.
Experience Knowledge Skills Abilities
- 4-year degree with major in computer science engineering (or equivalent) from an accredited university (preferred) will substitute for minimum 4-5 years professional IT experience
- Experience in ETL (Data extraction data transformation and data load processes)
- 6 years working experience in data integration and pipeline development.
- Proven track record using Databricks and Apache Spark.
- Data lake and Delta lake and Unity Catalog experience with AWS Glue and Athena.
- Demonstrated ability with AWS Cloud on data integration with Apache Spark Glue Kafka Elastic Search Lambda S3 Redshift RDS MongoDB/DynamoDB ecosystems.
- Strong real-life experience in Python development especially in pySpark in AWS Cloud environment
- Design develop test deploy maintain and improve data integration pipeline.
- Strong analytical experience with database in writing complex queries query optimization debugging user defined functions views indexes etc.
- Solid experience with source control systems including Git and Jenkins build and continuous integration tools.
- Understanding of development methodology and actual experience writing functional and technical design specifications.
- Must be willing to learn Generative AI.
Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race color religion sex sexual orientation gender identity national origin protected veteran status disability or any other legally protected status.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process to perform essential job functions and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Electron microscopes reveal hidden wonders that are smaller than the human eye can see. They fire electrons and create images, magnifying micrometer and nanometer structures by up to ten million times, providing a spectacular level of detail, even allowing researchers to view single a ... View more
