Senior Data Engineer (GCPBigQuery Migration)
Share
Job Location:
Monthly Salary:
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Department:
Job Summary
As a Senior Data Engineer you will drive the technical implementation of data pipelines and migration processes from Amazon RDS into Google BigQuery. You will work independently while collaborating closely with the Engineering Manager and Product stakeholders. You will mentor junior engineers and ensure high-quality delivery across the project.
Working hours: 14:0023:00
Responsibilities:
- Lead the migration of data from RDS to Google BigQuery.
- Design construct test and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Integrate new data management technologies and software engineering tools into existing structures.
- Work with messaging systems and data pipelines.
- Employ a variety of technologies and tools to marry systems together.
- Drive the improvements on data reliability efficiency and quality.
Qualifications :
- 6 years of hands-on experience with Google Cloud Platform including: BigQuery DataStream (CDC) Dataflow Pub/Sub
- Strong Java development background.
- Experience with Spring Boot.
- Proven expertise in building CDC pipelines and distributed data processing systems.
- Track record of migrating large datasets from relational databases into BigQuery.
- Strong knowledge of automated testing (unit integration pipeline tests).
- Ability to work autonomously make architectural decisions and own end-to-end delivery.
Additional Information :
Remote Work :
Yes
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small player ... View more
