Senior Data Engineer Spark Python AWSAzure
Senior Data Engineer Spark Python AWSAzure
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We are seeking a skilled Senior Data Engineer to join our team in Chiinu Moldova. In this role you will be responsible for designing implementing and maintaining robust data infrastructure and pipelines to support our organizations datadriven decisionmaking processes.
- Design develop and maintain scalable data pipelines using Python and cloud technologies (AWS/Azure)
- Design implement and maintain complex data engineering solutions to acquire and prepare data.Create and maintain data pipelines to connect data within and between data stores applications and organizations
- Carry out complex data quality checking and remediation
- Optimize data storage and retrieval systems for improved performance and efficiency
- Collaborate with data scientists and analysts to understand data requirements and provide efficient solutions
- Ensure data quality integrity and security throughout the data lifecycle
- Develop and maintain documentation for data processes and architectures
- Stay uptodate with emerging technologies and best practices in data engineering
- Troubleshoot and resolve datarelated issues in a timely manner
Qualifications :
- Bachelors degree in Computer Science Engineering or a related field
- 2 years of experience in data engineering or similar role
- Strong experience in Python programming language Python based pipeline jobs Apache Spark PySpark
- Knowledge of AWS and/or Azure cloud platforms
- Expertise in SQL and NoSQL databases (MongoDB)
- Proficiency in designing and implementing ETL processes
- Solid Data Lake/Data Warehouse principles techniques and technologies Star Schema SQL (data formats Apache Iceberg Parquet Avro)
- Knowledge of and experience working with of APIs (designing with OpenAPI is desirable) and web services CI/CD pipelines
- Some knowledge of Kubernetes and cloud native practices containerized workloads with tools such as Docker
- Experience of modern software and data engineering patterns including those used in highly scalable distributed and resilient systems
- Experience developing microservicesbased architectures including distributed messaging patterns is a plus
- Experience of high volume IoT domain would be great but not essential
- Knowledge of data security and compliance best practices
- Excellent problemsolving and analytical skills
- Strong communication and teamwork abilities
- Relevant cloud certifications (e.g. AWS Certified Data Analytics Azure Data Engineer Associate Databricks or Snowflake) are a plus
Additional Information :
Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package share plan company performance bonuses valuebased recognition awards referral bonus;
- Career Development: Career coaching global career opportunities nonlinear career paths internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects rotations internal tech communities training certifications coaching online learning platforms subscriptions passiton sessions workshops conferences;
- WorkLife Balance: Hybrid work and flexible working hours employee assistance programme;
- Health: Global internal wellbeing programme access to wellbeing apps;
- Community: Global internal tech communities hobby clubs and interest groups inclusion and diversity programmes events and celebrations.
Our diversity makes us stronger it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us regardless of background identity or personal characteristics feels valued respected and free from discrimination. As an equal opportunity employer we welcome applications from all individuals and base hiring decisions on merit skills qualifications and potential.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
