Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
21 hours ago
Vacancies:
1 Vacancy
Job Summary
We are looking for an experienced Senior Data Engineer to design build and optimize data pipelines storage solutions and data-driven systems within our technology organization. The ideal candidate has strong hands-on experience with Python and MongoDB combined with a solid understanding of data modeling data processing frameworks and scalable data architectures. This role requires technical leadership ownership of end-to-end data engineering tasks and the ability to collaborate effectively within cross-functional teams.
Key Responsibilities
- Design develop and maintain scalable data pipelines ETL/ELT workflows and data processing jobs using Python.
- Architect and optimize MongoDB databases including data modeling indexing and performance tuning.
- Implement data ingestion transformation and integration solutions from diverse data sources.
- Ensure data quality reliability and consistency across systems through testing and validation.
- Collaborate with analytics product and engineering teams to support data requirements and deliver data-driven solutions.
- Develop automation for data workflows monitoring and error handling.
- Ensure adherence to data security compliance and governance best practices.
- Contribute to architecture decisions performance optimization strategies and continuous improvement initiatives.
- Mentor junior team members in data engineering best practices.
Qualifications :
Required Skills & Qualifications
- 510 years of experience in Data Engineering or similar technical roles.
- Strong hands-on expertise with Python for data processing automation and application development.
- Deep experience with MongoDB including schema design aggregation pipelines indexing strategies and optimization.
- Solid understanding of data engineering fundamentals: ETL/ELT data modeling structured/unstructured data handling and distributed systems concepts.
- Experience working with data pipelines job orchestration tools and workflow scheduling.
- Knowledge of API integration data ingestion techniques and handling high-volume datasets.
- Experience working in agile software development environments.
- Strong analytical problem-solving and communication skills.
Preferred Qualifications
- Experience with cloud platforms (AWS Azure or GCP).
- Familiarity with streaming technologies (Kafka Kinesis Pulsar).
- Experience with data orchestration tools (Airflow Prefect Dagster).
- Knowledge of DevOps practices related to data engineering (CI/CD containerization monitoring).
Additional Information :
At Endava were committed to creating an open inclusive and respectful environment where everyone feels safe valued and empowered to be their best. We welcome applications from people of all backgrounds experiences and perspectivesbecause we know that inclusive teams help us deliver smarter more innovative solutions for our customers. Hiring decisions are based on merit skills qualifications and potential. If you need adjustments or support during the recruitment process please let us know.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with our customers to create technological solutions that drive?innovation and transfor ... View more
