Master Data Engineer
Master Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
At Capital One India we operate in a fastpaced and intellectually stimulating environment to solve complex business problems at scale. Using cuttingedge technology and datadriven solutions we focus on building highly scalable and efficient data platforms that enable observability analytics and governance for critical business functions.
We are looking for a Master Data Engineer to drive the development of highperformance data ingestion pipelines and scalable observability data stores. The ideal candidate will have a strong foundation in software engineering and data engineering principles with a focus on designing and implementing cloudnative solutions. This role requires handson expertise in architecting resilient data pipelines and distributed storage solutions that support realtime and batch processing at scale.
What Youll Do:
Lead the design development and optimization of scalable data ingestion pipelines and observability data stores.
Architect and implement cloudnative data solutions to support realtime analytics and monitoring.
Work closely with crossfunctional teams including software engineers data scientists and platform teams to enhance data infrastructure and observability capabilities.
Build and optimize distributed data storage solutions leveraging scalable indexing and search frameworks such as OpenSearch.
Develop and maintain efficient ETL/ELT processes for structured and unstructured data sources.
Ensure high availability reliability and security of data platforms through automation monitoring and best practices.
Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
Contribute to architectural decisions code reviews and technical mentorship within the team.
Required Qualifications:
710 years of experience in data engineering software engineering or a related field.
Strong expertise in building scalable data ingestion pipelines using distributed processing frameworks.
Handson experience with designing and optimizing data stores for largescale observability and analytical workloads.
Proficiency in cloud services (AWS preferred) and infrastructureascode tools.
Solid programming skills in Python Java or Scala for building robust data solutions.
Familiarity with indexing and search engines such as OpenSearch or Elasticsearch.
Strong problemsolving skills and ability to work in a collaborative agile environment.
Preferred Qualifications:
Experience working with log analytics metrics collection and observability platforms.
Knowledge of microservices eventdriven architectures and APIbased data integration.
Familiarity with Kubernetes Docker and DevOps practices for data pipeline deployment.
Exposure to Machine Learning Observability and monitoring frameworks.
If you have visited our website in search of information on employment opportunities or to apply for a position and you require an accommodation please contact Capital One Recruiting ator via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital Ones recruiting process please send an email to
Capital One does not provide endorse nor guarantee and is not liable for thirdparty products services educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).
Employment Type
Full-Time
