Primary Skills
- MapReduce HDFS Spark - Pyspark ETL Fundamentals SQL SQL (Basic Advanced) Spark - Scala Python Data Warehousing Hive Modern Data Platform Fundamentals Data Modelling Fundamentals PLSQL T-SQL Stored Procedures Oozie
Job requirements
- Primary Skills (Must Have) : Programming language: Python / Java / Scala Framework: Spark Hadoop Declarative language: SQL Secondary Skills (Good to Have) : Databricks AWS Scope of Work :
- Developing and maintaining Big Data ETL jobs.
- Conducting data analysis and profiling.
- Collaborating with cross-functional teams (e.g. data scientists business analysts) to align data engineering solutions with business objectives.
- Automating data workflows to increase system efficiency and reduce manual intervention.
- Monitoring troubleshooting and optimizing data pipelines to ensure high performance and reliability.
- Ensuring data security and compliance with Mastercard policies and industry standards.
- Role of Resource : Senior Data Engineer Role USP : Opportunity to work on cutting-edge Big Data technologies like Spark Databricks Cloud services with a focus on optimizing and scaling data processing pipelines.
- If Domain knowledge required : Banking / Mastercard data knowledge is an added advantage and preferable.
- Experience Range : 5 to 10 years
Required Experience:
Contract
Lead Data EngineerPrimary SkillsMapReduce HDFS Spark - Pyspark ETL Fundamentals SQL SQL (Basic Advanced) Spark - Scala Python Data Warehousing Hive Modern Data Platform Fundamentals Data Modelling Fundamentals PLSQL T-SQL Stored Procedures Oozie Job requirementsPrimary Skills (Must Have) : Programm...
Primary Skills
- MapReduce HDFS Spark - Pyspark ETL Fundamentals SQL SQL (Basic Advanced) Spark - Scala Python Data Warehousing Hive Modern Data Platform Fundamentals Data Modelling Fundamentals PLSQL T-SQL Stored Procedures Oozie
Job requirements
- Primary Skills (Must Have) : Programming language: Python / Java / Scala Framework: Spark Hadoop Declarative language: SQL Secondary Skills (Good to Have) : Databricks AWS Scope of Work :
- Developing and maintaining Big Data ETL jobs.
- Conducting data analysis and profiling.
- Collaborating with cross-functional teams (e.g. data scientists business analysts) to align data engineering solutions with business objectives.
- Automating data workflows to increase system efficiency and reduce manual intervention.
- Monitoring troubleshooting and optimizing data pipelines to ensure high performance and reliability.
- Ensuring data security and compliance with Mastercard policies and industry standards.
- Role of Resource : Senior Data Engineer Role USP : Opportunity to work on cutting-edge Big Data technologies like Spark Databricks Cloud services with a focus on optimizing and scaling data processing pipelines.
- If Domain knowledge required : Banking / Mastercard data knowledge is an added advantage and preferable.
- Experience Range : 5 to 10 years
Required Experience:
Contract
View more
View less