Big data ETL Consultant_EY_FTE
Big data ETL Consultant_EY_FTE
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
This is an immediate and critical requirement for our client EY Project MasterCard. We are looking for Big data ETL Consultant with 5.5 years of relevant experience.
Location-Pune.
Budget- Up to 25 LPA
Experience - 5.5
Mandatory:- Big data(Hadoop) ETL Data Warehousing Scripting language
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive digital economy that benefits everyone everywhere by making transactions safe simple smart and accessible. Using secure data and networks partnerships and passion our innovations and solutions help individuals financial institutions governments and businesses realize their greatest potential.
Our decency quotient or DQ drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories we are building a sustainable world that unlocks priceless possibilities for all.
Overview
Mastercard is looking for a Senior Software Test Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders with increasing disposable income and more refined preferences ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage to drive loyalty and spend.
*The immediate needs in project also require some exposure to Big data (Hadoop/Databricks) environment - test data preparations/executions with huge volumes Unix shell scripting/executions & plsql etc**
For ETL^
Job Description- Big Data Test Engineer with Python/Shell Script Automation
Role:
Support Development and maintain automated test frameworks tools and test cases for Data Engineering and Data Warehouse applications.
Collaborate with cross-functional teams including software developers data engineers and data analysts to ensure comprehensive testing coverage and adherence to quality standards.
Conduct thorough testing of data pipelines ETL processes and data transformations using Big Data technologies.
Apply your knowledge of Data Warehouse/Data Lake methodologies and best practices to validate the accuracy completeness and performance of our data storage and retrieval systems.
Identify document and track software defects working closely with the development team to ensure timely resolution.
Participate in code reviews design discussions and quality assurance meetings to provide valuable insights and contribute to the overall improvement of our software products.
Base Skill Requirements:
Must Technical
Bachelors or Masters degree in Computer Science Engineering or a related field.
5-9 years of experience in software testing and development with a focus on data-intensive applications.
Proven experience in testing data pipelines and ETL processes - Test planning Test Environment planning End to End testing Performance testing.
Solid programming skills in Python - proven automation effort to bring efficiency in the test cycles.
Solid understanding of Data models and SQL .
Must have experience with ETL (Extract Transform Load) processes and tools (Scheduling and Orchestration tools ETL Design understanding)
Good understanding of Big Data technologies like Spark Hive and Impala.
Understanding of Data Warehouse methodologies applications and processes.
Experience working in an Agile/Scrum environment with a solid understanding of user stories acceptance criteria and sprint cycles.
Optional Technical
Experience with scripting languages like Bash or Shell.
Experience working with large-scale datasets and distributed data processing frameworks (e.g. Hadoop Spark).
Familiarity with data integration tools like Apache NiFi is a plus.
Excellent problem-solving and debugging skills with a keen eye for detail.
Strong communication and collaboration skills to work effectively in a team-oriented environment.
Eagerness to learn and contribute to a growing team.
Employment Type
Full-time
