Lead Big Data Spark Engineer
Lead Big Data Spark Engineer
Posted on :
03-05-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Infosys is seeking a Lead Big Data Spark Engineer.In this roleyou will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation Application Architecture definition and Design. You will play an important role in creating the highlevel design artifacts. You will also deliver high quality code deliverables for a module lead validation for all types of testing and support activities related to implementation transition and warranty. You will be part of a learning culture where teamwork and collaboration are encouraged excellence is rewarded and diversity is respected and valued.
Candidate must be located within commuting distance ofAustin TX / Sunnyvale CAor be willing to relocate to the position may require travel within the US and Canada.
RequiredQualifications:
Candidate must be located within commuting distance ofAustin TX / Sunnyvale CAor be willing to relocate to the position may require travel within the US and Canada.
RequiredQualifications:
- Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4years of experience in Information Technology.
- Experience with Hadoop distributed frameworks while handling large amount of data using Spark or PySpark and Hadoop Ecosystems.
- Proven experience in data engineering data architecture or a related field
- Experience with Spark or PySpark is required.
- Strong understanding of data modeling data warehousing and ETL concepts
- Proficiency in SQL and experience with at least one major data analytics platform such as Hadoop or Spark
- Experience with Scala or Python is required.
Preferred Qualifications:
- Experience in understanding of Design Patterns ability to discuss tradeoffs between RDBMS vs Distributed Storage
- At least 3years of Experience with Spark or PySpark Python Scala and Data Engineering
- Experience in design and implementing a tiered data architecture that integrates analytics data from multiple sources in an efficient and effective manner.
- Experience with data orchestration tools like Airflow is a nice to have.
- Excellent problemsolving and analytical skills and the ability to work well under tight deadlines.
- Excellent interpersonal skills and the ability to collaborate effectively with crossfunctional teams.
- Experience in developing data models and mapping rules to transform raw data into actionable insights and reports.
- Experience in collaborating with the analytics and business teams to understand their requirements with crossfunctional teams to define and implement data governance policies and standards.
- Experience in developing data validation and reconciliation processes to ensure data quality and accuracy is met.
- Experience with development and maintenance of user documentation including data models mapping rules and data dictionaries.
The job entails extensive amount of travel. The job also entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone email or face to face.
Estimated annual compensation range for candidate based in the below locations will be:
Sunnyvale CA
Along with competitive pay as a fulltime Infosys employee you are also eligible for the following benefits :
- Medical/Dental/Vision/Life Insurance
- Longterm/Shortterm Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident Critical Illness Hospital Indemnity Legal)
- 401(k) plan and contributions dependent on salary level
- Paid holidays plus Paid Time Off
About Us
Infosys is a global leader in nextgeneration digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AIpowered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our alwayson learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem.
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy childbirth or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
