Apache Spark Jobs in India

AuxoAI is seeking a Senior GenAI Data Engineer with strong fundamentals in data engineering and end-to-end solution design. In this role you will design and develop production-grade pipelines leverage GenAI tools (Copilot Claude Gemini) to boost development productivity and define engineering best p...

We are seeking a ML Data Engineer with a wealth of experience creating and taking ownership of data pipelines to consume and interpret our unique GIS dataset. The analyses you deploy will range from simple stats all the way up to machine learning solutions.Our unprecedented technology requires highl...

We are a consulting company with a bunch of technology-interested and happy people! We love technology we love design and we love quality. Our diversity makes us unique and creates an inclusive and welcoming workplace where each individual is highly valued. With us each individual is her/himself an...

Position Description:Company Profile:Founded in 1976 CGI is among the largest independent IT and business consulting services firms in the world. With 94000 consultants and professionals across the globe CGI delivers an end-to-end portfolio of capabilities from strategic IT and business consulting t...

Azure Data EngineerReq number:R6811Employment type:Full timeWorksite flexibility:HybridWho we areCAI is a global technology services firm with over 8500 associates worldwide and a yearly revenue of $1 billion. We have over 40 years of excellence in uniting talent and technology to power the possible...

Job Description:Key Responsibilities:Design build and maintain data ingestion and transformation pipelines using Python and PySpark.Automate data validation and enrichment processes.Work closely with DevOps and AI teams to integrate data into analytics and AI workflows.Ensure reusability and modular...

Strong proficiency in Python and SQL including advanced SQL query writing and optimization. Experience with Google Cloud Platform (GCP) services such as BigQuery Cloud Run Data Catalog Cloud Functions IAM GCS Monitoring Workflows Cloud SQL and Secret Manager. Solid understanding of backend devel...

Total Exp-8Years Detailed JD *(Roles and Responsibilities) Hands on experience in Spark Python Proficient in Python PySpark and Object-oriented programming concepts. Proven experience as a Senior Data Engineer or similar role. Strong problem-solving techniques with an ability to troubleshoot comp...

Skill: Mandatory SQL / BigQuery GCP Good to have Python APIs GCP Dataflow & Workflows PostgreSQL Development of Web Applications (eg. React/Angular Java) JD: - Production Support (L1 L2) & Service Requests (L3: minor enhancement) for Data & Analytics solution in GCP - Support coverage unti...

Skill: Mandatory SQL / BigQuery GCP Good to have Python APIs GCP Dataflow & Workflows PostgreSQL Development of Web Applications (eg. React/Angular Java) JD: - Production Support (L1 L2) & Service Requests (L3: minor enhancement) for Data & Analytics solution in GCP - Support coverage unti...

JD: - Production Support (L1 L2) & Service Requests (L3: minor enhancement) for Data & Analytics solution in GCP - Support coverage until 12:00 am IST Weekend support in US hours - Experience in GCP services such as BigQuery/SQL Dataflow & Workflows - Monitor manage and optimize data load pipelines...

We are looking for Data Engineers!Salary: INR-/ yearResponsibilitiesCreate build and maintain data processing systems and pipelines on AWS using services like Glue EMR Lambda and S3Construct and manage data warehouses and data lakes using AWS services such as Redshift Lake Formation and Glue.Develop...

Assist in day-to-day operational tasks and support team workflowsCollaborate with team members to achieve departmental goalsMaintain accurate records and documentationParticipate in training and onboarding activitiesIdentify and communicate process improvement opportunitiesAdhere to company policies...

Assist in day-to-day operational tasks and support team workflowsCollaborate with team members to achieve departmental goalsMaintain accurate records and documentationParticipate in training and onboarding activitiesIdentify and communicate process improvement opportunitiesAdhere to company policies...

NIQ is seeking a Python Engineer with hands-on Python & Azure experience and proven analytical and problem-solving skills. The ideal candidate will be responsible for the configuration deployment and management of cloud-based functions and systems to support enterprise applications. This role involv...

About the Role:Grade Level (for internal use):10Segment: S&P Global EnergyThe Role: Senior Software DeveloperGrade 10The Team: We are looking for a highly motivated enthusiastic and skilled engineering leader for S&P Global Energy. We strive to deliver solutions that are sector-specific data-rich an...

About the Role:Grade Level (for internal use):11Segment: S&P Global EnergyThe Role: Lead Software DeveloperGrade 11The Team: We are looking for a highly motivated enthusiastic and skilled engineering leader for S&P Global Energy. We strive to deliver solutions that are sector-specific data-rich and...

Amazons Amazon Payments organization is seeking a highly quantitative experienced Business Intelligence Engineer to drive the development of analytics and insights. You will succeed in this role if you are an organized self-starter who can learn new technologies quickly and excel in a fast-paced th...

About us:As a Fortune 50 company with more than 350000 team members worldwide Target is an iconic brand and one of Americas leading retailers.Working at Target means the opportunity to help all families discover the joy of everyday life. Caring for our communities is woven into who we are and we inv...

Roles & Responsibilities Deliver training on Data Engineering fundamentals and architectures. Train on Python / SQL for data processing and analytics. Teach ETL/ELT concepts data pipelines and workflow orchestration. Provide hands-on training on Apache Spark (PySpark). Explain data warehou...