Data Engineering Cloud Data Platform Engineering

Company Name: VARITE India Private Limited

About The Client:

Client is a pioneering Software Engineering and IT consultancy company transforming and executing at the intersection of Domain and Technology to create digital leaders for our people clients partners and communities.

About The Job:

• Primary Skill: Data Engineer
• Experience: 57 Years
• We are looking for an experienced Data Engineer to design develop and maintain scalable cloud-based data platforms and data pipelines.
• The ideal candidate will have strong hands-on experience with PySpark AWS Glue Amazon Redshift and data pipeline orchestration along with a solid understanding of modern data engineering practices.
• The candidate will work closely with business analytics and technology teams to build reliable scalable and high-performance data solutions on AWS.

Essential Job Functions:

• Design develop and maintain scalable data pipelines and cloud data platforms.
• Develop data transformation and processing solutions using PySpark.
• Build and maintain ETL/ELT workflows using AWS Glue.
• Design optimize and manage data workloads in Amazon Redshift.
• Implement and manage data pipeline orchestration scheduling monitoring and dependency management.
• Perform data ingestion transformation cleansing validation and integration across multiple data sources.
• Optimize data processing jobs and queries for performance scalability and cost efficiency.
• Implement data quality checks error handling logging and monitoring mechanisms.
• Troubleshoot pipeline failures and production data issues and ensure timely resolution.
• Collaborate with data architects analysts application teams and other stakeholders to understand data requirements.
• Follow best practices for data security governance reliability and operational support.
• Contribute to the continuous improvement and automation of data engineering processes.

Qualifications:

• 57 years of hands-on experience in Data Engineering.
• Strong programming experience with PySpark / Apache Spark.
• Hands-on experience with AWS Glue for ETL/data processing.
• Strong experience with Amazon Redshift including data loading querying and performance optimization.
• Experience designing and implementing data pipelines and orchestration workflows.
• Strong SQL skills and experience working with large datasets.
• Good understanding of ETL/ELT concepts data integration and data transformation.
• Experience with cloud-based data engineering architectures preferably on AWS.
• Strong analytical and troubleshooting skills.
• Good communication and collaboration skills.

• Experience with additional AWS data services such as S3 Lambda Step Functions EMR or Athena.
• Experience with workflow orchestration tools such as Apache Airflow or equivalent.
• Knowledge of data warehousing and dimensional modeling concepts.
• Experience with CI/CD and DevOps practices for data engineering.
• Familiarity with data quality metadata management and data governance.
• Experience working in Agile/Scrum development environments.

• Bachelors degree in Computer Science Information Technology Engineering or a related discipline.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes and for additional job opportunities please visit Jobs In India VARITE.

Unlock Rewards:

Refer Candidates and Earn.

If youre not available or interested in this opportunity please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program where youll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

0-2 years INR 5000

2-6 years INR 7500

6 years INR 10000

About VARITE:

VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA UK CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking Cloud Infrastructure Hardware and Software Digital Marketing and Media Solutions Clinical Diagnostics Utilities Gaming and Entertainment and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race color religion sex sexual orientation gender identity or expression national origin age marital status veteran status or disability status.