Lead Analyst Lead Bigdata Developer with Python, PySpark & SQL

Position Description:

Company Profile:
Were Hiring at CGI for our GCC - Right Here in Hyderabad!
Join us at the intersection of technology finance and innovation. You will be working to support the PNC Financial Services Group one of the top-tier financial institutions in the U.S. Youll help shape digital solutions for a global enterprisefrom the ground up.
This is more than a job. Its your opportunity to:
Work on cutting-edge technologies
Collaborate with global teams
Build a career with purpose and impact
Ready to build the future of banking Lets talk.

Job Title: Lead Analyst - Lead Bigdata Developer with Python PySpark & SQL
Position Title: Lead Analyst - Lead Bigdata Developer with Python PySpark & SQL
Experience: 8 Years
Category: Technology/Software Development
Main location: Hyderabad
Shift Timings: General Shift
Employment Type: Full Time-Permanent
Position ID: J0325-2096

Job Summary:
CGI is looking for a Lead Big Data Developer who will design build and optimize large-scale data pipelines and processing systems.
The ideal candidate is a hands-on technologist with deep expertise in Python PySpark and SQL capable of leading data initiatives mentoring team members and ensuring delivery of high-performance data solutions across the organization.

Your future duties and responsibilities:

Lead the design and development of scalable efficient and reliable data pipelines using PySpark Python and SQL.
Collaborate with data architects analysts and business stakeholders to understand data requirements and translate them into technical solutions.
Optimize data workflows for performance scalability and cost efficiency in big data environments (e.g. Databricks EMR GCP DataProc or similar).
Implement data ingestion transformation and aggregation processes from multiple structured and unstructured sources.
Ensure data quality integrity and consistency through validation testing and monitoring frameworks.
Work with cloud-based data platforms (AWS Azure or GCP) and leverage tools like S3 Delta Lake or Snowflake.
Design and enforce best practices for coding version control and CI/CD within the data engineering team.
Provide technical leadership and mentorship to junior and mid-level developers.
Collaborate with DevOps and DataOps teams for deployment and operationalization of data solutions.
Stay updated with the latest technologies and trends in the big data ecosystem.

Required qualifications to be successful in this role:

Required Skills & Experience:-
8 years of experience in data engineering or big data development with at least 3 years in a lead or senior role.
Strong proficiency in Python for data processing scripting and automation.
Advanced hands-on experience with PySpark (RDD DataFrame and Spark SQL APIs).
Deep expertise in SQL (query optimization analytical functions performance tuning).
Strong understanding of distributed data processing and data lake architectures.
Experience working with Hadoop ecosystem (Hive HDFS Spark Kafka etc.).
Hands-on experience with cloud platforms (AWS Azure or GCP) and data orchestration tools (Airflow ADF etc.).
Solid understanding of data modeling ETL design and performance optimization.
Experience with version control (Git) and CI/CD pipelines for data projects.
Excellent communication and leadership skills with the ability to guide cross-functional teams.

Preferred Qualifications:-
Experience with Delta Lake / Apache Iceberg / Hudi.
Knowledge of containerization and orchestration (Docker Kubernetes).
Exposure to machine learning pipelines or data science integration.
Certification in AWS Big Data / GCP Data Engineer / Azure Data Engineer is a plus.

Education:-
Bachelors or masters degree in computer science Information Technology or a related field.

#LI-SP40

Skills:

• English
• Python
• SQL
• Analytical Thinking

What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our teamone of the largest IT and business consulting services firms in the world.