Data Engineer (Databricks) Software Engineer

Position Description
Company Profile:
Founded in 1976 CGI is among the largest independent IT and business consulting services firms in the world. With 94000 consultants and professionals across the globe CGI delivers an end-to-end portfolio of capabilities from strategic IT and business consulting to systems integration managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at

Job Title: Data Engineer
Position: Software Engineer
Experience: 2-4 Years
Category: Software Engineering
Shift: General Shift
Work Mode: Hybrid
Primary Location: Bangalore
Employment Type: Full Time

Job Description: Databricks
1. Architecture Design: Design scalable and reliable data analytics and machine learning architectures leveraging the Databricks platform to meet business requirements and objectives. 2. Platform Implementation: Implement and configure Databricks clusters; workspaces; notebooks; and other components to support data processing; analytics; and model development workflows. 3. Data Engineering: Develop and optimize data pipelines for ingesting; processing; and transforming large volumes of data from diverse sources using Databricks and related technologies. 4. Data Modeling: Design and implement data models; schemas; and storage structures within Databricks for efficient data organization and querying. 5. Machine Learning: Build and deploy machine learning models using Databricks ML frameworks and libraries; and integrate them into production workflows for predictive analytics and decision support. 6. Performance Optimization: Optimize Databricks jobs; queries; and workflows for performance; scalability; and cost efficiency; leveraging best practices and optimization techniques. 7. Security and Governance: Implement security controls; access management policies; and data governance frameworks within Databricks to ensure data privacy; compliance; and regulatory requirements. 8. Collaboration: Collaborate with data engineers; data scientists; business analysts; and stakeholders to understand requirements; design solutions; and deliver actionable insights using Databricks. 9. Documentation and Training: Document Databricks architecture; design decisions; configurations; and best practices; and provide guidance and training to team members on Databricks usage and methodologies. 10. Continuous Improvement: Stay abreast of the latest developments in Databricks and related technologies; evaluate new features and capabilities; and recommend enhancements to optimize data analytics workflows. Qualifications: 1. Experience in Oil & Gas domain preferable. 2. Proven experience designing; implementing; and managing data analytics and machine learning solutions using Databricks. 3. Strong proficiency in Apache Spark; SQL; Python; and Scala; with hands on experience developing data pipelines and machine learning models. 4. Expertise in cloud platforms such as AWS; Azure; or Google Cloud Platform; with a focus on data services and analytics offerings. 5. Experience with data engineering tools and frameworks such as Apache Kafka; Apache Airflow; and Apache Hadoop. 6. Knowledge of containerization technologies (e.g.; Docker; Kubernetes) and infrastructure as code tools (e.g.; Terraform) is a plus. 7. Excellent problem solving and analytical skills; with the ability to troubleshoot complex issues and optimize performance in distributed systems. 8. Effective communication and collaboration skills; with the ability to work with cross functional teams in a dynamic environment. 9. Databricks certification (e.g.; Databricks Certified Associate Developer; Databricks Certified Associate Data Scientist) is desirable but not mandatory.

Educational Qualification : BE/ Architecture

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our teamone of the largest IT and business consulting services firms in the world.