Shell Scripting/Python Developer
Shell Scripting/Python Developer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Description: ETL python and shell scripting
Key Responsibilities:
Design and develop robust and scalable ETL processes to move and transform large volumes of data from various sources.
Build and maintain data pipelines on Google Cloud Platform (GCP) using services such as Dataflow Cloud Functions BigQuery and Cloud Storage.
Automate workflows and processes using Shell Scripting and Python.
Write and optimize complex SQL queries for data manipulation and analysis in relational (e.g. PostgreSQL MySQL) and NoSQL databases.
Monitor debug and troubleshoot data pipelines to ensure their proper functioning and performance.
Document implemented processes architectures and data flows.
Skills and Qualifications
Required:
Proven experience in ETL development and/or data engineering.
Knowledge of Google Cloud Platform (GCP) especially with data services like BigQuery and Dataflow.
Proficiency in Python for data manipulation and script development (knowledge of libraries like Pandas Apache Beam is a plus).
Strong skills in Shell Scripting for task automation in Linux/Unix environments.
Extensive experience working with SQL (e.g. PostgreSQL SQL Server MySQL) and NoSQL databases. Ability to write complex and optimized queries.
Solid understanding of data modeling and data warehousing principles.
Excellent problem-solving skills and attention to detail.
Preferred:
Google Cloud certification (e.g. Professional Data Engineer).
Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
Knowledge of Agile methodologies (Scrum/Kanban).
Familiarity with container technologies like Docker and Kubernetes.
Ability to communicate effectively in English (oral and written).
hybrid scheme 3 days per week
Green credit bureau report
About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy childbirth or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability. Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy childbirth or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Employment Type
Full Time
