Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
16 hours ago
Vacancies:
1 Vacancy
Job Summary
Requisition ID: 241837
Thanks for your interest in ScotiaTech Scotiabanks new and innovative Technology hub in Bogota.
Join a purpose driven winning team that promotes creativity and innovation in a fast-paced environment where were always committed to results in an inclusive diverse and high-performing culture.
Purpose
The Senior Data Engineer will lead the design development and maintenance of scalable data products and pipelines on Google Cloud Platform (GCP). This role is critical in driving data-driven decision-making by building robust efficient and secure data infrastructure. The Senior Data Engineer will oversee a team of up to three Data Engineers providing technical guidance and ensuring high-quality delivery of data solutions that support business objectives.
Accountabilities
Design build and optimize data pipelines and architectures on GCP to support data products ensuring scalability reliability and performance.
Lead a team of up to three Data Engineers providing mentorship technical direction and performance feedback.
Collaborate with cross-functional teams (e.g. Data Scientists Product Managers and Software Engineers) to understand requirements and deliver data products that align with business goals.
Implement best practices for data governance security and compliance within GCP environments.
Monitor and maintain data infrastructure ensuring high availability data quality and efficient processing.
Drive the adoption of modern data engineering tools and methodologies including ETL/ELT processes data modeling and orchestration.
Troubleshoot and resolve complex data pipeline issues ensuring minimal downtime and optimal performance.
Contribute to the evaluation and integration of new GCP services and third-party tools to enhance data capabilities.
Reporting Relationships
Primary Manager: Director International Analytics Engineering
Direct Reports: NA
Shared Reports : NA
Dimensions NA
Education / Experience / Other Information
Education: Bachelors degree in Computer Science Data Engineering Information Systems or a related field. A Masters degree is a plus.
Experience:
7 years of experience in data engineering with at least 3 years focused on building data solutions in Google Cloud Platform (GCP).
Proven expertise in designing and implementing data pipelines using GCP tools such as BigQuery Dataflow Dataproc Pub/Sub and Cloud Composer.
2 years of experience leading or mentoring a team of engineers with a track record of successful project delivery.
Strong proficiency in programming languages such as Python Java or Scala and SQL for data processing.
Hands-on experience with data modeling schema design and data warehousing concepts.
Familiarity with CI/CD pipelines version control (e.g. Git) and Infrastructure as Code (e.g. Terraform) is preferred.
Knowledge of data governance security practices and compliance standards (e.g. GDPR CCPA) in cloud environments.
Excellent problem-solving skills and the ability to communicate complex technical concepts to non-technical stakeholders.
Competencies
Experience with cloud-based data platforms (e.g. AWS Azure Google Cloud).
Knowledge of advanced statistical techniques or machine learning fundamentals.
Familiarity with Agile or Scrum methodologies.
Working Conditions
Work in a standard office-based environment; non-standard hours are a common occurrence
Location(s): Colombia : Bogota : Bogota
ScotiaTech is a business unit within ScotiaGBS a Scotiabank Group company located in Bogota Colombia. The ScotiaTech hub was created to support different technology systems and processes of the Bank. We offer an inclusive positive work environment and competitive benefits.
At ScotiaTech we value the unique skills and experiences each individual brings and are committed to creating and maintaining an inclusive and accessible environment for must apply directly online to be considered for this role. We thank all applicants for their interest in a career at ScotiaTech; however only those candidates who are selected for an interview will be contacted.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Scotiabank is one of the leading foreign banks serving large national and multinational corporations in the U.S. through its Global Banking and Markets, Global Transaction Banking and Wealth Management business lines.
