Data Engineer with Modelling Experience (DE)
Job Summary
Nextlink is seeking an experienced Data Engineer with strong expertise in data warehouse and graph data modelling to design develop and maintain scalable data solutions within a cloud-native Google Cloud Platform (GCP) environment. The successful candidate will possess hands-on experience across the GCP data ecosystem modern data engineering frameworks CI/CD automation infrastructure-as-code and data governance practices.
This role requires a self-driven professional who can collaborate effectively with business and technical stakeholders translate complex business requirements into robust data solutions and contribute to the delivery of large-scale enterprise data initiatives.
- Design develop and maintain scalable data pipelines and transformation frameworks.
- Build and optimize data processing solutions using BigQuery Dataform and Python.
- Develop schedule and monitor Apache Airflow DAGs within Google Cloud Composer.
- Implement and maintain CI/CD pipelines using GitLab.
- Create deploy and manage Terraform modules for infrastructure provisioning and automation.
- Design and maintain enterprise data models across data warehouse and graph databases.
- Develop and manage Cloud Spanner schemas queries indexes and data structures.
- Implement data governance metadata management and data quality practices within Google Cloud.
- Integrate and manage datasets using Google Cloud Storage (GCS) BigQuery Pub/Sub and associated GCP services.
- Collaborate with solution architects business analysts and stakeholders to understand requirements and translate them into technical solutions.
- Support platform scalability performance optimization and operational excellence initiatives.
- Participate in code reviews design reviews and continuous improvement activities.
- Strong hands-on experience with Google Cloud Platform (GCP).
- Experience designing and managing cloud-native data platforms.
- Understanding of GCP security IAM controls and best practices.
- Experience integrating GCP services including:
- BigQuery
- Cloud Storage (GCS)
- Cloud Composer
- Pub/Sub
- Cloud Spanner
- Dataform
- BigQuery
- Advanced SQL development skills including:
- Window Functions
- Arrays and Structs
- Common Table Expressions (CTEs)
- DDL and DML Operations
- User Defined Functions (UDFs)
- Window Functions
- Strong experience with BigQuery performance optimization.
- Knowledge of:
- Table partitioning and clustering
- Query optimization techniques
- BigQuery pricing models (On-Demand vs Capacity/Slots)
- Table partitioning and clustering
- Experience using Dataform for data transformation and modelling.
- Knowledge of BigQuery IAM and security controls.
- Experience implementing:
- Data Catalog / Knowledge Catalog
- Metadata management
- Policy tagging
- Data quality frameworks
- Data contracts and governance standards
- Data Catalog / Knowledge Catalog
- Experience consuming APIs and GraphQL services.
- Strong Python programming skills for data engineering and automation.
- Experience developing reusable data processing components.
- Knowledge of Python libraries and frameworks commonly used within cloud data platforms.
The successful candidate must demonstrate strong expertise in:
- Data Warehouse Modelling
- Graph Data Modelling
- Conceptual Data Modelling
- Logical Data Modelling
- Physical Data Modelling
- Normalization and Denormalization techniques
- Slowly Changing Dimensions (SCD)
- Time-Series Data Modelling
- Medallion Architecture
- Business Requirement Analysis and Model Translation
- Hands-on experience creating and managing Apache Airflow DAGs.
- Experience deploying workflows in Google Cloud Composer.
- Integration experience with:
- BigQuery
- Google Cloud Storage (GCS)
- Dataform
- BigQuery
- Knowledge of workflow orchestration monitoring troubleshooting and optimization.
- Experience managing bucket structures and storage design.
- Understanding of:
- Storage classes
- Object lifecycle management
- Retention policies
- Storage classes
- Knowledge of IAM-based access management and security controls.
- Strong understanding of source control management.
- Experience with:
- Branching strategies
- Merge requests
- Code reviews
- Repository governance
- Branching strategies
- Hands-on experience designing and implementing GitLab CI/CD pipelines.
- Knowledge of automated deployment and testing practices.
- Strong understanding of Infrastructure as Code (IaC) principles.
- Experience developing maintaining and deploying Terraform modules.
- Integration of Terraform deployment pipelines with GitLab.
- Ability to manage cloud infrastructure in a repeatable and scalable manner.
- Experience querying and managing Google Cloud Spanner.
- Strong understanding of relational database design principles.
- Expertise in:
- Primary key design
- Interleaved tables
- Secondary and global indexes
- Schema optimization
- Primary key design
- Understanding of:
- Strong consistency reads
- Stale reads
- Distributed database architecture
- Strong consistency reads
- Understanding of event-driven architectures.
- Experience working with Google Cloud Pub/Sub messaging systems.
- Knowledge of real-time data integration patterns and asynchronous processing.
- Experience working with GIS and geospatial datasets.
- Understanding of:
- Coordinate reference systems
- Coordinate transformations
- Common geospatial data formats
- Coordinate reference systems
- Experience using BigQuery GIS functions and geospatial analytics.
Experience working within telecommunications environments with understanding of:
- Network topology
- Network assets and inventory
- Performance KPIs
- Telemetry data
- Asset lifecycle management
- Proven experience engaging with business and technical stakeholders.
- Ability to communicate complex technical concepts to non-technical audiences.
- Experience working on large-scale enterprise transformation and data platform projects.
- Strong problem-solving planning and delivery skills.
- Experience with Google Dataflow and Apache Beam.
- Knowledge of streaming data architectures.
- Exposure to graph databases and advanced analytics platforms.
- Experience within highly regulated enterprise environments.
- Bachelors degree in Computer Science Information Technology Engineering Data Science or related discipline.
- Relevant Google Cloud certifications will be highly regarded:
- Professional Data Engineer
- Professional Cloud Architect
- Associate Cloud Engineer
- Professional Data Engineer
Required Skills:
710 years of experience in Java/J2EE development Strong experience with Spring Spring Boot Hibernate and Microservices architecture Hands-on experience with Java 8 / JEE technologies Experience building applications using Spring Framework or similar web frameworks Strong understanding of multi-threading HTTP protocols REST API design and SOAP web services Minimum 2 years of hands-on experience in Python development Experience with Python web frameworks such as Django Flask or FastAPI Strong understanding of object-oriented programming and design principles Experience integrating RESTful APIs and third-party services Knowledge of relational and non-relational databases including Oracle MySQL PostgreSQL and MongoDB Experience with in-memory cache technologies such as Redis or Hazelcast Hands-on experience with React for UI development Expertise in HTML5 JavaScript jQuery and modern frontend technologies Experience with Git and version control systems Basic understanding of CI/CD pipelines DevOps practices and cloud environments Experience working in banking or regulated industry methodologies