GCP Data Engineering Consultant

As a GCP Data Engineering Consultant at Wipro Technologies you will be at the forefront of designing and implementing robust scalable data solutions enabling vital business intelligence and analytics capabilities. You will leverage the comprehensive suite of Google Cloud Platform services to create optimize and maintain data pipelines and platforms that support critical data-driven decision-making across diverse business units.

In this role you will translate complex business needs into efficient technical designs build state-of-the-art ETL/ELT pipelines and champion cloud modernization initiatives. Your expertise will drive seamless integration of batch and real-time data workflows ensuring consistent data availability and integrity for reporting analytics and business applications. You will also play a pivotal role in migrating legacy data workloads to modern GCP-native architectures thereby enhancing performance scalability and cost-efficiency.

This position offers an exciting opportunity to collaborate with multi-disciplinary teamsincluding data architects analysts and product ownerswhile continually refining practices for data governance security monitoring and operational excellence. By joining us you will contribute to transforming data into actionable insights that empower Wipros clients to achieve their digital transformation goals.

• Design develop and sustain scalable and performant ETL/ELT data pipelines employing a broad selection of Google Cloud technologies such as BigQuery Cloud Storage Dataflow Dataproc Cloud Composer Data Fusion Pub/Sub and Cloud Functions.
• Collaborate closely with business stakeholders and technical teams to accurately translate business objectives into comprehensive technical specifications and detailed data flow designs.
• Establish robust data ingestion and integration frameworks capable of handling a variety of data formats and sourcesincluding databases APIs cloud storage solutions and streaming data platformsto ensure seamless data availability.
• Develop and optimize data transformation processes using Python PySpark SQL BigQuery SQL and Apache Beam where appropriate ensuring high data quality and consistency.
• Implement both batch and real-time data processing solutions guaranteeing timely reliable and accurate data delivery for downstream consumption.
• Manage complex orchestration workflows via Cloud Composer and Apache Airflow including DAG creation and maintenance scheduling monitoring failure handling and dependency resolution.
• Design optimize and administer BigQuery datasets tables views stored procedures partitioning and clustering strategies as well as access control mechanisms promoting data security and efficiency.
• Lead migration initiatives focusing on modernizing legacy data platforms and migrating them to cloud-native GCP environments ensuring minimal disruption and optimized performance.
• Conduct comprehensive data validation and reconciliation apply rigorous data quality assessments and assist with thorough unit integration and smoke testing procedures during development and production phases.
• Troubleshoot pipeline failures investigate runtime and configuration errors resolve performance bottlenecks and correct data inconsistencies to maintain uninterrupted data service.
• Implement and maintain CI/CD pipelines for data solution deployments using Git-based workflows Cloud Build Jenkins or other modern DevOps platforms fostering automation and consistent releases.
• Apply Google Cloud best practices to ensure solutions are scalable reliable secure governed effectively monitored proactively cost-conscious and aligned with operational excellence frameworks.
• Engage with cross-functional teams including architects data governance specialists product owners and BI units to deliver holistic data engineering solutions that meet strategic goals.
• Document all aspects of data pipeline design data lineage source-to-target mappings operational procedures troubleshooting guides and deployment manuals to facilitate knowledge sharing and support continuity.

• Proven hands-on expertise in Google Cloud Platform data engineering services demonstrating strong command over deploying cloud-native data solutions.
• Deep proficiency with BigQuery including SQL scripting optimization techniques data modeling partitioning clustering stored procedures and secure access management.
• Structured experience working with Cloud Storage Dataflow Dataproc Cloud Composer/Apache Airflow Data Fusion Pub/Sub and Cloud Functions to design comprehensive data workflows.
• Advanced programming skills in Python and PySpark targeted at implementing efficient data processing automation and transformation logic suited to analytical workloads.
• Capability in writing and optimizing complex SQL queries involving multiple joins window functions DDL/DML operations and performance improvements.
• Strong understanding of contemporary data architectures and methodologies such as data lakes data warehouses lakehouses ETL/ELT pipelines batch processing streaming data integration and enterprise data platforms.
• Experience with cloud migration projects including re-architecting modernizing and transitioning on-premise data warehouses and workloads to Google Cloud Platform environments.
• Familiarity with Git version control workflows branching strategies code reviews and approval processes supporting collaborative development and deployment pipelines.
• Competence with CI/CD automation tools such as Jenkins Cloud Build GitHub Actions GitLab CI or equivalents facilitating frequent reliable and automated delivery of data solutions.
• Knowledge of Unix/Linux environments and shell scripting to support automation monitoring and operational maintenance tasks within cloud ecosystems.
• Strong analytical and troubleshooting skills to diagnose root causes optimize pipeline performance and provide timely production support in fast-paced mission-critical environments.

• Being Respectful: Prioritize inclusive communication and demonstrate respect for diverse perspectives and contributions within teams and stakeholders.
• Always Communicating: Maintain transparent timely and effective communication channels to ensure alignment and shared understanding across all project phases.
• Demonstrating Stewardship: Take ownership and responsibility for the quality security and sustainability of data engineering solutions and processes.
• Being Responsive: React promptly and flexibly to evolving business requirements technical challenges and operational incidents.
• Building Trust: Establish credibility through consistent delivery ethical practices and collaborative problem-solving with colleagues and clients alike.

At Wipro Technologies we are committed to building a modern innovative organization poised to drive digital transformation across industries worldwide. As an end-to-end technology partner our mission is to empower individuals and enterprises to redefine their future through technology and innovation.

Joining our team means embarking on a career path rich with opportunities for growth skill enhancement and meaningful impact. We encourage creativity continuous learning and leadership while fostering a culture built on respect diversity and integrity.

If you are passionate about transforming data into actionable insights and aspire to shape large-scale cloud data solutions that power transformative business outcomes Wipro Technologies is the ideal place to grow and innovate alongside talented peers.

We seek individuals with 8-10 years of hands-on experience specializing in GCP BigQuery and related technologies who are ready to contribute immediately to complex projects while advancing their expertise within a stimulating supportive environment.

Reinvent your world. Join Wipro a business powered by purpose and passion where you are empowered to design your own professional reinvention.