DescriptionJob Overview:
As a Cloud Data Platform Engineering Specialist you will be instrumental in building and optimizing our Enterprise Data Platform on Google Cloud Platform (GCP). Your role will focus on designing developing and deploying scalable data solutions that integrate cloudnative technologies serviceoriented architectures and microservices principles. Youll also bring fullstack knowledge to the development process ensuring seamless data integration and access across various layers of the platform.
We are looking for a handson developer who has indepth knowledge in Cloud Fundamentals and Infrastructure solutions who can help to translate business requirements into key functionalities by deciding the right Cloud Technology for the use case. We will appreciate individuals who are eager to learn capable of mastering a variety of multicloud technologies and dedicated to understanding and meeting the needs of developers with empathy and precision.
Key Responsibilities:
- Design and Build Data Pipelines:Architect develop and maintain scalable data pipelines and microservices that support realtime and batch processing on GCP.
- ServiceOriented Architecture (SOA) and Microservices:Design and implement SOA and microservicesbased architectures to ensure modular flexible and maintainable data solutions.
- FullStack Integration:Leverage your fullstack expertise to contribute to the seamless integration of frontend and backend components ensuring robust data access and UIdriven data exploration.
- Data Ingestion and Integration:Lead the ingestion and integration of data from various sources into the data platform ensuring data is standardized and optimized for analytics.
- GCP Data Solutions:Utilize GCP services (BigQuery Dataflow Pub/Sub Cloud Functions etc. to build and manage data platforms that meet business needs.
- Data Governance and Security:Implement and manage data governance access controls and security best practices while leveraging GCPs native row and columnlevel security features.
- Performance Optimization:Continuously monitor and improve the performance scalability and efficiency of data pipelines and storage solutions.
- Collaboration and Best Practices:Work closely with data architects software engineers and crossfunctional teams to define best practices design patterns and frameworks for cloud data engineering.
- Automation and Reliability:Automate data platform processes to enhance reliability reduce manual intervention and improve operational efficiency.
Qualifications: Qualifications:
- Education:
- Bachelors degree in Computer Science Data Engineering Information Systems or a related field. Masters degree or equivalent experience preferred.
- Experience:
- 5 years of experience in data engineering or software engineering with at least 2 years focused on cloud data platforms (GCP preferred).
- Technical Skills:Proficient in Python Java or Scala with experience in designing and deploying cloudbased data pipelines and microservices using GCP tools like BigQuery Dataflow and Dataproc.
- ServiceOriented Architecture and Microservices:Strong understanding of SOA microservices and their application within a cloud data platform context.
- FullStack Development:Knowledge of frontend and backend technologies enabling collaboration on data access and visualization layers (e.g. React .
- Database Management:Experience with relational (e.g. PostgreSQL MySQL) and NoSQL databases as well as columnar databases like BigQuery.
- Data Governance and Security:Understanding of data governance frameworks and implementing RBAC encryption and data masking in cloud environments.
- CI/CD and Automation:Familiarity with CI/CD pipelines Infrastructure as Code (IaC) tools like Terraform and automation frameworks.
- ProblemSolving:Strong analytical skills with the ability to troubleshoot complex data platform and microservices issues.
- Certifications (Preferred):GCP Data Engineer GCP Professional Cloud Architect.
Responsibilitiessame as above
Qualificationssame as above