SrAI platform engineer
SrAI platform engineer
Posted on :
18-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Description
Responsibilities
Qualifications
- Data Architecture: Design build and optimize GCPbased data pipelines (streaming/Batch) using services like BigQuery Dataflow Dataproc Pub/Sub and Cloud Composer. Architect data lakes/warehouses for structured and unstructured data.
- Pipeline Development: Implement ETL/ELT workflows and integrate data from heterogeneous sources (APIs databases streaming platforms) using tools like Spark Apache Beam DBT and Kafka.
- GCP Expertise: Proficiency in BigQuery Dataflow Dataproc Cloud SQL Pub/Sub logging and monitoring.
- Programming: Strong coding skills in Python SQLJava and familiarity with Apache Spark
- DevOps & IaC: Experience with Terraform Kubernetes and CI/CD pipelines for infrastructure automation
- Data Modeling: Working Knowledge of relational NoSQL (Bigtable Firestore) and Vector databases.
- Governance & Compliance: Enforce data security encryption and governance standards (GDPR CCPA) using GCP tools like Cloud KMS and IAM policies
- Collaboration: Partner with data scientists DevOps and business teams to deploy AI/ML models BI dashboards (PowerBI LookerQlik) and realtime analytics solutions
- Operational Excellence: Automate CI/CD pipelines monitor system performance and troubleshoot issues using Terraform Jenkins and GCP monitoring tools
Responsibilities
- Develop data engineering pipelines frameworks focused on modularity & Data craftsmanship in GCP.
- Hands an individual contributor for Log data management analytics integration with observability and AIOps platforms.
- Democratize Data as a service API for all interfacing systems.
Qualifications
- As a senior engineer ensure the data pipelines built by teams are robust scalable and meets the highest standards.
- Execute data governance and data quality projects.
- Serve as role model for data engineering experts with strong emphasis on bias towards action.
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
