Data Pipeline Architect

Stefanini Group is hiring!

Stefanini is looking for Data Pipeline Architect Dearborn MI

For quick apply please reach out to Fardeen Ali at /emailprotected

Were seeking a highly skilled and experienced Full Stack Data Engineer/Architect to play a pivotal role in the development and maintenance of our Enterprise Data this role youll be responsible for designing building and optimizing scalable data pipelines within our Google Cloud Platform (GCP) environment. Youll work with GCP Native technologies like BigQuery Dataflow and Pub/Sub ensuring data governance security and optimal performance.

Responsibilities

• Data Pipeline Architect & Builder:Spearhead the design development and maintenance of scalable data ingestion and curation pipelines from diverse sources. Ensure data is standardized high-quality and optimized for analytical use. Leverage cutting-edge tools and technologies including Python SQL and DBT/Dataform to build robust and efficient data pipelines.
• End-to-End Integration Expert:Utilize your full-stack skills to contribute to seamless end-to-end development ensuring smooth and reliable data flow from source to insight.
• GCP Data Solutions Leader:Leverage your deep expertise in GCP services (BigQuery Dataflow Pub/Sub Cloud Functions etc.) to build and manage data platforms that not only meet but exceed business needs and expectations.
• Data Governance & Security Champion:Implement and manage robust data governance policies access controls and security best practices fully utilizing GCPs native security features to protect sensitive data.
• Data Workflow Orchestrator:Employ Astronomer and Terraform for efficient data workflow management and cloud infrastructure provisioning championing best practices in Infrastructure as Code (IaC).
• Performance Optimization Driver:Continuously monitor and improve the performance scalability and efficiency of data pipelines and storage solutions ensuring optimal resource utilization and cost-effectiveness.
• Collaborative Innovator:Collaborate effectively with data architects application architects service owners and cross-functional teams to define and promote best practices design patterns and frameworks for cloud data engineering.
• Automation & Reliability Advocate:Proactively automate data platform processes to enhance reliability improve data quality minimize manual intervention and drive operational efficiency.

Skills Required

Skills Preferred

Experience Required

• Bachelors degree in Computer Science Information Technology Information Systems Data Analytics or a related field (or equivalent combination of education and experience).
• 5-7 years of experience in Data Engineering or Software Engineering with at least 2 years of hands-on experience building and deploying cloud-based data platforms (GCP preferred).
• Strong proficiency in SQL Java and Python with practical experience in designing and deploying cloud-based data pipelines using GCP services like BigQuery Dataflow and DataProc.
• Solid understanding of Service-Oriented Architecture (SOA) and microservices and their application within a cloud data platform.
• Experience with relational databases (e.g. PostgreSQL MySQL) NoSQL databases and columnar databases (e.g. BigQuery).
• Knowledge of data governance frameworks data encryption and data masking techniques in cloud environments.
• Familiarity with CI/CD pipelines Infrastructure as Code (IaC) tools like Terraform and Tekton and other automation frameworks.
• Excellent analytical and problem-solving skills with the ability to troubleshoot complex data platform and microservices issues.
• Experience in monitoring and optimizing cost and compute resources for processes in GCP technologies (e.g. BigQuery Dataflow Cloud Run DataProc).

Education Required

Education Preferred

About Stefanini Group

The Stefanini Group is a global provider of offshore onshore and near shore outsourcing IT digital consulting systems integration application and strategic staffing services to Fortune 1000 enterprises around the world. Our presence is in countries like the Americas Europe Africa and Asia and more than four hundred clients across a broad spectrum of markets including financial services manufacturing telecommunications chemical services technology public sector and utilities. Stefanini is a CMM level 5 IT consulting company with a global presence. We are a CMM Level 5 company.

#LI-FA1

#LI-ONSITE