Company Overview:
Pibythree is a leading provider of data-driven solutions committed to empowering organizations through innovative technology. Our mission is to harness the power of data to drive strategic business decisions and enhance operational efficiency. We value teamwork ingenuity and a proactive approach to challenges fostering a culture where every team member can thrive and contribute to our success.
Job Summary:
We are seeking an experienced Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Data Factory (ADF) Snowflake and data warehousing concepts. The Data Engineer will be responsible for designing developing and maintaining large-scale data pipelines and architectures.
Key Responsibilities:
- Design develop and deploy data pipelines using Azure Data Factory (ADF)
- Work with Snowflake to design and implement data warehousing solutions
- Collaborate with cross-functional teams to identify and prioritize data requirements
- Develop and maintain data architectures data models and data governance policies
- Ensure data quality security and compliance with regulatory requirements
- Optimize data pipelines for performance scalability and reliability
- Troubleshoot data pipeline issues and implement fixes
- Stay up-to-date with industry trends and emerging technologies in data engineering
Requirements:
- 4 years of experience in data engineering with a focus on cloud-based data platforms (Azure preferred)
- 2 years of hands-on experience with Azure Data Factory (ADF)
- 1 year of experience working with Snowflake
- Strong understanding of data warehousing concepts data modeling and data governance
- Experience with data pipeline orchestration tools such as Apache Airflow or Azure Databricks
- Proficiency in programming languages such as Python Java or C#
- Experience with cloud-based data storage solutions such as Azure Blob Storage or Amazon S3
- Strong problem-solving skills and attention to detail
- Excellent communication and collaboration skills
Nice to Have:
- Experience with data discovery and metadata management tools such as Azure Purview or Alation
- Knowledge of data security and compliance frameworks such as GDPR or HIPAA
- Experience with containerization using Docker and Kubernetes
- Certification in Azure Data Factory Snowflake or other relevant technologies
snowflake,communication,apache airflow,c#,amazon s3,java,collaboration,azure databricks,data pipeline orchestration,python,azure data factory,azure blob storage,data modeling,problem-solving,data governance,data warehouse,data warehousing,azure data factory (adf)