Job Title: Full Stack Data Engineer with Cloud Security Focus. Direct Hire Remote position.
Job Description: We are seeking a highly skilled Full Stack Data Engineer with a strong focus on cloud security to join our team. The ideal candidate will have extensive experience in implementing and integrating data management tools such as Prisma Scout and Collibra into cloud environments. This role requires proficiency in Azure Data Services including Azure Databricks and Azure Data Factory as well as expertise in building CI/CD pipelines and implementing DevOps practices using tools like Git GitHub Actions or Jenkins. A critical aspect of this position is ensuring robust cloud security and implementing security tools within our data infrastructure.
Key Responsibilities:
Data Pipeline Development: Design develop and maintain scalable data pipelines using Azure Data Factory and Azure Databricks to process and analyze large datasets.
Tool Integration: Implement and integrate data management and governance tools such as Prisma Scout and Collibra into the existing data environment to enhance data quality and compliance.
Cloud Security Implementation: Focus on cloud security by implementing security tools and best practices within the Azure environment ensuring data protection and compliance with industry standards.
CI/CD Pipeline Construction: Develop and maintain continuous integration and continuous deployment (CI/CD) pipelines using tools like Git GitHub Actions or Jenkins to streamline development processes and ensure code quality.
DevOps Collaboration: Work closely with DevOps teams to implement and manage infrastructure as code automate deployments and monitor system performance.
Data Mirroring and Replication: Utilize native mirroring functions to ensure data redundancy availability and disaster recovery capabilities.
Documentation and Compliance: Maintain comprehensive documentation of data workflows security protocols and integration processes to support compliance and audit requirements
Qualifications:
Bachelors degree in Computer Science Information Technology or a related field.
Minimum of 5 years of experience in data engineering with a focus on full stack development and cloud security.
Technical Proficiency:
Extensive experience with Azure Data Services including Azure Databricks and Azure Data Factory.
Proficiency in integrating data management tools such as Prisma Scout and Collibra.
Strong programming skills in languages like Python and SQL.
Experience in building and managing CI/CD pipelines using Git GitHub Actions or Jenkins.
Solid understanding of cloud security principles and experience implementing security measures in cloud environments.
Soft Skills:
Excellent problemsolving abilities and attention to detail.
Strong communication and collaboration skills with the ability to work effectively in a teamoriented environment.
Proactive attitude towards learning new technologies and staying updated with industry trends.
Preferred Qualifications:
Experience with DevOps practices and infrastructure as code.
Certifications in Azure Data Engineering or Cloud Security.
Familiarity with data governance frameworks and compliance standards.
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.