Snowflake Architect

Dallas, IA - USA

Monthly Salary: Not Disclosed

Posted on: 7 hours ago

Vacancies: 1 Vacancy

Job Summary

Descriptions:

Data Lake Architecture and Experience:

Guide team to migrate from on Prem Cloudera to Azure cloud environment.

Designed and implemented scalable data lake solutions using Snowflake and Databricks Developed and optimized data pipelines for ingestion transformation and storage.

Managed data governance quality and security across cloud environments and Implemented performance tuning automation and CI/CD for data workflows.

Collaborated with cross-functional teams to support cloud migration activitiesCloudera Cluster Management:

Install configure manage and monitor Cloudera Hadoop clusters ensuring high availability performance and security. This includes managing HDFS YARN and other ecosystem Optimization:

Tune Hadoop Hive and Spark jobs and configurations for optimal performance efficiency and resource utilization. This includes optimizing queries managing partitions and leveraging in-memory and Support:

Diagnose and resolve issues related to Linux servers networks cluster health job failures and performance bottlenecks. Provide on-call support and collaborate with other teams to ensure smooth Governance and Secrets Management:

Implement and manage security measures within the Cloudera environment including Kerberos Apache Ranger and Atlas to ensure data governance and compliance.

Setup and manage HashiCorp Vault for secure keys and secrets management.

Utilize CyberArk for privileged access management and secure administrative tasks on the and Application Migration:

Migrate Hadoop Hive and Spark data and applications to Azure cloud services such as Azure Synapse Analytics Azure Databricks or Snowflake. Ensure data integrity performance tuning and validation.

Automation and Scripting: Develop scripts (e.g. shell Ansible Python) for automating administrative tasks deployments and monitoring. Work with users to develop debug optimize Hive/Spark/Python programs that connect to the Cloudera :

Create and maintain documentation for system configurations operational procedures and troubleshooting knowledge Collaboration:

Work closely with the Cloudera vendor to stay current with the latest releases perform upgrades and address vulnerabilities.

Designed and implemented scalable data lake solutions using Snowflake and Databricks Developed and optimized data pipelines for ingestion transformation and storage.

Managed data governance quality and security across cloud environments and Implemented performance tuning automation and CI/CD for data workflows.

Comments for Suppliers: Role: Snowflake Architect

Location: ONSITE- Minneapolis/ Dallas

Descriptions: Data Lake Architecture and Experience: Guide team to migrate from on Prem Cloudera to Azure cloud environment. Designed and implemented scalable data lake solutions using Snowflake and Databricks Developed and optimized data pipelines for ingestion transformation and storage. Managed ...