Data Engineer PySpark & Snowflake

Who we are

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.

Job Description:

Job Title : Data Engineer - PySpark & Snowflake

Job Type : Full-time / Contract

Experience : 7-10 Years

Location : Hyderabad Telangana

Responsibilities:

• Experience with PySpark and Apache Spark.
• Expertise in Snowflake architecture development optimization and administration concepts.
• Strong knowledge of SQL and relational database management systems (RDBMS).
• Experience designing and developing ETL/ELT pipelines.
• Hands-on experience with Data Warehousing concepts dimensional modeling and data integration.
• Experience with Spark Streaming and real-time data processing.
• Experience with workflow orchestration tools such as Apache Airflow.
• Experience working with cloud platforms such as AWS Microsoft Azure and Google Cloud Platform (GCP)
• Experience with Databricks and distributed data processing environments.
• Strong understanding of DBMS concepts and database performance tuning.
• Proficiency with Apache Kafka for event-driven architectures.
• Strong understanding of Data Pipelines Data Quality frameworks and data governance practices.
• Design develop and maintain scalable ETL/ELT data pipelines using PySpark Spark and cloud-native technologies.
• Develop and manage enterprise data warehouse solutions using Snowflake.
• Implement batch and real-time data processing solutions using Spark Streaming and Kafka.
• Create high-performance data models and support business intelligence and analytics requirements.
• Develop and maintain data workflows using orchestration tools such as Apache Airflow.
• Optimize SQL queries Spark jobs and Snowflake workloads for performance and scalability.
• Support production deployments incident resolution and continuous improvement initiatives.
• Participate in architecture discussions and contribute to enterprise data platform modernization efforts.