Sr. AWS Data Engineer Airflow + ETL ( AWS, Pyspark, Databricks)

Artmac Soft LLC

Job Location:

Hyderabad - India

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Who We Are

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.

Job Description

Job Title : Sr. AWS Data Engineer - Airflow ETL ( AWS PySpark Databricks)

Job Type : Contract

Experience : 8-15 Years

Location : Hyderabad Telangana (Hybrid)

Responsibilities :

Experience in data engineering with a strong focus on ETL processes and data pipeline development.
Proficiency in using Airflow for orchestrating complex data workflows.
Extensive experience with AWS services (e.g. S3 Lambda Glue Redshift).
Strong programming skills in PySpark with a deep understanding of distributed data processing.
Hands-on experience with Databricks for data processing and analytics.
Experience with additional big data technologies such as Kafka Hadoop or Snowflake.
Familiarity with data visualization tools like Tableau Power BI or similar.
Experience with CI/CD tools and practices for data pipelines.
Certifications in AWS or Databricks are a plus.
Familiarity with SQL and relational databases for data extraction and manipulation.
Proven experience with data modeling data warehousing and building scalable data solutions.
Knowledge of best practices in data management including data governance and data security.
Strong problem-solving skills and ability to troubleshoot complex data issues.
Excellent communication and collaboration skills with the ability to work effectively in a team environment.
Optimize data pipelines for performance scalability and reliability.
Implement best practices for data governance data quality and data security.
Monitor and troubleshoot ETL processes to ensure data accuracy and integrity.
Work in an agile environment actively participating in sprint planning daily stand-ups and retrospectives.
Document data workflows processes and technical specifications to ensure clear communication and knowledge sharing within the team.

Qualification:

Bachelors degree in Computer Science Information Technology or a related field.

Who We Are Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers. Job Description Job Title : Sr. AWS Data Engineer - Airflow ETL ( AWS PySpark Databricks) Job Type : Contract Experience : 8-15 Y...

Who We Are

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.

Job Description

Job Title : Sr. AWS Data Engineer - Airflow ETL ( AWS PySpark Databricks)

Job Type : Contract

Experience : 8-15 Years

Location : Hyderabad Telangana (Hybrid)

Responsibilities :

Experience in data engineering with a strong focus on ETL processes and data pipeline development.
Proficiency in using Airflow for orchestrating complex data workflows.
Extensive experience with AWS services (e.g. S3 Lambda Glue Redshift).
Strong programming skills in PySpark with a deep understanding of distributed data processing.
Hands-on experience with Databricks for data processing and analytics.
Experience with additional big data technologies such as Kafka Hadoop or Snowflake.
Familiarity with data visualization tools like Tableau Power BI or similar.
Experience with CI/CD tools and practices for data pipelines.
Certifications in AWS or Databricks are a plus.
Familiarity with SQL and relational databases for data extraction and manipulation.
Proven experience with data modeling data warehousing and building scalable data solutions.
Knowledge of best practices in data management including data governance and data security.
Strong problem-solving skills and ability to troubleshoot complex data issues.
Excellent communication and collaboration skills with the ability to work effectively in a team environment.
Optimize data pipelines for performance scalability and reliability.
Implement best practices for data governance data quality and data security.
Monitor and troubleshoot ETL processes to ensure data accuracy and integrity.
Work in an agile environment actively participating in sprint planning daily stand-ups and retrospectives.
Document data workflows processes and technical specifications to ensure clear communication and knowledge sharing within the team.