Senior Data Engineer (AWS)

WILLWARE TECHNOLOGIES PRIVATE LIMITED

Job Location:

Bengaluru - India

Monthly Salary: Not Disclosed

Posted on: 4 days ago

Vacancies: 1 Vacancy

Job Summary

Role:Senior Data Engineer (AWS)

Company Name : WillWare Technologies

Work Model : Fulltime / Hybrid

Experience : 8 Years

Work Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Gurgaon

Job Description :

Scope: Build/operate ingestion pipelines from unstructured semi-structured data sources and additional sources; develop PySpark/Glue transformations; manage S3 data lake layout/partitioning; orchestrate with Airflow; CI/CD testing and operational monitoring.

Core skills: PySpark Python AWS Glue Amazon S3 SQL-based transforms Airflow orchestration connectors/streaming (e.g. Kafka/Snowflake connectors) CI/CD for data pipelines observability and automated data quality checks. Nice to have: Experience preparing data for vectorization and search services.

Required Skills:

PySparkPythonAWS GlueS3SQL-based transformsAirflow

Role:Senior Data Engineer (AWS) Company Name : WillWare Technologies Work Model : Fulltime / Hybrid Experience : 8 Years Work Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Gurgaon Job Description : Scope: Build/operate ingestion pipelines from unstructured semi-structured data so...