Sr. Data Engineer AWS

Pune - India

Monthly Salary: Not Disclosed

Posted on: 13 hours ago

Vacancies: 1 Vacancy

Job Summary

Position Summary:

We are seeking an experienced Data Engineer to join our dynamic technology consulting team. The ideal candidate will have 5 years of Python expertise focused on ETL and a strong background in AWS-based data ecosystems. This role centers around building scalable secure data solutions supporting advanced analytics and contributing to cybersecurity initiatives offers a very good opportunity to learn.

Responsibilities:

Design Build and Maintain ETL Pipelines: Develop robust efficient ETL processes using Python PySpark for diverse data sources and third-party integrations.
Exploratory Data Analysis (EDA): Conduct EDA to drive insights optimize data models and support machine learning initiatives.
DataLake Architecture: Architect and optimize DataLake solutions leveraging AWS technologies such as S3 Glue and Athena.
AWS Ecosystem Integration: Deploy monitor and maintain solutions on EC2; write and optimize Athena SQL queries; manage scalable cloud infrastructure for data engineering needs.
Data Wrangling: Clean transform and standardize large heterogeneous data sets enabling seamless analytics and reporting.
Cybersecurity Analytics (Preferred): Engineer pipelines for security-related data supporting threat detection SIEM and anomaly modeling.
Cribl Experience (Preferred): Leverage Cribl solutions for data routing enrichment and log management within cybersecurity contexts.

Preferred Skills & Experience:

Bachelors degree in Computer Science Information Technology Engineering or a related field.
5 years hands-on experience as a Data Engineer working extensively with Python ETL frameworks and ML engineering concepts.
Proven track record in building and optimizing ETL and DataLake solutions.
Demonstrated expertise in AWS cloud data engineering (EC2 S3 Glue Athena SQL).
Strong skills in EDA data wrangling and building analytics-ready data sets.
Exposure to cybersecurity analytics log enrichment or SIEM tools (Splunk ELK Stack etc.).
Experience with Cribl or similar log data streaming frameworks.
AWS Professional or Specialty certification (Data Analytics Security or Machine Learning).
Strong written and verbal communication skills for client engagement and team collaboration.

New Vision is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees

Required Experience:

Senior IC

Position Summary:We are seeking an experienced Data Engineer to join our dynamic technology consulting team. The ideal candidate will have 5 years of Python expertise focused on ETL and a strong background in AWS-based data ecosystems. This role centers around building scalable secure data solutions...