Senior Data Engineer (8 yrs exp). Please refer the JD and share profiles accordingly.
Primary Skills:
SQL
Data Modeling
ETL and ELT skills
Snowflake
AWS Lambda Glue S3 etc
Python Basics
SAP HANA knowledge is good to have
Senior Data Engineer
Job Description
Role Overview: A Senior Data Engineer is responsible for designing building and maintaining the infrastructure and tools required for efficient data processing and analysis. This role involves working closely with business team data analysts and other stakeholders to ensure data quality and accessibility.
Key Responsibilities:
- Design and Implement ETL Processes: Develop and manage ETL (Extract Transform Load) processes to transform raw data into usable formats.
- Data Pipeline Management: Build and maintain scalable data pipelines to handle increasing data volumes and complexity.
- Data Warehousing: Manage data warehousing solutions to store and organize large datasets.
- Collaboration: Work with data scientists and business teams to improve data models and support data-driven decision-making.
- Data Integration and optimization: Implement and manage the deployment of data integration models into production environments. Optimize the workload and data processing
- Ensure Data Quality: Implement processes for data correction reconciliation and quality checking to maintain data integrity.
Skills and Qualifications:
- Technical Expertise: Proficiency in programming languages such as SQL Python PySpark and experience with cloud platforms (e.g. Snowflake AWS).
- Data Management: Strong understanding of data warehousing ETL processes and data pipeline architecture.
- Analytical Skills: Ability to analyze complex data sets and provide actionable insights.
- Collaboration: Excellent communication and teamwork skills to work effectively with cross-functional teams.
- Problem-Solving: Strong problem-solving skills to address data-related challenges and optimize data workflows.
- Experience with Snowflake platform.
- Experience with cloud services like AWS Lambda Glue.
- Programming skills with SQL and Python/PySpark.
- Knowledge of SAP ERP tables.
- Familiarity with data visualization tools (e.g. Tableau Power BI).