Sr Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
13 days ago
Vacancies:
1 Vacancy
Job Summary
Job Summary for Sr Data Engineer (Hyderabad 8 years experience):
- Design optimize and maintain scalable data pipelines for ingestion transformation and loading of large datasets from diverse sources.
- Orchestrate and automate ETL/ELT processes using Azure Data Factory to ensure efficient data flow.
- Manage and utilize Azure services including Blob Storage and Data Lake Storage (ADLS Gen2) for secure and efficient data storage.
- Integrate and automate data flows using Azure Logic Apps for event-driven workflows.
- Develop optimize and maintain complex SQL queries stored procedures and data models for analytical and reporting needs.
- Implement and uphold data governance quality standards and security best practices.
- Troubleshoot debug and optimize data pipelines and infrastructure for performance and reliability.
- Lead or contribute to solution design production support and maintenance projects for data engineering applications on Azure and Snowflake.
- Demonstrate expert-level proficiency with Snowflake for data warehousing and platform development.
- Use version control systems (e.g. Git) for collaboration and code management.
- Exhibit strong problem-solving analytical and communication skills.
- Work independently and collaboratively in a fast-paced dynamic environment.
- Design optimize and maintain scalable data pipelines for ingestion transformation and loading of large datasets from diverse sources.
- Orchestrate and automate ETL/ELT processes using Azure Data Factory to ensure efficient data flow.
- Manage and utilize Azure services including Blob Storage and Data Lake Storage (ADLS Gen2) for secure and efficient data storage.
- Integrate and automate data flows using Azure Logic Apps for event-driven workflows.
- Develop optimize and maintain complex SQL queries stored procedures and data models for analytical and reporting needs.
- Implement and uphold data governance quality standards and security best practices.
- Troubleshoot debug and optimize data pipelines and infrastructure for performance and reliability.
- Lead or contribute to solution design production support and maintenance projects for data engineering applications on Azure and Snowflake.
- Demonstrate expert-level proficiency with Snowflake for data warehousing and platform development.
- Use version control systems (e.g. Git) for collaboration and code management.
- Exhibit strong problem-solving analytical and communication skills.
- Work independently and collaboratively in a fast-paced dynamic environment.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
