Sr. Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Bengaluru - India

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Job Description:

  • Design and implement scalable data pipelines for batch and near real- time use cases in cloud environments

  • Write optimized complex SQL queries for data transformation and analysis in cloud data warehouses

  • Develop efficient Python and PySpark scripts for large-scale data processing and ETL workflows

  • Create and maintain data models in Databricks ensuring data quality and consistency

  • Optimize queries and scripts over large-scale datasets (TBs) with a focus on performance and cost-efficiency

  • Implement data governance and security best practices in cloud environments

  • Collaborate across teams to translate business requirements into robust technical solutions

Job Description: Design and implement scalable data pipelines for batch and near real- time use cases in cloud environments Write optimized complex SQL queries for data transformation and analysis in cloud data warehouses Develop efficient Python and PySpark scripts for large-scale data ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala