Senior Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Bengaluru - India

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Job Description:

  • End-to-End Development: Architect build and maintain ETL processes using Apache Spark and Python to efficiently ingest transform and load data from diverse sources.

  • Data Integrity: Implement robust data quality checks monitoring systems and error handling to ensure data accuracy and reliability.

  • Analytical Modeling: Develop advanced analytical and reporting models for our SaaS products tailored to meet the complex needs of large-scale enterprise clients.

  • Cloud Collaboration: Work closely with the Operations team to manage and scale data pipelines on leading cloud platforms.

  • Performance Optimization: Debug troubleshoot and optimize intricate SQL queries to maximize system performance.

  • Non-Functional Excellence: Enhance all facets of non-functional requirements for our cloud-based SaaS applications regularly conducting performance profiling and capacity planning for critical systems.

Job Description: End-to-End Development: Architect build and maintain ETL processes using Apache Spark and Python to efficiently ingest transform and load data from diverse sources. Data Integrity: Implement robust data quality checks monitoring systems and error handling to ensure data a...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala