Lead Data Engineer

Trigent Software Private Limited

Job Location:

Monthly Salary: Not Disclosed

Posted on: 2 hours ago

Vacancies: 1 Vacancy

Develop Maintain and Optimize the scalable data pipelines for data integration transformation and analysis ensuring high performance and reliability.
Demonstrate proficiency in ETL/ELT processes including writing testing and maintaining high-quality code for data ingestion and transformation.
Improve the efficiency and performance of data pipeline and workflows utilizing advanced data engineering techniques and best practices.
Troubleshoot and resolve complex issues related to data pipelines and applications using logs and code reviews to ensure smooth data flow and system functionality.
Work closely with data scientists analysts and stakeholders to understand requirements and deliver effective high-quality datasets and data solutions.
Utilize and manage cloud-based services particularly on AWS for data storage and processing ensuring optimal use of resources.
Ensure data accuracy and integrity by implementing data validation and cleansing techniques to maintain unit testing system integration testing regression testing and assist with user acceptance testing to ensure data solutions meet quality standards.