Job Summary (List Format):
- Design and develop robust data infrastructure including data ingestion processing storage and retrieval systems using big data and cloud technologies.
- Build and maintain scalable data pipelines (ETL) to extract transform and load data from diverse sources ensuring high data quality and integrity.
- Perform data modeling and database design to support data integration and reporting needs collaborating with data scientists and analysts to optimize data structures.
- Optimize the performance of data systems through query optimization indexing caching and system monitoring implementing solutions to enhance efficiency and scalability.
- Ensure data security and privacy by implementing access controls encryption and data masking while maintaining compliance with relevant regulations.
- Collaborate with cross-functional teams to understand data requirements provide technical guidance and mentor junior data engineering staff as needed.
- Stay updated on data engineering trends and technologies evaluate new tools and propose innovative solutions to enhance data processing analysis and visualization capabilities.
- Support timely project delivery contribute to generating quality insights and reports and ensure adherence to data governance security and compliance protocols.