Data Engineer

Overview:

Key Responsibilities:

• Design and develop robust scalable data pipelines for ingesting integrating and transforming large volumes of structured and unstructured data
• Implement ETL processes to efficiently extract load and transform diverse data sources
• Create and maintain data models and schema designs to support analytics and reporting requirements
• Optimize data infrastructure and architecture for performance reliability and costeffectiveness
• Collaborate with crossfunctional teams to understand data requirements and implement solutions
• Implement data security and compliance measures to protect sensitive information
• Monitor and troubleshoot data pipeline and infrastructure issues
• Document data processes data flow and infrastructure components
• Keep abreast of emerging technologies and best practices in data engineering
• Contribute to the continuous improvement of data quality consistency and accuracy

Required Qualifications:

• Bachelors or Masters degree in Computer Science Engineering or related field
• Proven experience in data engineering database development or related roles
• Proficiency in SQL and database technologies for data manipulation and optimization
• Strong programming skills in Python for data processing
• Experience with data modeling Data clearing visualization text processing Image processing
• Knowledge of Big Data technologies such as Hadoop Spark or Hive
• Handson experience with cloud platforms like AWS (quicksight glue RDS)
• Expertise in ETL tools and processes to manage data pipelines
• Familiarity with data visualization tools like Power BI or similar
• Excellent problemsolving analytical and communication skills
• Ability to work effectively in a collaborative agile environment
• Strong attention to detail and commitment to delivering highquality solutions

sql,python,etl,data modeling,big data,data warehousing,aws,spark,data visualization,visualization,processing,excel,power bi