Big Data Engnieer (Remote-Worldwide)

This job is with our partner Micro1.

Key Responsibilities:

1. Design build and maintain scalable big data pipelines and architectures to support robust data solutions.
2. Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
3. Implement data integration transformation and processing solutions using Python and relevant big data technologies.
4. Develop manage and optimize distributed databases and storage systems for efficiency and reliability.
5. Monitor troubleshoot and enhance data systems to ensure high availability and performance.
6. Enforce data quality security and governance standards across all solutions.
7. Document solutions and communicate complex technical concepts effectively both in writing and verbally.

Required Skills and Qualifications:

1. Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
2. Advanced proficiency in Python for data processing automation and integration.
3. Deep understanding of relational and NoSQL databases including optimization and management techniques.
4. Experience with distributed data processing frameworks (e.g. Hadoop Spark Flink).
5. Strong foundation in data modeling ETL processes and data warehousing principles.
6. Excellent written and verbal communication skills with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.
7. Detail-oriented proactive and self-motivated thriving in remote and autonomous work environments.