Middle Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
- Design develop and maintain end-to-end big data pipelines that are optimized scalable and capable of processing large volumes of data in real-time and in batch mode
- Follow and promote best practices and design principles for Data Lakehouse architecture
- Support technological decision-making for the businesss future data management and analysis needs by doing POCs
- Write and automate data pipelines
- Assist in improving data organization and accuracy
- Collaborate and work with data analysts scientists and engineers to ensure the use of best practices in terms of data processing and storage technologies
- Explore and stay up to date on emerging technologies and proactively shares learnings with the team
- Ensure that all deliverables adhere to our world-class standards
Qualifications :
- 3 years of experience in big data development and database design
- Strong hands-on experience with SQL and experience working on advanced SQL
- Proficient in Python and other scripting languages
- Working knowledge of at least one of the big data technologies
- Experience developing software solutions using Hadoop Technologies such as MapReduce Hive Spark
- Yarn/Mesos etc.
- At least an Upper-Intermediate level of English
WOULD BE A PLUS
- Experience with AWS cloud S3 and Redshift
- Experience with Python
- Knowledge and exposure to BI applications e.g. Tableau QlikView
Additional Information :
PERSONAL PROFILE
- Excellent analytical and problem-solving skills
Remote Work :
Yes
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
At Sigma Software, we are involved with the clients team to contribute to the design and development of a technical solution for their tokenized domain reservation platform. We started by assigning a software architect to design the smart contracts and integrate blockchain into the s ... View more
