Senior Big Data Analyst

Job Description

• Builds large-scale data processing systems, is an expert in data warehousing solutions, and should work with the latest (NoSQL) database technologies.
• Implement/Optimize ETLs to Capture, cleanse, and augment data from different sources.
• Design and implement a data hub/store to store all the cleansed and organized data.
• Continuous maintenance of data integrity and data store consistency, such as DWH.
• Implement and execute data archiving strategy.
• Provide a fast/secure way to access the data hub to cater to other analytics purposes.
• Develop big data solution design and data architecture for data management use cases.
• Lead and mentor younger team members.

Job Requirements

• Management of Hadoop cluster, with all included services.
• minimum 2-years of experience with various messaging systems, such as #Kafka.
• Ability to solve any ongoing issues with operating the cluster.
• Experience with building stream-processing systems, using solutions Storm or #Spark-Streaming.
• Experience with the integration of data from multiple data sources.
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
• Knowledge of various ETL techniques and frameworks, such as Flume, Nifi.
• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
• Monitoring performance and advising any necessary infrastructure changes.
• Defining data retention policies.
• Mentor junior team members.