Big Data Engineer:
7-10 years of experience with modern data-engineering practices and big data technologies
Must be very comfortable with reading and writing Python/Scala code
Well versed with Spark development (SQL and/or Spark) - should able to express complex logic if SQL is not possible
Sound Knowledge on any NoSQL database e.g. Cassandra, MongoDB., DataIQ
Experience in batch or real time data streaming
Ability to dynamically adapt to conventional big-data frameworks and open source tools if project demands
Knowledge of design strategies for developing scalable, resilient, always-on data lake
Experience in agile(scrum) development methodology
Strong development/automation skills
Solid understanding of data architecture principles, including data access patterns and data modelling
Work experience on AWS on any other cloud would be an added advantage
Previous experience in Financial Services organisations an advantage
Skills : bigdata,python,scala