work from home - Data Science Engineer

Responsibilities:

• Build and maintain ETLs in cloud environment (Azure and/or Google Cloud)
• Write Spark jobs for data transformation on structured and semi structured datasets
• Contribute to the design and implementation of the application databases and storage hierarchy
• Design and Implement a real-time data streaming architecture
• Write code for monitoring pipelines and data quality, as well as serving data to different consumers
• Maintain the data infrastructure in a healthy and highly available state

Job Requirements

Basic qualifications:

• 2+ years of professional experience as a Data Engineer using Python/Scala as well as Spark and SQL
• Experience with Computer Science fundamentals including data structures, algorithms, complexity analysis.
• Strong understanding of databases concepts such as Relational, NoSQL, Graph Databases, etc...
• Strong understanding of best practices in Data Warehousing and Data Modelling concepts
• Experience building high load, scalable and robust systems
• Ability to go above your functional responsibilities and help to solve problems across departments and business verticals.

Preferred qualifications:

• Master's Degree in Computer Science or other related technical field
• Previous Experience in building complex ETLs and Data Transformation pipelines
• Understanding of Cloud Native environment, its details and ability to work in any of the 3 cloud providers
• Highly Preferred experience with real-time data streaming
• Preferred some experience with visualization tools such as PowerBI or Tableau