Data engineer

Job Description:

Data Engineer that will be working within a team to design and implement highly available data services and pipelines. This is an ideal job if you have proven experience as a technical professional and have already collaborated with teams to deliver production systems based on big data solutions.

strong expertise in artificial intelligence through use of machine learning, data mining, and information retrieval to design, prototype and build next generation advanced analytics engines and services. The data scientist collaborates with business partners to define the technical problem statement and hypothesis to test; develops solutions that mimic business decisions and incorporates them into analytical data products or tools with the support of a cross-functional team.

• 3 - 5 years' experience in Quality validating ETL pipelines and Data Warehouses
• Expert SQL knowledge and experience working with relational databases as well as a working familiarity with a variety of databases.
• Good experience in data analytics, data engineering, data modeling, data warehousing, and big data platform
• Strong programming (Scala/Java) or scripting skills (Python)
• Experience with but not limited to JUnit/TestNG or similar tools
• Experience in a range of common big data tools & technologies such as Spark, Hive, Snowflake, Kafka etc.
• Experience in working with large datasets (Terabytes or more)
• Ability to operate effectively in a team-oriented and collaborative environment
• Excellent communication skills and ability to interact with all levels of end users and technical resources