Senior Data Engineer Spark

AgileEngine is a topranking provider of software solutions to Fortune 500 Global 500 and Future 50 companies. Listed on Inc. 5000 among the fastestgrowing US companies we are always open to talented software UX and data experts in the Americas Europe and Asia.

If you like a challenging environment where you re working with the best and are encouraged to learn and experiment daily there s no better place guaranteed! :)

What you will do

• Research design and implementation of Logical and Physical Query Plan Optimization techniques;
  

• Demonstrate expertise in Query Optimization topics like cost models logical plan rewrite techniques materialized view rewrites etc;
  

• Address both simple and complex product defects as a part of normal development;
  

• Translate complex functional and technical requirements into detailed design;
  

• Facilitate knowledge sharing by creating and maintaining detailed comprehensive documentation;
  

• Mentor less knowledgeable team members as needed.
  

Must haves

• A Bachelor s degree is required in the field of Computer Science or Engineering;
  

• Prior experience working on SQL Query Optimization contributing to one or more optimization techniques at a DB vendor;
  

• Experienced in Apache Spark internals. Deep understanding of distributed scale out platform like Hive/Tez HBase Flink Spark (Spark is a hard must);
  

• Familiarity with Spark development and deployment experience;
  

• Experience working in Open Source. Apache contributor and/or committer a strong plus;
  

• At least 5 years of experience working in/with Big Data.
  

Nice to haves

• Engineering experience with the following technologies preferred : Linux Java Scala Python.
  

The benefits of joining us

• Professional growth
  

Accelerate your professional journey with mentorship TechTalks and personalized growth roadmaps.

• Competitive compensation
  

We match your evergrowing skills talent and contributions with competitive USDbased compensation and budgets for education fitness and team activities.

• A selection of exciting projects
  

Join projects with modern solutions development and toptier clients that include Fortune 500 enterprises and leading product brands.

• Flextime
  

Tailor your schedule for an optimal worklife balance by having the options of working from home and going to the office whatever makes you the happiest and most productive.