Middle Data Engineer

AgileEngine is a topranking provider of software solutions to Fortune 500 Global 500 and Future 50 companies. Listed on Inc. 5000 among the fastestgrowing US companies we are always open to talented software UX and data experts in the Americas Europe and Asia.

If you like a challenging environment where you re working with the best and are encouraged to learn and experiment daily there s no better place guaranteed! :)

What you will do

• Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed s data platforms;
  

• Designing and implementing data model changes that align with data standards;
  

• Work with existing APIs written in Flask (python);
  

• Monitoring production data pipelines daily to ensure completion maintain data quality and address performance issues;
  

• Reading and interpreting system logs to evaluate system health or perform root cause analysis;
  

• Identifying pipeline issues and working with colleagues vendors and external teams to resolve;
  

• Clearly communicating pipeline statuses with management and stakeholders.
  

Must haves

• Ideally a bachelor s degree in computer science computer engineering or an engineering discipline;
  

• 5 years of industry experience in software development and/or data engineering with strong expertise in fastpaced and deliverfocused environments;
  

• Extensive production experience in SQL;
  

• Extensive experience building an ETL from scratch;
  

• 3 years of experience with:
  

• Python/Flask;
  

• 3 years of handson experience with big data technologies (such as Redshift Hive Trino/Presto or similar technologies);
  

• Experience with modeling data;
  

• Experience in Athena;
  

• Experience with MySQL;
  

• Experience in Gitlab CI;
  

• Experience in AWS cloud platform (SQS S3 services);
  

• Extensive experience in writing technical documentation;
  

• Upperintermediate English level.
  

Nice to haves

• Experience in Spark;
  

• Experience in Tableau or Google Data Studio;
  

• ETL work will be in Dagster but may not be a primary focus of the individual.
  

The benefits of joining us

• Professional growth
  

Accelerate your professional journey with mentorship TechTalks and personalized growth roadmaps.

• Competitive compensation
  

We match your evergrowing skills talent and contributions with competitive USDbased compensation and budgets for education fitness and team activities.

• A selection of exciting projects
  

Join projects with modern solutions development and toptier clients that include Fortune 500 enterprises and leading product brands.

• Flextime
  

Tailor your schedule for an optimal worklife balance by having the options of working from home and going to the office whatever makes you the happiest and most productive.