Data Engineer with Python

Get to know us better

CodiLime is a software and network engineering industry expert and the firstchoice service partner for top global networking hardware providers software providers and telecoms. We create proofsofconcept help our clients build new products nurture existing ones and provide services in production environments. Our clients include both tech startups and big players in various industries and geographic locations (US Japan Israel Europe).

While no longer a startup we have 300 people on board and have been operating since 2011 weve kept our peopleoriented culture. Our values are simple:

• Actto deliver.
• Disruptto grow.
• Team upto win.

The project and the team

Our client is a large consulting company building a SaaS platform to support M&A (Merger and Acquisition) process by generating reports on companies and their competitors such as company overviews market data and news feed analysis. Currently the platform is being extensively extended and integrated with other subsystems of the client.

What else you should know:

• The team consists of less than 15 people including an architect project manager ML developers and multitech and multilanguage engineers familiar with numerous APIs data structuring and processing techniques presenting output in multiple ways depending on business needs.
• We use SCRUM/Agile methodology.
• Our tech stack for the project includes AWS infrastructure Terraform relational and nonrelational databases (ES Postgres Snowflake) application logic and data processing pipelines written in Python and orchestrated by Apache Airflow frontend built in React.
• The client is based in the US.

Now we are working on many interesting projects so we may invite you to an interview for a different project if we consider your skills and profile suitable.

Your role

As a member of the project team you will be responsible for:

• Designing and implementing features in Postgres and Snowflake database
• Implementing solutions suitable for either OLTP or OLAP approaches
• Investigating possible bottlenecks and improving overall databases performance
• Writing code pieces in Python to PoC developed ideas
• Participating in technical design discussions
• Delivering automatic tests for your code
• Validating the solution with the client (demo)
• Fixing discovered bugs efficiently and effectively
• Working in agile methodology and collaborating with a team

Do we have a match

As a Data Engineer you must meet the following criteria:

• Very good understanding of data pipeline design concepts and approaches
• Handson experience with Postgres and Snowflake
• Excellent coding skills in Python
• Experience with Apache Airflow Apache Spark tools
• Experience with CI/CD tools and processes
• Knowledge of AWS
• Experience in frameworks like PyTorch TensorFlow Ray would be a plus
• Experience with nonrelational databases would be a plus
• Knowledge of Git
• Good communication skills English (B2 level) ability to confront technical solutions with the team and the clients technical representatives to validate the solution with the client

More reasons to join us

• Flexible working hours and approach to work: fully remotely in the office or hybrid
• Professional growth supported by internal training sessions and a training budget
• Solid onboarding with a handson approach to give you an easy start
• A great atmosphere among professionals who are passionate about their work
• The ability to change the project you work on