Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
10 hours ago
Vacancies:
1 Vacancy
Job Summary
Join our dynamic and high-impact Data Platform team where youll be responsible for safely receiving and storing trading-related data as well as operating and improving our shared data access and data processing systems. This is a critical role in the organisation as the data platform drives a huge range of trader analysis simulation reporting and insights. The ideal candidate should have work experience in systems engineering preferably with prior exposure to financial markets and with proven working knowledge in the fields of Linux administration orchestration and automation tools systems hardware architecture as well as storage and data protection technologies.
Your Core Responsibilities:
- Manage and monitor all distributed systems storage infrastructure and data processing platforms including HDFS Kubernetes Dremio and in-house data pipelines
- Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions
- Collaborate closely with systems and network engineers traders and developers to support and troubleshoot their queries
- Stay up to date with the latest technology trends in the industry; propose evaluate and implement innovative solutions
Your Skills and Experience:
- 2 years of experience in managing large-scale multi-petabyte data infrastructure in a similar role
- Knowledge of Linux system administration and internals with proven ability to troubleshoot issues in Linux environments
- Experience in at least one of the following technologies: Kafka Spark Cassandra/Scylla or HDFS
- Working knowledge of Docker Kubernetes and Helm
- Experience with data access technologies such as Dremio and Presto
- Familiarity with workflow orchestration tools like Airflow and Prefect
- Exposure to cloud platforms such as AWS GCP or Azure
About Us
IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989 weve been a stabilizing force in financial markets providing essential liquidity upon which market participants depend. Across our offices in the US Europe Asia Pacific and India our talented quant researchers engineers traders and business operations professionals are united by our uniquely collaborative high-performance culture and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies and from developing an innovative research environment to diversifying our trading strategies we dare to continuously innovate and collaborate to succeed.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
0-50 employees
IMC is where the brightest minds in trading, technology, and quant research come together to solve the industry’s greatest challenges. Explore careers with us.
