Lead Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
Company Overview
Arcesium is a global financial technology firm that solves complex data-driven challenges faced by some of the worlds most sophisticated financial institutions. We constantly innovate our platform and capabilities to meet tomorrows challenges anticipate the risks our clients encounter and design advanced solutions to help our clients achieve transformational business outcomes.
Financial technology is a high-growth industry as change and innovation continue to disrupt the status-quo and prompt major transformation. Arcesium is at a particularly interesting time in our own growth as we look to leverage our successfully established market position and expand operations in pursuit of strategic new business opportunities. We value intellectual curiosity proactive ownership and collaboration with colleagues and we empower you to meaningfully contribute from day one and accelerate your professional development.
Job Overview
We are looking for a bright and exceptional Engineering Lead to join our Technology this role you will work closely with Product Managers Subject Matter Experts Data Scientists and Software Engineers to design build and optimize scalable data pipelines for our Data Platform. The ideal candidate has strong hands-on experience in distributed data processing expertise in architecting Data Pipelines and operational skills to drive efficiency and speed.
Key Responsibilities:
- Work closely with the product and other teams to understand business requirements and translate them into robust engineering solutions.
- Architect build and maintain data solutions and pipelines to meet business requirements.
- Engage and lead a team of talented technologists and establishing engineering best practices.
- Act as a point of contact for managing and driving production defects & stability improvements to resolution
- Oversee end-to-end data workflows from ingestion transformation and storage to data lake in both batch and streaming environments.
- Drive improvements in performance reliability and scalability of data pipelines
Required Skills & Qualifications:
- A bachelors degree in computer science Math or other technical fields with 6-8 years of experience Fintech domain is a plus.
- Demonstrated contribution to end-to-end delivery of enterprise-grade software
- Experience on Data Engineering Data Lakes Data Warehousing Data Pipelines Data Analytics tools.
- Experience using open-source Big Data technologies such as Spark Hadoop Elasticsearch Kafka.
- Hands-on experience in enterprise application development
- Strong SQL skills and experience working with relational and NoSQL databases.
- Experience in cloud technologies is a plus
- Demonstrates advanced proficiency in Python for building scalable data pipelines automating workflows
- Experience building scalable ETL/ELT data pipelines and data lakes/warehouses.
- Familiarity with workflow orchestration tools (Airflow ADF Glue Workflow etc.).
- Solid understanding of CI/CD version control and DevOps practices.
- Experience working in agile collaborative environments.
- Attention to detail and quality and the ability to work well in and across teams
- Ability to advocate & influence multiple stakeholders
- Excellent problem-solving communication and leadership skills.
- Experience in leading a team of highly skilled engineers
- Strong communication skills
Recruiting Security
Emails from genuine Arcesium recruiters who are employees of the company will always come from some cases you may also be contacted by independent search firms engaged to recruit on our behalf; emails from their employees should always come from their firms applicable domain. Well never ask for your banking information or any payment as part of the recruiting process. If something seems off or youre contacted by an unexpected third party please reach out to us at .
Arcesium is an equal opportunity employer.
Required Experience:
IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Arcesium's scalable, cloud-native solutions help clients in the investment industry transform operations with new and better financial data management.
