Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About the Role
A forwardthinking firm working at the convergence of advanced analytics and financial technologies is seeking a Lead Data Systems Engineer to empower various internal departments by constructing and sustaining a robust adaptable data ecosystem.
This individual will play a crucial part in refining our data architecture sharing guidance on optimal methodologies and advancing organizational standards around information management. With a bigpicture approach this person will align priorities and maintain open lines of communication with all relevant teams.
Primary Duties
-
Design and operate dependable data workflows to combine inputs from a variety of distinct systems.
-
Assemble and oversee a data inventory that outlines all datasets their origins and how they should be utilized.
-
Ensure a streamlined data experience across teams supporting both predefined analytics and spontaneous inquiries.
-
Take charge of the foundational data framework leveraging tools that enable infrastructure automation.
-
Enable both scheduled batch handling and ondemand streaming data capabilities.
-
Collaborate closely with multiple departments to clarify and sequence datarelated priorities.
-
Deliver regular updates to internal stakeholders regarding data readiness platform efficiency and project developments.
Experience & Competencies
-
Over 8 years working in data engineering or adjacent technical fields.
-
Recognized ability in managing data storage systems and overseeing data reliability in dataheavy contexts.
-
Fluency in using Python and SQL to manage and transform data.
-
Handson familiarity with scalable analytics platforms such as BigQuery Snowflake or Databricks.
-
Experience developing and managing ETL/ELT workflows using orchestration frameworks like Airflow dbt or Dagster.
-
Background in harmonizing numerous and varied data feeds.
-
Proficient in working with at least one major cloud provider (knowledge of GCP is advantageous).
-
Exposure to realtime data movement tools such as Kafka Flink Spark Streaming Dataflow or Kinesis.
-
Understanding of modern AI methods including largescale language models or reinforcement learning is a bonus.
-
Excellent communication capabilities able to convey complex concepts to both technical and nontechnical audiences.
-
A seniorlevel contributor confident in engaging with both software practitioners and executive leaders.
What We Offer
-
An adaptive setting that values creative approaches and bold ideas.
-
A performanceoriented workplace ethos.
-
Comprehensive health coverage and a retirement matching scheme.
-
Immediate access to vacation benefits.
-
Support for public transit usage.
-
Donation matching program.
-
Flexible scheduling with the option to work remotely parttime.
-
Contemporary office amenities including a fitness area relaxation zones lockers and showers.
Employment Type
Full Time
