Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Yesterday
Vacancies:
1 Vacancy
Job Summary
- Working with multiple stakeholder communities to understand our data needs and create pipelines to take data between different layers in the platform
- Ensuring the technical infrastructure is in place and appropriate to support managing the data platform and associated activities such as pipelines
- Creating standards and patterns to ensure that future development adhere to a high-quality fit for purpose framework
- Defining features and capabilities to move the dial on data usage within the insurance industry
- Providing governance and consultancy to users of the data platform and data related questions
- Communication client has a broad range of stakeholders with a commitment to becoming data driven. The successful candidate will need to be able to work with a broad stakeholder group and align between multiple viewpoints
- Collaborative client prides itself on its collaborative culture and data engineers will regularly interact with other technical teams and business users
- Willingness to learn the successful candidate will be expected to propose new approaches and prototype solutions
Influence A key part of this role will be to influence the strategic usage of data within client at both a technical and cultural level. - This role will be a mixture of hands-on development and thought leadership
- 3 years working in a Data Engineering role
- Experience designing and using Azure capabilities and especially Analytics tools (incl. Synapse Analytics)
- Strong SQL knowledge ideally with SQL Server and Azure SQL experience
- Knowledge of Python and ideally Spark
- Experience analyzing cleaning migrating and modeling data
- Experience working in an Agile environment
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
