Senior Data Engineer

Senior Data Engineer

About us:

Make a difference and advance your career by helping deliver some of the UKs most important #tech4good projects making the world a smarter safer greener and healthier place.

Youll join a talented team of dynamic and driven professional problem solvers; creative thinkers and solutions builders who thrive on helping clients meet the most exciting digital transformation challenges.

AAs a certifiedyoull experience a dynamic and nurturing environment that rewards initiative and flexibility and enjoy a career path tailored to your own aspirations.

Founded in 1992 we are a successful growing International digital transformation consultancy. We deliver multi-Queens Award for innovation winning platforms and services that support large-scale digital transformation. Our digital data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence Healthcare Sustainable Environment and Land Asset Management and Digital Democracy.

About the role:

As a Senior Data Engineer at Informed Solutions youll take a leading role in designing building and delivering robust data platforms and pipelines that underpin critical public sector services. Your work will enable better decision-making improve service outcomes and help create a healthier safer and more sustainable UK.

Youll be part of a collaborative high-performing team taking ownership of end-to-end delivery on greenfield and transformation programmes while guiding and supporting colleagues to deliver high-quality data solutions. Working closely with Software Engineering User-Centred Design Data Science Delivery Management and Live Services youll help shape enterprise-scale data platforms for high-profile clients influencing technical direction and driving innovation.

As a technology-agnostic consultancy we empower you to design the right data solutions for each challenge. With technologies spanning Python SQL cloud-native data services streaming platforms and modern data tooling across AWS Azure and GCP youll have opportunities to deepen your expertise explore new approaches and grow your career.

Role Responsibilities

This is a varied role that requires adaptability ambition and a proactive approach in a fast-paced agile environment.

You will:

• Own delivery of data services: Take responsibility for the engineering and delivery of small-to-medium data services (or major components of larger platforms) across the full lifecycle from design and build through to deployment operation and continual improvement.
• Lead on data architecture and design: Take ownership of the end-to-end design of data pipelines data models and platform components producing and maintaining high-quality technical documentation. Collaborate with Lead and Principal Engineers Data Architects and practitioners from disciplines such as UCD and Data Science to review and refine designs and translate them into robust implementations.
• Build and operate data pipelines: design develop test and deploy ETL pipelines to source cleanse and optimise data at scale.
• Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow) implementing testing alerting monitoring and data quality checks as first-class concerns.
• Ensure data quality and observability: Embed data testing and validation processes alongside monitoring and alerting systems such as Prometheus and Grafana to ensure reliability performance and operational insight across data services.
• Work with metadata and standards: Implement metadata capture and validation within data pipelines including working with geospatial metadata standards where relevant to support governance discovery and reuse.
• Support delivery planning: Partner with Delivery Managers to plan and structure technical activities provide accurate and commercially sound estimates and proactively identify and mitigate technical risks issues and dependencies.
• Build stakeholder trust: Act as a trusted technical advisor to client counterparts partner organisations and third parties ensuring alignment between data requirements business needs and technical delivery.
• Mentor and develop others: Provide guidance and technical leadership to Data Engineers and adjacent roles supporting professional growth and fostering a culture of high-quality sustainable delivery.

Essential Skills

• 5 years proven experience in a Data Engineering role delivering production-grade data platforms and pipelines.
• Strong Python skills with experience using Python to build test and operate data pipelines and services.
• Proficiency with at least one major cloud platform (AWS Azure or GCP) delivering scalable secure and well-architected data solutions.
• Strong experience working with core data stores including relational databases such as PostgreSQL and Microsoft SQL.
• Experience with non-relational and NoSQL data stores (e.g. DynamoDB MongoDB or equivalent) and understanding when to apply them.
• Hands-on experience designing and operating event streaming platforms including Kafka and its core concepts on topics messages and consumers.
• Experience building and operating automated data workflows using tools like Apache Airflow.
• Experience implementing data quality and validation checks throughout pipelines to ensure accuracy completeness consistency and reliability.
• Practical experience implementing monitoring observability and alerting for data platforms using tools such as Prometheus and Grafana.
• Strong understanding of data architecture patterns including data lakes data warehouses and event-driven architectures.
• Awareness of GDPR and data protection practices including secure handling of sensitive data and privacy-by-design principles.
• Experience working in Agile environments (Scrum Kanban) contributing to delivery planning estimation and iterative improvement.
• Proven experience mentoring and supporting other engineers enabling high-quality delivery and team capability growth.
• Familiarity with metadata standards including experience validating and implementing metadata with exposure to geospatial metadata standards (e.g. ISO 19115 INSPIRE GEMINI) being highly desirable.

Desirable Skills

• Experience working in a consultancy environment engaging with external stakeholders and clients.
• Exposure to public sector projects and delivering solutions in complex organisational landscapes.
• Experience working with geospatial or GIS data (e.g. spatial databases geospatial data formats or services) is highly desirable reflecting the nature of the work we deliver.
• Experience with Graph databases (e.g. Neo4j Apache Jena) for modelling and querying complex relationships in data.

Senior colleagues experts and leaders at Informed Solutions are committed to supporting coaching upskilling and enabling the success and career progression of each other.

There are some foundation areas however which you need to possess to be able to successfully contribute to your team and work alongside others.

Key abilities that are necessary for success

• Able to work effectively in environments where you can adapt to innovative practices involving uncertainty change and agile working.
• Ability to manage competing priorities and your time so you can deliver high-quality work within deadlines.
• Good interpersonal skills with the ability to respect and accept different perspectives and disagreement work collaboratively in diverse teams and maintain positive working relationships.
• Good judgement and decision-making in complex environments where uncertainty ambiguity and risk must be collaboratively managed by working supportively alongside others.
• Good communication skills including clear constructive written outputs and measured respectful verbal delivery.

We work in a fast-paced ever-evolving innovation and problem-solving workplace environment where no two days are the same. This requires you to have the foundations of personal resilience professional adaptability and flexibility in working alongside others with a positive mindset.

We appreciate that this workplace culture and the level of variety wont suit everyone. However after significant consultations with colleagues at all levels we understand that these are the fundamentals of success in undertaking the complex innovation work which is the DNA of Informed Solutions.

These shared foundations are important to team cohesion performance and mutual personal support.

As colleagues we thrive in successfully problem solving together to deliver real-world impact; and value the variety of challenges and opportunities to learn grow and progress on a personal and professional level.

What Youll Gain

At Informed Solutions youll have the opportunity to make a tangible impact while advancing your career. Youll gain:

• Ownership and influence:Lead the delivery of services shape technical direction and influence project outcomes at a senior level.
• Professional growth:Develop your leadership and mentoring skills guiding colleagues and helping them thrive.
• Exposure to high-profile projects:Work on enterprise-scale digital solutions that improve public services and have societal impact.
• Technical development:Expand your expertise across a wide range of modern technologies including cloud microservices and serverless architectures.
• Collaborative supportive environment:Join a team that values learning knowledge sharing and continuous improvement.
• Career progression:Opportunities to grow within a consultancy setting broadening your client-facing experience and technical leadership.

Our benefits package compliments our highly competitive salaries and our great working environment. We believe that our people should be properly rewarded for their commitment to the continued success of our business through a comprehensive and flexible range of benefits.

These can include:

• InformedACADEMY We offer excellent career development opportunities through our award-winning personal and professional development programmes including support with professional certifications.
• Industry leading health and wellbeing plan We partner with several wellbeing support functions to cater to each individuals need including 24/7 GP services mental health support and physical health support.
• Hybrid working*
• Private Health Care Cover*
• Generous life assurance cover*
• Gym Membership*
• Monthly office lunch
• Onsite massage sessions
• 25 paid working days holiday per year plus bank holidays*
• Sabbatical Leave Scheme*
• Enhanced Maternity Leave and Pay*
• Enhanced Paternity Leave and Pay*
• Company Pension Contribution
• Profit Share Scheme
• Payment of professional subscriptions
• Generous referral scheme with no limits on the number of referrals

*Qualifying period applies

Culture

We are proud to nurture a workplace culturethat is diverse inclusive rewarding and egalitarian.

We strive to live up to our values of Innovation Excellence and Integrity by thinking about things differently always doing our best and acting in good faith at all times.

Were a team of passionate problem solvers. We take pride in helping our clients accelerate and de-risk digital business change so that we can collaborate and codesign world class digital services that solve complex business and safety critical problems particularly where place location or geography are important.

Our workplace culture reflectshow we go about our work the type of work that we choose to do and our commitment and contribution to the sustainable social environmental and economic development aims of the communities that we are part of.

Required Experience:

Senior IC