Senior Data Platform Engineer

Dataiku

Not Interested
Bookmark
Report This Job

profile Job Location:

New York City, NY - USA

profile Monthly Salary: Not Disclosed
Posted on: Yesterday
Vacancies: 1 Vacancy

Job Summary

Dataiku is The Universal AI Platform giving organizations control over their AI talent processes and technologies to unleash the creation of analytics models and agents. Providing no- low- and full-code capabilities Dataiku meets teams where they are today allowing them to begin building with AI using their existing skills and knowledge.

Context:

Dataiku is looking for a Sr. Data Platform Engineer to join our Enterprise Data and Analytics (EDA) team. As a member of the EDA Team you will play a central role in delivering data & GenAI solutions to fuel analytics and data-driven insights to various stakeholders and teams within the company.

You will be a key technical member contributing to the Data Platform that fuels centralized analytics embedded analytics teams and self-service users across the organization. At this level of seniority non-technical skills learning & teaching and business acumen are critical along with the expectation of technical excellence as you will help drive technical decision-making and solutioning of key technical challenges both within the team and across the Analytics Community. The technical day to day will primarily be within the Data Platform built using Snowflake Dataiku & Github.

The primary development will focus on GenAI Platform Capabilities python & SQL (among other languages) DataOps processes built within Github Actions & Dataiku and data platform processes built within Snowflake & Dataiku. Strong software development lifecycle knowledge and DataOps skills are a must! The ideal candidate is naturally curious has excellent verbal and written communication skills a sharp analytical mind a positive attitude towards work and thrives when collaborating towards a shared goal. This is an internal and non-client facing role.

What youll do:

Dataiku is unique in that every Dataiker is encouraged to use our own product within our Enterprise Data Platform. We are looking for a strong technical engineer to help us to continue to build out our Data Platform internally. GenAI engineering is growing internally which brings a unique opportunity to help build out a Data Platform for GenAI engineering along with delivering a scalable platform with governed data to fuel an entire company of current or potential Data Analysts! This role will also play a key part in delivering GenAI architecture & guidance to our stakeholders. Your responsibilities within the team include but are not limited to:

  • Be an expert level engineer within the Dataiku Platform including Platform Automation GenAI Capabilities Plugin Development maintenance & troubleshooting
  • Be an expert level engineer within Snowflake for data engineering and security/governance features
  • Build & maintain GenAI Platform solutions focused on security and governance for engineering delivery
  • Build & maintain Python & SQL based platform automation process
  • Build & maintain DataOps process for SDLC delivery
  • Build & maintain data quality metrics & observability to help drive data quality standards
  • Build & maintain administration systems and applications for monitoring alerting data observability access management platform metrics and end user transparency
  • Assist Data Engineering with building python & SQL data replication & data pipelines on large & often complex data sets
  • Design data models for both short term and long term use cases to support data warehouse scalability
  • Identify opportunities for improvements & optimization for greater scalability & delivery velocity
  • Collaborate with engineers within GenAI Engineering & Analytics Engineering to build scalable solutions within the Data Platform
  • Perform root cause analysis on often complex errors to help ensure data pipeline availability
  • Help drive technical & architectural decisions on the data platform including decisions on data architecture data engineering processes data quality frameworks data access security & governance frameworks DataOps processes & data consumption models.
  • Help test new features in Dataiku and partner tools to both provide feedback internally and determine value towards internal analytics & data platform integration
  • Work closely with key stakeholders across the organization including Infra embedded analytics teams Product and Engineering to help foster both technical implementations & requirements gathering
  • Promote the Data Platform internally help train & mentor others within the organization with technical excellence & provide support on data & platform related inquiries
  • Proactively drive innovation internally with dedicated innovation time & projects that aim to be transformational for either the platform team or company as a whole.
  • Actively contribute to the expertise level and competencies of the EDA Team and participate in the creation and support of data development standards and best practices.

Requirements :

  • 5 years of relevant experience in Data Engineering / Data Platform Engineering /Data Architecture
  • Expert level SQL & Python is a must.
  • Prior experience with Snowflake required
  • Experience & a strong understanding of GenAI development security & governance concepts
  • Prior experience with DevOps technologies such as Github Actions Azure DevOps or Jenkins
  • Experience in Dataiku DSS is a strong plus.
  • Strong understanding of data architecture & data modeling concepts
  • Prior experience building and maintaining replication & data pipelines in a cloud data warehouse or data lake environment
  • Strong analytical mindset; proactively clarifies ambiguous problems challenges assumptions and proposes pragmatic solutions.
  • Works effectively with complex stakeholders translating vague asks into clear testable requirements.
  • Excellent written and verbal communication with senior audiences; articulates business value data products and platform capabilities; produces precise concise documentation.
  • Demonstrated ownership in remote fast-paced environments: manages multiple projects adapts to different roles mentors peers and invests in continuous learning & knowledge-sharing.

What are you waiting for!

At Dataiku youll be part of a journey to shape the ever-evolving world of AI. Were not just building a product; were crafting the future of AI. If youre ready to make a significant impact in a company that values innovation collaboration and your personal growth we cant wait to welcome you to Dataiku! And if youd like to learn even more about working here you can visit our Dataiku LinkedIn page.

Our practices are rooted in the idea that everyone should be treated with dignity decency and fairness. Dataiku also believes that a diverse identity is a source of strength and allows us to optimize across the many dimensions that are needed for our success. Therefore we are proud to be an equal opportunity employment practices are based on business needs without regard to race ethnicity gender identity or expression sexual orientation religion age neurodiversity disability status citizenship veteran status or any other aspect which makes an individual unique or protected by laws and regulations in the locations where we operate. This applies to all policies and procedures related to recruitment and hiring compensation benefits performance promotion and termination and all other conditions and terms of employment. If you need assistance or an accommodation please contact us at:

Protect yourself from fraudulent recruitment activity

Dataiku will never ask you for payment of any type during the interview or hiring process. Other than our video-conference application Zoom we will also never ask you to make purchases or download third-party applications during the process. If you experience something out of the ordinary or suspect fraudulent activity please review our page on identifying and reporting fraudulent activityhere.


Required Experience:

Senior IC

Dataiku is The Universal AI Platform giving organizations control over their AI talent processes and technologies to unleash the creation of analytics models and agents. Providing no- low- and full-code capabilities Dataiku meets teams where they are today allowing them to begin building with AI usi...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala