Data Platform Engineer
Data Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
At Technoidentity we re a Data AI product engineering company with over 14 years of experience delivering cuttingedge solutions and we re expanding globally faster than ever. Step in as our Data Engineer (Databricks/Snowflake) and build cloudbased data platforms capable of largescale ingestion realtime analytics BI reporting and machine learning integration.
What s in it for You
Highimpact Projects Evaluate and implement scalable cloud platforms powering millions of data transactions daily.
Fastpaced Growth Collaborate closely with analysts data scientists and crossfunctional teams from day one.
Modern Tech Stack Databricks Snowflake Python Spark SQL Snowpark Power BI and cloudnative architecture.
Cloud at Scale AWS Azure or GCP for deploying robust secure data solutions.
Continuous Learning Work closely with advanced tools like dbt Apache Airflow MLflow Delta Lake SageMaker and Unity Catalog.
Wellbeing & Perks Premium health coverage recharge breaks and performancebased incentives.
What Will You Be Doing
Data Engineering & Implementation
Design build and maintain scalable data pipelines for ingestion and transformation of large files (CSV JSON XML) and transactional database sources.
Implement optimized ETL/ELT workflows capable of incremental processing and near realtime ingestion for millions of records.
Support schema inference and perform ad hoc analyses on raw or semistructured data stored in cloudnative data lakes.
Analytics & BI Enablement
Prepare efficient data models to support interactive BI dashboards achieving subminute response times over extensive datasets.
Collaborate closely with data analysts scientists and business stakeholders to enhance the usability and responsiveness of analytics solutions.
Machine Learning Integration
Utilize platformnative tools for seamless machine learning integration model lifecycle management and process automation.
Contribute actively to the tuning and cost optimization of data platforms to ensure efficiency and scalability.
Governance & Security
Ensure robust data security lineage tracking and governance through integration with Unity Catalog Snowflake Governance or equivalent tools.
Platform Evaluation & Optimization
Engage in continuous performance tuning cost assessment and evaluation metrics as part of broader platform initiatives.
Requirements
What Makes You the Perfect Fit
2 4 years of handson cloud data engineering experience (Databricks or Snowflake required; experience in both preferred).
Proficiency in SQL Python Spark (Databricks) or Snowpark/Streams/Tasks (Snowflake).
Experience processing largescale datasets from files and transactional databases.
Familiarity with BI tools such as Power BI including dashboard creation and performance optimization.
Understanding of data governance cataloging access control and compliance frameworks.
Preferred Skills
Solid grasp of data lake architecture cloud storage solutions and compute/storage separation.
Cloud experience with AWS Azure or GCP.
Familiarity with dbt Apache Airflow Delta Lake or Azure Data Factory.
Exposure to machine learning tools such as MLflow SageMaker or Snowpark ML.
Agile development experience and strong crossfunctional collaboration skills.
Excellent problemsolving capabilities with meticulous attention to detail.
Ready to Shape the Future of Data & Analytics
This isn t just another role; it s your chance to significantly impact cuttingedge data platforms and analytics solutions at scale. Apply now and let s innovate together!
By applying you confirm the authenticity of your information and authorize background checks for employment purposes.
Qualifications: 6-8 years of project management experience in a technical or IT setting. PMP or PRINCE2 certification is mandatory, demonstrating a strong foundation in project management methodologies and best practices. Experience with project management tools like JIRA, Microsoft DevOps, or equivalent, ensuring efficient project tracking, collaboration, and reporting. Proven ability to build and maintain strong relationships with clients and stakeholders. Strong problem-solving skills and the ability to handle disputes effectively. Experience managing multiple projects or stakeholders simultaneously. Excellent time management skills, with a proven track record of meeting deadlines. Demonstrated ability to thrive under pressure and adapt to shifting priorities. Previous experience interacting with senior management and decision-makers. Ability to work independently, making strategic decisions with significant impact on day-to-day operations. Prior experience managing teams or project efforts in a technical environment is highly desirable.
Employment Type
Full Time
