About Cognite
Embark on a transformative journey with Cognite a global SaaS forerunner in leveraging AI and data to unravel complex business challenges through our cutting-edge offerings including Cognite Atlas AI an industrial agent workbench and the Cognite Data Fusion (CDF) platform. We were awarded the 2022 Technology Innovation Leader for Global Digital Industrial Platforms & Cognite was recognized as 2024 Microsoft Energy and Resources Partner of the the realm of industrial digital transformation we stand at the forefront reshaping the future of Oil & Gas Chemicals Pharma and other Manufacturing and Energy sectors. Join us in this venture where AI and data meet ingenuity and together we forge the path to a smarter more connected industrial future.
About The Role
Were seeking a Senior Data Platform Engineer who excels at building high-performance distributed systems and thrives in a fast-paced startup environment. Youll be working on cutting-edge data infrastructure challenges that directly impact how Fortune 500 industrial companies manage their most critical operational data.
How youll create an imapct
- Build high-performance data pipelines using Spark Flink and Kafka to process terabyte-scale industrial datasets.
- Develop low-latency APIs and services supporting thousands of concurrent users with sub-second response times.
- Optimize time-series sensor and operational data storage and retrieval for massive scale.
- Engineer distributed processing solutions including real-time streaming that handles millions of events per second.
- Design and evolve cost-efficient data lake architectures (S3/GCS) using modern formats like Parquet/ORC.
- Optimize OLAP query performance across systems such as ClickHouse Pinot or Druid.
- Build fault-tolerant highly-available systems with circuit breakers retries and distributed tracing.
- Drive technical innovation through research prototyping and contributions to open-source.
- Collaborate with product and architecture teams to translate complex industrial data problems into scalable production-grade solutions.
What you bring:
- Deep expertise in Spark internals including Catalyst optimizer partitioning and performance tuning.
- Strong hands-on experience with Flink/Kafka for both streaming and batch workloads.
- Proven ability to scale systems to 10K QPS with strong foundations in JVM performance GC tuning and memory management.
- Experience building high-throughput REST/gRPC services and advanced caching with Redis/in-memory data structures.
- Strong understanding of monitoring and observability (Prometheus Grafana OpenTelemetry).
- Solid architectural thinking with an ability to design distributed secure and resilient platforms.
- Collaborative mindset with the ability to work across engineering product and platform teams.
Qualifications
- 612 years of experience in distributed data systems backend engineering or platform engineering.
- Strong programming skills in Scala Java or Python.
- Experience with cloud platforms (AWS/GCP/Azure) and data lake/object storage.
- Prior experience with large-scale data OLAP systems or industrial/IoT data is a plus.
- Contributions to open-source or experience in industrial data/AI platforms is an added advantage.
Whar we offer:
- Opportunity to build world-class Industrial DataOps systems powering global energy manufacturing and industrial AI customers.
- A fast-growing high-ownership environment in Cognites India R&D Center.
- Work on cutting-edge distributed systems streaming architectures AI-ready data platforms and industrial-scale challenges.
- A culture that rewards innovation autonomy continuous learning and open-source contribution.
- Competitive compensation equity and benefits aligned with Cognites global standards.
Join the Global Cognite Community
Be part of a diverse global team of 70 nationalities building technology that transforms how the worlds industries operate.
Work from our modern Bengaluru hub in a hybrid high-trust environment with a flat structure and direct access to decision-makers.
At Cognite youll learn fast make an impact and grow your career alongside exceptional talent.
Why Cognite
Recognized by CNBC and Frost & Sullivan as a global innovation leader Cognite is driving the next wave of industrial AI and digital transformation.
Join us to shape the future of data and industry.
Apply today and follow us on LinkedIn (@Cognite) to discover more opportunities.
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
About CogniteEmbark on a transformative journey with Cognite a global SaaS forerunner in leveraging AI and data to unravel complex business challenges through our cutting-edge offerings including Cognite Atlas AI an industrial agent workbench and the Cognite Data Fusion (CDF) platform. We were award...
About Cognite
Embark on a transformative journey with Cognite a global SaaS forerunner in leveraging AI and data to unravel complex business challenges through our cutting-edge offerings including Cognite Atlas AI an industrial agent workbench and the Cognite Data Fusion (CDF) platform. We were awarded the 2022 Technology Innovation Leader for Global Digital Industrial Platforms & Cognite was recognized as 2024 Microsoft Energy and Resources Partner of the the realm of industrial digital transformation we stand at the forefront reshaping the future of Oil & Gas Chemicals Pharma and other Manufacturing and Energy sectors. Join us in this venture where AI and data meet ingenuity and together we forge the path to a smarter more connected industrial future.
About The Role
Were seeking a Senior Data Platform Engineer who excels at building high-performance distributed systems and thrives in a fast-paced startup environment. Youll be working on cutting-edge data infrastructure challenges that directly impact how Fortune 500 industrial companies manage their most critical operational data.
How youll create an imapct
- Build high-performance data pipelines using Spark Flink and Kafka to process terabyte-scale industrial datasets.
- Develop low-latency APIs and services supporting thousands of concurrent users with sub-second response times.
- Optimize time-series sensor and operational data storage and retrieval for massive scale.
- Engineer distributed processing solutions including real-time streaming that handles millions of events per second.
- Design and evolve cost-efficient data lake architectures (S3/GCS) using modern formats like Parquet/ORC.
- Optimize OLAP query performance across systems such as ClickHouse Pinot or Druid.
- Build fault-tolerant highly-available systems with circuit breakers retries and distributed tracing.
- Drive technical innovation through research prototyping and contributions to open-source.
- Collaborate with product and architecture teams to translate complex industrial data problems into scalable production-grade solutions.
What you bring:
- Deep expertise in Spark internals including Catalyst optimizer partitioning and performance tuning.
- Strong hands-on experience with Flink/Kafka for both streaming and batch workloads.
- Proven ability to scale systems to 10K QPS with strong foundations in JVM performance GC tuning and memory management.
- Experience building high-throughput REST/gRPC services and advanced caching with Redis/in-memory data structures.
- Strong understanding of monitoring and observability (Prometheus Grafana OpenTelemetry).
- Solid architectural thinking with an ability to design distributed secure and resilient platforms.
- Collaborative mindset with the ability to work across engineering product and platform teams.
Qualifications
- 612 years of experience in distributed data systems backend engineering or platform engineering.
- Strong programming skills in Scala Java or Python.
- Experience with cloud platforms (AWS/GCP/Azure) and data lake/object storage.
- Prior experience with large-scale data OLAP systems or industrial/IoT data is a plus.
- Contributions to open-source or experience in industrial data/AI platforms is an added advantage.
Whar we offer:
- Opportunity to build world-class Industrial DataOps systems powering global energy manufacturing and industrial AI customers.
- A fast-growing high-ownership environment in Cognites India R&D Center.
- Work on cutting-edge distributed systems streaming architectures AI-ready data platforms and industrial-scale challenges.
- A culture that rewards innovation autonomy continuous learning and open-source contribution.
- Competitive compensation equity and benefits aligned with Cognites global standards.
Join the Global Cognite Community
Be part of a diverse global team of 70 nationalities building technology that transforms how the worlds industries operate.
Work from our modern Bengaluru hub in a hybrid high-trust environment with a flat structure and direct access to decision-makers.
At Cognite youll learn fast make an impact and grow your career alongside exceptional talent.
Why Cognite
Recognized by CNBC and Frost & Sullivan as a global innovation leader Cognite is driving the next wave of industrial AI and digital transformation.
Join us to shape the future of data and industry.
Apply today and follow us on LinkedIn (@Cognite) to discover more opportunities.
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
View more
View less