Senior Data Engineer Streaming
Senior Data Engineer Streaming
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
The key to our success is simple; we deliver the highest quality on time with passion and commitment and live every day by a set of great values. Weve built a company that fosters long-term careers in an environment of continuous learning with cutting-edge benefits tools and addition certifications that endorse our company as a great place to work.
Responsibilities
- 10 years of experience in software engineering or data engineering roles with a focus on real-time data processing.
- Deep expertise in streaming technologies especially Apache Flink.
- Strong experience with AWS services (Kinesis Lambda S3 Glue EMR ECS Redshift).
- Proficiency with Apache Iceberg or similar (Delta Lake Hudi).
- Proven experience in joining streaming and batch data (watermarking state management consistency models).
- Strong skills in SQL for data transformations exploration and performance tuning.
- Hands-on experience with data exchange pipelines delivering large datasets securely to multiple consumers.
- Strong understanding of distributed systems networking and modern data architecture.
- Programming experience in Java Scala or Python.
- Experience with BI or frontend data layers (Qlik a plus).
- Advanced English.
- Experience with data cataloging and governance tools.
- Familiarity with data mesh or decentralized data architectures.
- Knowledge of frontend frameworks or dashboarding systems for data applications.
Requirements
- Design and develop scalable low-latency streaming data pipelines using Apache Flink on AWS.
- Architect and implement solutions to join streaming and batch data with strong focus on accuracy consistency and performance.
- Build and maintain infrastructure for efficient and secure data exchange delivering large-scale datasets to internal teams and external partners.
- Leverage Apache Iceberg (or similar) for reliable scalable data table formats across streaming and batch systems.
- Write optimize and maintain complex SQL queries for analytics and platform integration.
- Work with AWS Redshift for scalable batch processing and BI workloads.
- Collaborate with data scientists product teams and platform engineers to enable real-time analytics and new data-driven features.
- Contribute to the evolution of the data platform architecture focusing on observability reliability and developer self-service.
- Partner with frontend engineers to support data visualization and exploration workflows (experience with Qlik or other BI tools is a plus).
#LI-REMOTE
About us
AssureSoft is a multinational software development and information technology company providing strategic consulting technology services and outsourcing business processes. We work to innovate and create quality software with motivated passionate and qualified teams that develop in an environment of professional stable growth and continuous learning.
What sets us apart
- Great Place To Work certification.
- A company with more than 15 years of experience.
- Work with world-class clients and long-term projects.
- English scholarships for an external institute.
- English classes with company teachers.
- State-of-the-art tools and resources.
- Certifications for your professional growth.
- Recreation and leisure activities.
- Compliance with the regulations and labor rights of your region.
Retention of your personal information: AssureSoft will retain your personal information for as long as necessary to fulfill the purposes for which it was collected or as necessary to comply with our legal obligations resolve disputes and maintain appropriate business records. Once the purpose has been fulfilled your personal information will be retained and blocked due to the possibility of legal and governmental requirements and until the status of limitations has run out.
Important Notice Regarding Personal Information: If you do not want your personal and professional information to be retained in our database please send your request for data removal to.
Required Experience:
Senior IC
Employment Type
Full Time
