| Detailed JD (Roles and Responsibilities) | 3 years of hands-on experience with IBM StreamSets (Data Collector & Transformer).
- Strong understanding of pipeline performance tuning (e.g. stage optimization buffer tuning cluster resource allocation).
- Proficiency in Java/Python/Groovy for custom scripting in StreamSets. -
- Knowledge of SQL NoSQL databases and CDC (Change Data Capture) techniques.
- Ability to diagnose and resolve memory leaks thread contention and network bottlenecks.
- Familiarity with CI/CD for StreamSets pipelines (Git Jenkins Docker).
- Strong analytical skills to profile and benchmark pipeline performance.
- Analyze and troubleshoot pipeline performance bottlenecks (CPU memory I/O latency) and implement optimizations.
- Fine-tune JVM settings parallelism partitioning and batch sizes for optimal throughput.
- Implement best practices for error handling data validation and recovery mechanisms in pipelines.
- Optimize slow-running stages memory-heavy transformations and network latency issues.
Work with Kafka and other data sources. |
| Mandatory skills | Strong understanding of pipeline performance tuning (e.g. stage optimization buffer tuning cluster resource allocation).
- Proficiency in Java/Python/Groovy for custom scripting in StreamSets. -
- Knowledge of SQL NoSQL databases and CDC (Change Data Capture) techniques.
- Ability to diagnose and resolve memory leaks thread contention and network bottlenecks.
- Familiarity with CI/CD for StreamSets pipelines (Git Jenkins Docker). |
| Desired skills | Good to have migration experience from Open Source to Enterprise |
| Work Location | India |
| Mode of Interview- Telephonic/Face to Face/Video Interview | Telephonic (Teams Video Calling ) and F2F |
| WFO / WFH / Hybrid | Hybrid |
| Shift Details (Time) | 12 PM to 9 PM |
Detailed JD (Roles and Responsibilities) 3 years of hands-on experience with IBM StreamSets (Data Collector & Transformer). - Strong understanding of pipeline performance tuning (e.g. stage optimization buffer tuning cluster resource allocation). - Proficiency in Java/Python/Groovy for cus...
| Detailed JD (Roles and Responsibilities) | 3 years of hands-on experience with IBM StreamSets (Data Collector & Transformer).
- Strong understanding of pipeline performance tuning (e.g. stage optimization buffer tuning cluster resource allocation).
- Proficiency in Java/Python/Groovy for custom scripting in StreamSets. -
- Knowledge of SQL NoSQL databases and CDC (Change Data Capture) techniques.
- Ability to diagnose and resolve memory leaks thread contention and network bottlenecks.
- Familiarity with CI/CD for StreamSets pipelines (Git Jenkins Docker).
- Strong analytical skills to profile and benchmark pipeline performance.
- Analyze and troubleshoot pipeline performance bottlenecks (CPU memory I/O latency) and implement optimizations.
- Fine-tune JVM settings parallelism partitioning and batch sizes for optimal throughput.
- Implement best practices for error handling data validation and recovery mechanisms in pipelines.
- Optimize slow-running stages memory-heavy transformations and network latency issues.
Work with Kafka and other data sources. |
| Mandatory skills | Strong understanding of pipeline performance tuning (e.g. stage optimization buffer tuning cluster resource allocation).
- Proficiency in Java/Python/Groovy for custom scripting in StreamSets. -
- Knowledge of SQL NoSQL databases and CDC (Change Data Capture) techniques.
- Ability to diagnose and resolve memory leaks thread contention and network bottlenecks.
- Familiarity with CI/CD for StreamSets pipelines (Git Jenkins Docker). |
| Desired skills | Good to have migration experience from Open Source to Enterprise |
| Work Location | India |
| Mode of Interview- Telephonic/Face to Face/Video Interview | Telephonic (Teams Video Calling ) and F2F |
| WFO / WFH / Hybrid | Hybrid |
| Shift Details (Time) | 12 PM to 9 PM |
View more
View less
Job Location:
Monthly Salary:
Posted on:
17 hours ago
Vacancies:
1 Vacancy
