MW Partners is currently seeking a Data Engineer to work for our client who is a global leader in multimedia and creativity software products.
Responsibilities and duties:
Search & Performance Optimization
- Improve speed and efficiency of searches across large datasets.
- Implement caching tuning and best practices to reduce redundant or costly searches.
- Enhance workflows so analysts can pivot and re-use results without re-running full searches.
Data Integration & Reliability
- Strengthen reliability of Splunk data pipelines for exports and integrations.
- Support real-time or near real-time data flows where feasible.
- Improve stability and resiliency of indexing clustering and correlation searches.
Governance & Lifecycle Management
- Review and rationalize knowledge objects (saved searches lookups dashboards).
- Establish monitoring for field drift or schema changes that impact detections.
- Define lightweight governance processes for detection lifecycle management versioning and validation.
- Support alignment with broader data governance policies including access controls retention and auditability.
Advanced Capabilities & Usability
- Explore and implement notebook-style investigation support for collaboration and reproducibility.
- Assist in enabling inline data transformation and ML/AI-driven enhancements where practical.
- Provide guidance on best practices for detection-as-code and integration with CI/CD systems.
Requirements:
- 9-12 YOE
- Strong hands-on experience with Splunk Enterprise / Enterprise Security administration and development.
- Expertise in SPL optimization indexing and performance tuning.
- Experience with data integration and pipeline reliability.
- Familiarity with data governance practices as applied to Splunk (knowledge object hygiene schema evolution access/retention policies).
- Proficiency in Python or scripting for automation and advanced handling.
Nice to Have:
- Experience with detection engineering and detection-as-code frameworks.
- Background in ML/AI features in Splunk or adjacent tools.
- Understanding of compliance frameworks and their implications for Splunk governance.
For a confidential discussion or to find out more contact Rucha Swain on / Indu Sri Lakavath on or apply now.