Data Engineer 4

MW Partner

Not Interested
Bookmark
Report This Job

profile Job Location:

San Jose, CA - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

MW Partners is currently seeking a Data Engineer to work for our client who is a global leader in multimedia and creativity software products.

Responsibilities and duties:

Search & Performance Optimization

  • Improve speed and efficiency of searches across large datasets.
  • Implement caching tuning and best practices to reduce redundant or costly searches.
  • Enhance workflows so analysts can pivot and re-use results without re-running full searches.

Data Integration & Reliability

  • Strengthen reliability of Splunk data pipelines for exports and integrations.
  • Support real-time or near real-time data flows where feasible.
  • Improve stability and resiliency of indexing clustering and correlation searches.

Governance & Lifecycle Management

  • Review and rationalize knowledge objects (saved searches lookups dashboards).
  • Establish monitoring for field drift or schema changes that impact detections.
  • Define lightweight governance processes for detection lifecycle management versioning and validation.
  • Support alignment with broader data governance policies including access controls retention and auditability.

Advanced Capabilities & Usability

  • Explore and implement notebook-style investigation support for collaboration and reproducibility.
  • Assist in enabling inline data transformation and ML/AI-driven enhancements where practical.
  • Provide guidance on best practices for detection-as-code and integration with CI/CD systems.

Requirements:

  • 9-12 YOE
  • Strong hands-on experience with Splunk Enterprise / Enterprise Security administration and development.
  • Expertise in SPL optimization indexing and performance tuning.
  • Experience with data integration and pipeline reliability.
  • Familiarity with data governance practices as applied to Splunk (knowledge object hygiene schema evolution access/retention policies).
  • Proficiency in Python or scripting for automation and advanced handling.

Nice to Have:

  • Experience with detection engineering and detection-as-code frameworks.
  • Background in ML/AI features in Splunk or adjacent tools.
  • Understanding of compliance frameworks and their implications for Splunk governance.

For a confidential discussion or to find out more contact Rucha Swain on / Indu Sri Lakavath on or apply now.

MW Partners is currently seeking a Data Engineer to work for our client who is a global leader in multimedia and creativity software products. Responsibilities and duties: Search & Performance Optimization Improve speed and efficiency of searches across large datasets. Implement caching tuning and ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala