Key Responsibilities:
- Design develop and maintain ELK Stack solutions to ensure efficient log management monitoring and search capabilities.
- Implement optimize and troubleshoot data pipelines for telemetry analytics and observability using Logstash Beats Kafka or other ETL tools.
- Customize Elasticsearch indexing queries and storage solutions to improve system performance and scalability.
- Develop dashboards visualizations and alerting mechanisms in Kibana and other monitoring tools to enhance system observability.
- Integrate ELK solutions with cloud environments (AWS Azure or GCP) and implement security best practices for data storage and access.
- Monitor and optimize system performance resource utilization and search efficiency to maintain high availability and reliability.
- Collaborate with DevOps Security and Software Engineering teams to enhance log processing alerting and data enrichment strategies.
- Automate deployments and configurations using tools like Ansible Terraform Kubernetes and CI/CD pipelines.
- Stay updated with the latest ELK stack developments and industry trends to implement best practices and new features.
Required Skills and Qualifications:
- 710 years of handson experience with Elasticsearch Logstash and Kibana (ELK Stack) in enterprise environments.
- Strong knowledge of log aggregation indexing and data parsing techniques.
- Proficiency in scripting and automation using Python Bash or Groovy.
- Experience with observability platforms and telemetry solutions including Dynatrace
- Knowledge of distributed systems clustering and highavailability architectures.
- Experience in tuning and scaling Elasticsearch clusters for performance optimization.
- Handson experience with Kafka Fluentd Prometheus Grafana and OpenSearch is a plus.
- Strong background in Linux systems networking and security.
- Familiarity with CI/CD pipelines Git Kubernetes and containerization (Docker).
- Experience with cloud services like AWS OpenSearch Azure Elastic Stack or Google Cloud Logging.
- Strong problemsolving skills and the ability to work in fastpaced environments.