Epicareer Might not Working Properly
Learn More

Data Engineer

Salary undisclosed

Apply on


Original
Simplified

Elasticsearch and Cloudera Engineer

Key Responsibilities

  • Driving operation readiness and resolving the production issues in Elasticsearch, Logstash, and Kibana (ELK)
  • Capacity planning and analysis for Elasticsearch
  • Perform health checks of Elasticsearch clusters and indices regularly.
  • Collect and analyze Elasticsearch slow logs and identify poorly performing queries
  • Troubleshoot performance issues and scaling indices
  • Work with multiple stakeholders to analyze requirements, clarify design dependencies, create test plans, support functional and non-functional activities
  • Set up and configure Elastic stack
  • Configure ELK Stack components to collect and store the data necessary to meet business requirements

What we are looking for

  • Hands-on experience in Elasticsearch, Logstash & Kibana
  • Ability to deploy Elasticsearch, Logstash configurations, tunings, and customizations as per requirements
  • Elasticsearch clustering, performance optimization, and REST API
  • Ability to set up different type of beats and to establish secure data transfers
  • Ability to Search Query, dashboards, and visualizations using Kibana
  • Must have a good understanding of Log Analytics
  • Kibana: Can create different visualization and dashboards according to the requirement
  • Good experience in query languages and writing complex queries with joins that deals with a large amount of data
  • Good understanding and experience with Cloudera CDP services (HDFS, HBase, SPRAK and Ranger)
  • Hands-on experience with security settings implementation and working on vulnerabilities fixes
  • Strong background in managing and maintaining large-scale Linux environments
  • Infrastructure Knowledge (Server / Storage / Network / Services)
  • ITIL knowledge