Epicareer Might not Working Properly
Learn More

Data Engineer (Cloudera)

Salary undisclosed

Checking job availability...

Original
Simplified

Job Title: Data Engineer – Data (Cloudera) & AI

Job Description

Responsibilities:

  • Manage the day-to-day operations of the big data platform, ensuring high availability, reliability, and performance.
  • Proactively monitor big data platform services, components, and clusters to identify potential issues and take corrective actions to maintain platform health.
  • Oversee configuration, upgrades, and patching of the big data platform, ensuring all services remain up to date.
  • Collaborate with the Authority’s technical teams to facilitate smooth deployment and adoption of new solutions for data ingestion, processing, and workflows.
  • Maintain comprehensive documentation of platform configurations, troubleshooting steps, and incident resolution procedures.
  • Continuously monitor and address security vulnerabilities, implementing patching strategies to maintain a secure environment.
  • Develop automation scripts to streamline administrative tasks, ensure platform health, and maintain operational consistency.
  • Ensure seamless operations and adherence to service level agreements (SLAs) for IT solutions.
  • Provide support for production issues and troubleshooting.

Qualifications & Skills:

  • Hands-on experience in managing and troubleshooting Cloudera Data Platform components, including HDFS, YARN, HIVE, Spark, Impala, Ranger, as well as knowledge of operating systems, security, and networking.
  • Experience with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
  • Familiarity with middleware applications like Informatica and Denodo, and scripting languages such as Bash, Python, or Shell scripting for automation.
  • Exposure to cloud technologies such as AWS and Azure is a plus.
  • Strong ability to troubleshoot complex issues, from system resource management to application stack traces.
  • Proven track record in implementing high-availability, high-performance, and secure systems hosted in data centers or hybrid cloud environments.
  • Cloudera Certified Administrator or similar certifications are a plus.
  • Excellent communication skills with the ability to work effectively across cross-functional teams.
  • Ability to handle high-pressure situations and manage critical incidents efficiently.

Job Title: Data Engineer – Data (Cloudera) & AI

Job Description

Responsibilities:

  • Manage the day-to-day operations of the big data platform, ensuring high availability, reliability, and performance.
  • Proactively monitor big data platform services, components, and clusters to identify potential issues and take corrective actions to maintain platform health.
  • Oversee configuration, upgrades, and patching of the big data platform, ensuring all services remain up to date.
  • Collaborate with the Authority’s technical teams to facilitate smooth deployment and adoption of new solutions for data ingestion, processing, and workflows.
  • Maintain comprehensive documentation of platform configurations, troubleshooting steps, and incident resolution procedures.
  • Continuously monitor and address security vulnerabilities, implementing patching strategies to maintain a secure environment.
  • Develop automation scripts to streamline administrative tasks, ensure platform health, and maintain operational consistency.
  • Ensure seamless operations and adherence to service level agreements (SLAs) for IT solutions.
  • Provide support for production issues and troubleshooting.

Qualifications & Skills:

  • Hands-on experience in managing and troubleshooting Cloudera Data Platform components, including HDFS, YARN, HIVE, Spark, Impala, Ranger, as well as knowledge of operating systems, security, and networking.
  • Experience with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
  • Familiarity with middleware applications like Informatica and Denodo, and scripting languages such as Bash, Python, or Shell scripting for automation.
  • Exposure to cloud technologies such as AWS and Azure is a plus.
  • Strong ability to troubleshoot complex issues, from system resource management to application stack traces.
  • Proven track record in implementing high-availability, high-performance, and secure systems hosted in data centers or hybrid cloud environments.
  • Cloudera Certified Administrator or similar certifications are a plus.
  • Excellent communication skills with the ability to work effectively across cross-functional teams.
  • Ability to handle high-pressure situations and manage critical incidents efficiently.