Data Engineer (Cloudera)
Salary undisclosed
Checking job availability...
Original
Simplified
Job Title: Data Engineer – Data (Cloudera) & AI
Job Description
Responsibilities:
- Manage the day-to-day operations of the big data platform, ensuring high availability, reliability, and performance.
- Proactively monitor big data platform services, components, and clusters to identify potential issues and take corrective actions to maintain platform health.
- Oversee configuration, upgrades, and patching of the big data platform, ensuring all services remain up to date.
- Collaborate with the Authority’s technical teams to facilitate smooth deployment and adoption of new solutions for data ingestion, processing, and workflows.
- Maintain comprehensive documentation of platform configurations, troubleshooting steps, and incident resolution procedures.
- Continuously monitor and address security vulnerabilities, implementing patching strategies to maintain a secure environment.
- Develop automation scripts to streamline administrative tasks, ensure platform health, and maintain operational consistency.
- Ensure seamless operations and adherence to service level agreements (SLAs) for IT solutions.
- Provide support for production issues and troubleshooting.
Qualifications & Skills:
- Hands-on experience in managing and troubleshooting Cloudera Data Platform components, including HDFS, YARN, HIVE, Spark, Impala, Ranger, as well as knowledge of operating systems, security, and networking.
- Experience with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
- Familiarity with middleware applications like Informatica and Denodo, and scripting languages such as Bash, Python, or Shell scripting for automation.
- Exposure to cloud technologies such as AWS and Azure is a plus.
- Strong ability to troubleshoot complex issues, from system resource management to application stack traces.
- Proven track record in implementing high-availability, high-performance, and secure systems hosted in data centers or hybrid cloud environments.
- Cloudera Certified Administrator or similar certifications are a plus.
- Excellent communication skills with the ability to work effectively across cross-functional teams.
- Ability to handle high-pressure situations and manage critical incidents efficiently.
Job Title: Data Engineer – Data (Cloudera) & AI
Job Description
Responsibilities:
- Manage the day-to-day operations of the big data platform, ensuring high availability, reliability, and performance.
- Proactively monitor big data platform services, components, and clusters to identify potential issues and take corrective actions to maintain platform health.
- Oversee configuration, upgrades, and patching of the big data platform, ensuring all services remain up to date.
- Collaborate with the Authority’s technical teams to facilitate smooth deployment and adoption of new solutions for data ingestion, processing, and workflows.
- Maintain comprehensive documentation of platform configurations, troubleshooting steps, and incident resolution procedures.
- Continuously monitor and address security vulnerabilities, implementing patching strategies to maintain a secure environment.
- Develop automation scripts to streamline administrative tasks, ensure platform health, and maintain operational consistency.
- Ensure seamless operations and adherence to service level agreements (SLAs) for IT solutions.
- Provide support for production issues and troubleshooting.
Qualifications & Skills:
- Hands-on experience in managing and troubleshooting Cloudera Data Platform components, including HDFS, YARN, HIVE, Spark, Impala, Ranger, as well as knowledge of operating systems, security, and networking.
- Experience with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
- Familiarity with middleware applications like Informatica and Denodo, and scripting languages such as Bash, Python, or Shell scripting for automation.
- Exposure to cloud technologies such as AWS and Azure is a plus.
- Strong ability to troubleshoot complex issues, from system resource management to application stack traces.
- Proven track record in implementing high-availability, high-performance, and secure systems hosted in data centers or hybrid cloud environments.
- Cloudera Certified Administrator or similar certifications are a plus.
- Excellent communication skills with the ability to work effectively across cross-functional teams.
- Ability to handle high-pressure situations and manage critical incidents efficiently.