
Data Engineer (1 Year Contract)
Job Summary
You will be working with our client who are well renowned in the public and financial sector. The ideal candidate will have a minimum of 9 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, building, maintaining and supporting big data platforms.
Responsibilities
- Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.
- Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health
- Manage configuration, upgrades, and patching of big data platform, ensuring all services are up to date
- Work with the technical teams to ensure smooth deployment and adoption of new solution to support data ingestions, process and workflows
- Maintain clear and detailed documentation of platform configuration, troubleshooting steps and incident resolution.
- Continuously monitor for and address platform security vulnerabilities. Implement patching strategies to resolve identified vulnerabilities and maintain a secure environment.
- Develop automation script to streamline administrative tasks, platform health and ensure operational consistency.
- Ensure the smooth operations and service level of IT solutions.
- Support production issues
Requirements
- Bachelor's Degree in Computer Science, Computer Engineering or equivalent
- Hands-on experience, knowledge and troubleshooting of Cloudera Data Platform such as HDFS, YARN, HIVE, Spark, Impala, Ranger, operating systems, security and network.
- Hands on experience with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG
- Familiarity with middleware applications i.e. Informatica, Denodo and scripting languages like bash, python, or shell scripting for automation
- Experience with cloud technology i.e. AWS, Azure is a plus
- Ability to troubleshoot complex issues ranging from system resource to application stack traces.
- Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
- Cloudera Certified Administrator or similar certification are a plus.
- Excellent communication skill to work with cross-functional teams
- Ability to handle high-pressure situations and manage critical incidents
If you are interested in this role and would like to discuss the opportunity further please click apply now or email Chew Kai-Xinn at [email protected] for more information.
Only shortlisted candidates will be responded to, therefore if you do not receive a reply within 14 days please accept this as notification that you have not been shortlisted.
Morgan McKinley Pte Ltd
Chew Kai-Xinn
EA Licence No: 11C5502
EAP Registration No: R2196712