Checking job availability...
Original
Simplified
- Design, implement, and maintain scalable data pipelines for processing structured and unstructured data.
- Build and manage data lakes and warehouses, ensuring efficient data storage and retrieval.
- Leverage cloud platforms (AWS, Azure, GCP) to optimize data infrastructure for performance, cost, and reliability.
- Implement data quality checks, validation, and governance frameworks to ensure accuracy and security compliance.
- Optimize data pipelines to improve speed, reduce latency, and enhance system performance.
- Collaborate with data scientists, analysts, and stakeholders to deliver business-driven solutions.
- Implement data visualization solutions using tools like Tableau and PowerBI.
- Stay updated on emerging technologies and trends in big data and data engineering.
- Bachelor's or Master's in IT, Computer Science, or related field with 6+ years of experience.
- Strong knowledge of big data technologies (Hadoop, Spark) and NoSQL databases (Cassandra, MongoDB).
- Experience with batch & ETL jobs, and querying tools (Hive, Spark SQL).
- Proficiency in PowerBI and data visualization.
- Experience or willingness to work with real-time stream processing (Kafka, AWS Kinesis).
- Familiarity with DevOps/DataOps principles and automation.
- Basic understanding of Data Science concepts.
- Passionate about technology and continuous learning.
Direct Line: 6697 7866
EA License No: 91C2918
Personnel Registration Number: R2091205
- Design, implement, and maintain scalable data pipelines for processing structured and unstructured data.
- Build and manage data lakes and warehouses, ensuring efficient data storage and retrieval.
- Leverage cloud platforms (AWS, Azure, GCP) to optimize data infrastructure for performance, cost, and reliability.
- Implement data quality checks, validation, and governance frameworks to ensure accuracy and security compliance.
- Optimize data pipelines to improve speed, reduce latency, and enhance system performance.
- Collaborate with data scientists, analysts, and stakeholders to deliver business-driven solutions.
- Implement data visualization solutions using tools like Tableau and PowerBI.
- Stay updated on emerging technologies and trends in big data and data engineering.
- Bachelor's or Master's in IT, Computer Science, or related field with 6+ years of experience.
- Strong knowledge of big data technologies (Hadoop, Spark) and NoSQL databases (Cassandra, MongoDB).
- Experience with batch & ETL jobs, and querying tools (Hive, Spark SQL).
- Proficiency in PowerBI and data visualization.
- Experience or willingness to work with real-time stream processing (Kafka, AWS Kinesis).
- Familiarity with DevOps/DataOps principles and automation.
- Basic understanding of Data Science concepts.
- Passionate about technology and continuous learning.
Direct Line: 6697 7866
EA License No: 91C2918
Personnel Registration Number: R2091205