Epicareer Might not Working Properly
Learn More

Data Engineer

Salary undisclosed

Apply on


Original
Simplified

1 year contract with the client

Description

Work closely with the Product Owner for the development, implementation, and maintenance of Business Intelligence (BI) and Data Warehouse projects, including:

  • Gathering requirements from stakeholders
  • Developing data warehouses and data marts both on-premises and in the cloud
  • Designing and developing reports, dashboards, and interactive visualizations
  • Providing system documentation, ensuring proper version control, and managing program changes
  • Offering operational maintenance and support for non-production environments
  • Handling incidents and service request management to resolve issues within the Service Level Agreement
  • Engaging users to implement enhancements and refinements based on changes in business requirements and agreed timelines
  • Supporting appointed personnel in responding to regular audits or reviews for projects and addressing follow-up actions and recommendations from audit findings
  • Conducting testing of software patches or upgrades and collaborating with the Facilities Management team for production deployment
  • Support the Product Owner in conducting regular clinics and user training/briefings (including training materials) to enhance BI competency for users.

Requirements

  • Candidates should have a tertiary education in relevant fields.
  • A solid understanding of data modeling, data processing, data warehousing, data management, and data security is essential.
  • Hands-on experience in SQL programming is required.
  • Practical experience in data warehouse projects is necessary.
  • Proficiency in visual analytics tools such as Power BI and Tableau is expected.
  • Candidates should possess skills in data engineering, including:
  • Experience with AWS Cloud services (e.g., Lambda, Glue, Athena)
  • Python and container development
  • SQL and PostgreSQL database management (creating tables, views, and partitioning)
  • Development of ingestion scripts using SSIS
  • Data modeling experience, preferably in ER Studio, is advantageous.
  • Familiarity with the following is beneficial:
  • Denodo, SQL Polybase
  • Azure DevOps, GitLab, JIRA, Confluence
  • Microsoft SharePoint development
  • Unix scripting for secure file transfers
  • Dot Net programming (e.g., C#)
  • Kafka / AWS Kinesis
  • Strong analytical, logical thinking, and problem-solving abilities are necessary.
  • A willingness to learn and adapt, along with excellent communication skills (both written and spoken), is required.