Responsibilities
1. Help ingest structured / unstructured can be batch or real time data in the Azure lake and perform cleaning and aggregation as per data requirements
2. Work with business stakeholders and create data marts to be used for reporting
3. Create and maintain data pipelines to transform and load data from Databricks into Datawarehouse models
4. Create and maintain data marts, data catalogue, data lineage, etc
5. Enable data quality checks and scheduling for timely delivery of data
Professional Experience
1. Must have knowledge of data warehouse concept (Star or snowflake) methodology and experience in designing data warehouse dimensional modelling;
2. Must have hands-on experience in Azure Data Factory, Azure Databricks , Azure Synapse Analytics / Datawarehouse, Spark programming in Scala or python (for batch and real time) and Python;
3. Must have at least three years hands-on experience as a Data Engineer including at least two years using Microsoft data tools;
Personal Attributes
1. Positive attitude and disposition
2. Ability to function independently or as a team player
3. Technical aptitude
4. Organized, systematic, logical
5. Willing to learn
Qualification
1. Degree from a recognized university, preferably in Data Analytics or Computer Science domain;
Job Type: Contract
Contract length: 12 months
Pay: $5,000.00 - $8,000.00 per month
Benefits:
- Health insurance
Schedule:
- Day shift
