AWS Cloud Data Engineer (Data Ingestion, ETL)
Job Description
Responsibilities:
- Work with data engineering and machine learning teams to improve our data infrastructure for increased reliability, maintainability, and scalability.
- Architect and design solutions to improve our data delivery capabilities, data quality monitoring, and data pipeline lifecycle.
- Architect and administer our cloud applications such as AWS Glue, Sagemaker, LakeFormation, iceberg lakehouse, etc.
- Managing Regression Testing Suite , Continuous Integration and Contnuous deployment Pipelines.
Mandatory Skill-set
4+ years of designing and building production data pipelines from ingestion to consumption in a cloud environment using SQL and Python.
Experience in cloud application architecture & administration in AWS or Azure.Hands-on experience designing, building and operationalizing large-scale enterprise data solutions and applications. (Airflow, Databricks, Snowflake, Serverless Functions, Cloud storage preferred).
Background in in custom ETL design, implementation, and maintenance. Hands-on experience with Unix/Linux Command Line Interface (CLI).
Thanks,
Rajkumar
UEN 199801439D
Job Description
Responsibilities:
- Work with data engineering and machine learning teams to improve our data infrastructure for increased reliability, maintainability, and scalability.
- Architect and design solutions to improve our data delivery capabilities, data quality monitoring, and data pipeline lifecycle.
- Architect and administer our cloud applications such as AWS Glue, Sagemaker, LakeFormation, iceberg lakehouse, etc.
- Managing Regression Testing Suite , Continuous Integration and Contnuous deployment Pipelines.
Mandatory Skill-set
4+ years of designing and building production data pipelines from ingestion to consumption in a cloud environment using SQL and Python.
Experience in cloud application architecture & administration in AWS or Azure.Hands-on experience designing, building and operationalizing large-scale enterprise data solutions and applications. (Airflow, Databricks, Snowflake, Serverless Functions, Cloud storage preferred).
Background in in custom ETL design, implementation, and maintenance. Hands-on experience with Unix/Linux Command Line Interface (CLI).
Thanks,
Rajkumar
UEN 199801439D