Data Engineer
Job Description
Description
We are looking for a skilled Data Engineer with 5-7 years of experience to join our team in Southeast Asia. The ideal candidate will have a strong background in building and optimizing data pipelines and architectures, ensuring data quality, and supporting data-driven decision-making across the organization. You will play a key role in transforming raw data into meaningful insights and help drive our analytics capabilities.
Responsibilities
- Design, construct, install, and maintain large-scale processing systems and pipelines.
- Develop and maintain data architectures that support business intelligence and analytics initiatives.
- Collaborate with data scientists and analysts to understand their data needs and provide appropriate data solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Optimize data storage and retrieval processes to improve system performance.
- Implement data ingestion processes from various sources including APIs, databases, and flat files.
- Monitor and troubleshoot data processing workflows and systems.
Skills and Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5-7 years of experience in data engineering or related roles.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
- Familiarity with data warehousing solutions (e.g., Snowflake, Amazon Redshift, Google BigQuery).
- Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
- Knowledge of ETL tools and data pipeline frameworks (e.g., Apache Airflow, Talend).
- Understanding of data modeling, data architecture, and data governance best practices.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and services like S3, Lambda, or BigQuery.
- Strong analytical and problem-solving skills, with attention to detail.
Job Description
Description
We are looking for a skilled Data Engineer with 5-7 years of experience to join our team in Southeast Asia. The ideal candidate will have a strong background in building and optimizing data pipelines and architectures, ensuring data quality, and supporting data-driven decision-making across the organization. You will play a key role in transforming raw data into meaningful insights and help drive our analytics capabilities.
Responsibilities
- Design, construct, install, and maintain large-scale processing systems and pipelines.
- Develop and maintain data architectures that support business intelligence and analytics initiatives.
- Collaborate with data scientists and analysts to understand their data needs and provide appropriate data solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Optimize data storage and retrieval processes to improve system performance.
- Implement data ingestion processes from various sources including APIs, databases, and flat files.
- Monitor and troubleshoot data processing workflows and systems.
Skills and Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5-7 years of experience in data engineering or related roles.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
- Familiarity with data warehousing solutions (e.g., Snowflake, Amazon Redshift, Google BigQuery).
- Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
- Knowledge of ETL tools and data pipeline frameworks (e.g., Apache Airflow, Talend).
- Understanding of data modeling, data architecture, and data governance best practices.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and services like S3, Lambda, or BigQuery.
- Strong analytical and problem-solving skills, with attention to detail.