Data Engineer

uDomain · Hong Kong, Remote (Hong Kong)

Remote Full-time Not specified Engineering

Job Description

Data Engineer (ref: UD-DE-26)

Responsibilities

Design and develop scalable data pipelines for collecting, processing, and storing infrastructure metrics
Build ETL/ELT systems to integrate data from multiple monitoring sources for AI/ML applications
Optimize databases and data warehouses for analytics and machine learning workloads
Develop data validation and quality assurance frameworks
Collaborate with AI/ML engineers to prepare datasets for model training
Monitor and maintain data pipeline performance and reliability
Implement data governance and security best practices

You'll be redirected to the company's application page

Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field (2+ years experience acceptable for non-degree holders)
2+ years professional experience in data engineering or related fields
Strong SQL proficiency and experience with relational databases (PostgreSQL, MySQL)
Experience with NoSQL databases (MongoDB, Cassandra, or similar)
Proficiency in Python or Java for data processing
Experience with big data technologies (Spark, Hadoop) is preferred
Familiarity with cloud data platforms (Snowflake, BigQuery, Redshift) is a plus
Knowledge of Apache Kafka or similar streaming platforms is beneficial
Understanding of data modeling, ETL design patterns, and distributed systems
Experience with containerization and orchestration (Docker, Kubernetes)