Job Description
Must have Skills : Python (Strong), SQL (Strong)
Good To Have Skills : Snowflake, MySQL (Capable),Hive, StarRocks, OceanBase
Job Description : We are looking for an experienced candidate from Guangdong, China location having 3-6 year of Data engineer experience.
The candidate should be comfortable to speak Chinese Mandarin language to communicate.
Key Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines to support various business needs.
- Implement data ingestion processes from multiple sources, ensuring data quality and integrity.
- Integrate data from different sources, including databases, APIs, and third-party data providers.
- Develop ETL (Extract, Transform, Load) processes to transform raw data into usable formats.
- Design and optimize database schemas to support data storage and retrieval.
- Manage and maintain relational and non-relational databases, ensuring high performance and availability.
- Develop and maintain data warehouses to support analytical and reporting needs.
- Implement best practices for data warehousing, including partitioning, indexing, and caching.
- Implement data quality checks and validation processes to ensure data accuracy and consistency.
- Establish and enforce data governance policies and procedures.
- Communicate effectively with technical and non-technical team members.
- Monitor and optimize the performance of data pipelines and databases.
- Troubleshoot and resolve issues related to data processing and storage.
- Ensure data security and compliance with relevant regulations and standards.
- Implement data encryption, access controls, and other security measures.
Requirements:
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with database management systems (e.g., MySQL, PostgreSQL, SQL Server).
- Can communicate in Chinese Mandarin language.
- Knowledge of ETL tools and processes
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.