Data Engineer – Python

• Build ingestion workflows for APIs, web data, and files.
• Handle structured and semi- structured formats (JSON, XML, HTML, CSV).
• Apply resilient scraping practices, including session handling, proxies, and request
automation.
• Ensure compliance with security and access restrictions when integrating external
data sources.
• Ensure data quality, consistency, and scalability across workflows.
• Implement testing frameworks and good engineering practices for reliability.
• Optimize SQL queries and transformations for analytics.
• Design, build, and maintain robust Python- based data pipelines.

• Familiarity with best practices in testing, monitoring, and pipeline reliability.
• Knowledge of web scraping, ingestion workflows, and handling varied data formats.
• Proficiency with version control (Git/GitHub/Azure DevOps).
• Experience designing and maintaining production- grade data pipelines.
• Expert- level Python for data engineering and workflow automation.
• Strong SQL skills for ETL and analytics.
Qualifications
• BSc or MSc in Computer Science, Data Engineering, Software Engineering, or related fields.
• Equivalent practical experience will also be considered

• Opportunities for onsite work in Japan, Singapore, Australia, and many other countries.
• Salary: Negotiation
• Work and grow in a dynamic, creative, and professional environment.
• Join a global team and work directly with many talents around the world.
Healthcare: Premium Health Insurance TECHVIFY Care
• Annual salary evaluation.
• 13 months’ salary per year.
• Sponsor and encourage staff to study courses by covering tuition fees, such as Udemy, Coursera.

Cập nhật gần nhất lúc: 2025-11-08 17:35:03