Principal Data Engineer AWS, SQL, Data Architecture

JOB PURPOSE:
As a Senior Data Engineering, you will be responsible for:

Carrying out day- to- day support for the reporting system
Analyze statistics, data, and algorithms for projection accuracy for the deployed data model.
Develop strategies for data modelling, design, and implementation to meet stated requirements for Metadata management, Operation Data Stores, Data Lake, Data Warehouse, Data Marts and Extract Transform Load environments in batch processing, and real- time injection.
Review existing data architectures to determine overall effectiveness and compliance with determined objectives, develop comprehensive strategies for improving or replacing underperforming areas, and come up with plans to execute these solutions.
Create, maintain, and design relational databases to support enterprise application and physical data modelling according to project requirements for data acquisition and security as well as customer- defined deliverables.
Create and test physical data models for a variety of business data, applications, database structures, and metadata tables to meet operational goals for performance and efficiency.

MAJOR ACCOUNTABILITIES:

Review the existing data workflow and model to provide possible solutions for cost optimization, performance and efficiency
Other assignments such as incidents, ad- hoc tasks, etc..
Take the ownership of designing, building and managing data pipeline on both batch processing and streaming to ensure its availability, reliability and usability for various business demands.

Yêu cầu công việc

TECHNICAL SKILLS:

Good knowledge in ETL Batch, Micro Batch workflow by using SSIS
Strong Experienced in application data architecture, data design patterns such as Data Lake, Data Warehouse for Life Insurance
Good knowledge of life cycle of application developments.
Good knowledge in DevOps tools and practices (source control, build, CI…).
Strong knowledge of SQL and NO SQL Data such as Spark query, Athena, Redshift, Postgres, SQL Server, DynamoDB, and In Memory Database.
Strong Experienced in Data Streaming Workflow by using AWS Components such as AWS Glue Job (PySpark), Glue Data Catalogs, Glue Data Quality, Lake Information, Lambda, S3, IAM

SOFT SKILLS:

Effective project communication
Collaborative Problem- Solving session
Embracing change and learning
Critical evaluation of Data Architecture
Cross- function team projects

PROBLEM SOLVING:

Optimized the existing data workflow to prevent recurring issues, leading to improved stability and performance
Strong analytical and problem- solving skills with a track record of delivery effective and sustainable solutions.

COMMUNICATION:

Collaborated cross- functionally to troubleshoot and resolve intricate data discrepancies, enhancing data integrity

- Flexible working hour
- Professional and international working environment.
- Healthcare and wellness programs.

Cập nhật gần nhất lúc: 2025-12-01 17:10:04