■ Architect and implement Data warehouse
Design database schema and system architecture for the data warehouse.
The entire system was built using AWS cloud resources.
*stack - 2VPC, 4Subnet, RDS, lambda, lambda layer, AWS step-function, s3, dynamo-db, peering connection, ALB, EC2, ECS, etc.
Dozens of AWS resource in three different environments(production, QA, development) is managed by terraform which is an IaaC tool so that not only applications but also whole infrastructure can be continuously deployed 100% automatically with the help of Jenkins.
■ Data warehouse ETL Pipeline
Collect and process millions of data(trading, deposit, withdrawal, referral reward, etc.) to derive business insights via the ETL pipeline.
The ETL pipeline consists of AWS RDS, step-function, lambda, cloud-watch so that Data extraction, processing, and loading can be simply cascaded without external job queue or other task management systems.
■ Data visualization and serving with ELK
Construct ELK to visualize and serve processed data. Integrate RDS, AWS S3, etc.
■ Integrate blockchain main network
Implement deposit, withdrawal logic for IOST, ZILLIQA main network.
■ Support various kind of backend tasks
Integrate various kind of external API including LG U plus, various kind of web tracking, messaging tools.
Email sending system using AWS pinpoint
더보기