Data Engineer & Web3 Backend

Yi-Wen (Claire) Liu

Python engineer building data pipelines and blockchain backends.
Based in London · Open to Crypto & Web3 roles.

About

Python-based engineer based in London, with hands-on experience building automated data pipelines, API integrations, and monitoring systems in production environments.

Background spans ETL workflow design, time-series data modelling (ARIMA, LSTM), and system-level debugging. Currently targeting Data Engineer and Web3 Backend Engineer roles at crypto and blockchain companies.

Actively deepening expertise in on-chain data infrastructure, smart contract interaction via Web3.py, and decentralised application backend architecture.

Master's in Computer Science focused on hybrid ML forecasting models, achieving a 22% reduction in prediction error.

15+ Machines monitored in production
22% Reduction in forecast error (MSc research)
3 mo To department-wide adoption
~70% Background noise filtered by anomaly algorithm

Skills

Data Engineering

Python SQL ETL / ELT Pipelines Apache Airflow dbt PostgreSQL BigQuery Google Cloud APIs Time-series Modelling ARIMA · LSTM

Web3 & Blockchain

Web3.py Ethereum Smart Contracts On-chain Data Event Log Indexing DeFi ERC-20 / ERC-721

Backend & Infra

REST API Docker Bash / Shell Google Apps Script C Git

Currently Learning

Apache Kafka Spark Solidity Hardhat Redis Kubernetes

Experience

Compal Electronics Software Engineer Dec 2023 – Feb 2025 · Full-time · Taipei, Taiwan
Project 1

Build Performance Monitoring Pipeline

Python Windows Batch Google Sheets API Google Apps Script REST API Data Pipeline
Situation

The firmware team managed 15+ parallel development machines with build times ranging from 2 to 60+ minutes, with no systematic way to detect anomalies or allocate hardware resources — decisions were made ad hoc.

Task

Design and deploy an automated data collection and anomaly detection system from scratch, with zero dedicated infrastructure budget.

Action

Built an end-to-end data pipeline using Python and Windows Batch scripting embedded directly into each machine's codebase (zero-touch ingestion). Designed a two-layer Google Sheets architecture separating raw ingestion from a management dashboard. Implemented a dynamic anomaly threshold algorithm (μ + 1.5σ) filtering ~70% of background noise, with real-time API uploads for live alerting.

Result

System was mandated for department-wide adoption within 3 months and became the sole objective reference for hardware resource planning. Anomaly alerts earned full operational trust — engineers proactively followed up on every trigger.

Project 2

BIOS/Firmware Debugging & Validation

C ACPI / ASL BIOS Debugging Firmware Validation Technical Documentation
Situation

Cross-regional firmware issues between Taiwan R&D and China QA teams frequently stalled device bring-up, with no structured triage process — bugs could live in local firmware, IBV logic, or vendor tooling.

Task

Act as technical liaison to isolate root causes and establish reproducible validation workflows to accelerate bug resolution across three stakeholder groups.

Action

Investigated ACPI/ASL-level anomalies by collaborating with IBV engineers to map fault boundaries. Built structured validation checklists where none existed, and documented triage decision trees to enable QA self-resolution.

Result

Reduced engineering queue backlog by enabling QA to independently resolve a recurring class of issues without R&D escalation. Technical documentation was adopted as the standard onboarding reference for new firmware engineers.

Education

National Dong Hwa University (NDHU) MSc Computer Science and Information Engineering Sep 2021 – Jul 2023 · Taiwan
Master's Thesis

Integrating Statistical and Deep Learning Models for Time-Series Data Prediction

Python pandas Keras scikit-learn ARIMA SMA LSTM
Focus

Hybrid time-series forecasting, combining statistical models (ARIMA, SMA) with deep learning (LSTM) to reduce prediction error by up to 22% across financial, environmental, and public health datasets.

Work

Built end-to-end data preprocessing workflows, ran forecasting experiments across statistical and deep learning approaches, and compared model behaviour across datasets to evaluate prediction performance.

Result

Completed full thesis writing and research presentation materials, with hands-on experience in data preprocessing, model comparison, and result evaluation.

Data Mining Pattern Recognition Big Data Systems Blockchain Principle & Application Cryptography Operating System Engineering Optimisation & Decision Making
National Dong Hwa University (NDHU) BSc Computer Science and Information Engineering Sep 2017 – Jul 2021 · Taiwan
Team Project

Resource Allocation & Booking Optimisation System

Android Frontend Team Project
What it did

A scheduling-based reservation system for allocating manpower and resources for the following month.

My contribution

Built the Android frontend and supported report writing and poster preparation for project delivery.

Computer Networks Software Engineering Big Data Analytics Computer Vision

Activities

Tennis Club, NDHU — Treasurer, 2 years. Managed the club's income, expenses, and budget records, and supported its formal evaluation process — helping the club pass evaluation and secure an office space the following academic year.

Blog

Learning notes on Data Engineering, Web3, and Python — coming soon.

Contact

Open to Data Engineer and Web3 Backend roles in London and remote.