Marco Chen
CS @ UWaterloo
enjoy working with ML Infra, World Model, distributed systems, full-stack.
experience
— Researching on World Model for soccer dynamics, building a Selective SSM + Imagined Rollout + Actor-Critic architecture to predict next latent state and planning strategic actions.
— Optimized harsh event recommendation latency, engineered an offline-first cache layer with a synchronization queue, built an error observability dashboard.
— Designed a RAG persistent memory system and a hiearchical memory retrieval strategy.
— Reviewed and curated AI training datasets for LLM Coding Agents.
— Built end-to-end compliance tests in C#, maintained and optimized the Geotab Drive App.
— Developed a coding plagiarism detection application in Rust and TypeScript.
projects
LLM From Scratch
Implemented all components of a language model from scratch (tokenizer, model, optimizer), trained a minimal Language Model on TinyStory dataset.
Python, PyTorch, Transformers, CUDA, WandB, Multiprocecssing
Nano-vLLM
A minimalistic implementation of a transformer-based LLM inference engine optimized for low-latency and high-throughput on GPU with smart memory management.
Python, CUDA, Multi-Head Attention, KV Cache, Tensor Parallelism, Prefix Cache
LLM Gateway
High-performance API gateway for large language models with smart routing, semantic caching, rate-limiting, and real-time monitoring.
Go, gRPC, Redis, Kafka, PostgreSQL/pgvector, ClickHouse, Docker/Kubernetes, Prometheus/Grafana
High Concurrency Cache System
In-memory cache system optimized for high concurrency workloads with sharding and lock-free data structures.
C++, LRU/LFU/ARC
SnapNote
AI-powered note-taking platform that turns handwritten notes into organized digital documents with RAG semantic search and agentic workflows.
Python, TypeScript, OCR, RAG, LangGraph, PostgreSQL/pgvector, React
WLP4 Compiler
A compiler for the WLP4 language (Simplified C) that generates MIPS assembly code, implemented scanner, parser, semantic analyzer, and code generator from scratch using C++.
C++, Compiler, MIPS
Biquadris
A multiplayer Tetris video game implemented in C++. Supports both CLI and GUI, optimized resources management with RAII, implements software design patterns.
C++, RAII
now
- — researching on World Model, exploring Model-Based Reinforcement Learning
- — exploring CUDA kernels and GPU programming
- — building a nano vllm for macOS hardware (MPS)
updated July 2026