I build AI systems that do more with the hardware at hand. Studying EECS + Business in UC Berkeley’s M.E.T. program; building independently across models, GPU kernels, and practical engineering.
A complete rotated GPTQ-INT4 inference path in llama.cpp: native INT4 matrix instructions, custom attention and gated-delta-net kernels, and a decode graph cut from 847 to 236 launches per token.
Prefill · pp512 · fast preset
Decode · tg128 · empty context
Prefill throughput vs Q4_K_M
Block-Hadamard rotations tame activation outliers; GPTQ quantizes the rotated weights. Custom WMMA kernels then use RDNA3’s INT4 pipeline directly, with fused operations across prefill and decode.
The same pipeline also transfers to Ossicle-4B’s language backbone. One copy of the weights stays in VRAM, with peak usage of 3,358 MiB for the stock model’s quality preset.
Fast uses 4-bit activations for 2.01× prefill throughput, with a larger quality cost. Decode always uses 8-bit activations.
Stock Qwen3.5-4B; same checkpoint, GPU, and build. Q4_K_M: 145.2 tok/s decode, +2.00% perplexity, 0.0278 KLD. WikiText-2 evaluation. Measurements and limitations in the report.
The default quality preset reaches 7,140 tok/s prefill and 200.7 tok/s decode: 1.30× and 1.38× Q4_K_M throughput at comparable measured perplexity degradation (+1.92% vs +2.00%). The fast preset reaches 11,012 tok/s prefill at +8.67% perplexity degradation. Results cover two 4B checkpoints of the same architecture on RDNA3; other model sizes and GPU families are untested. Decode varies by about ±1.5 tok/s with temperature. Cross-GPU leaderboard figures in the report use different conditions and are contextual comparisons.
A 4.9B audio-language model built by grafting Qwen3-Omni’s audio encoder onto Qwen3.5-4B.
A frozen audio encoder, a trained projector, and LoRA adapters connect speech, sound, and music to the language model. Released with evaluation code, quantized checkpoints, and streaming support for long recordings.
MMAU-Pro
Two-pass system
Ossicle describes the clip, then base Qwen3.5-4B answers from that text and Ossicle’s answer. Single-pass score: 52.0%. Category prompts and sampling settings were selected on MMAU-Pro; see the evaluation notes.
Retrieve a conversation by its strongest matching turn. Turn-level scoring lifts the same encoder from 406 to 436 all-gold passes out of 470 LongMemEval-S questions under the released evaluator; a direct annotated-ID check gives 433/470.
Tests whether unchanged learned artifacts can work across language-model hosts, then examines compiling acquired behavior into native model weights.
How should two local language models pass information on a 16 GB GPU? A comparison of six message formats finds concise prose summaries balance factual fidelity with token and memory cost.
Low-cost sensors and predictive models for agricultural emissions management on small and medium farms. Co-authored at Castleknock College and published at IEEE GESSC.
Read publication ↗A guide stick that detects wet surfaces and warns visually impaired users through audio. Built around a single NE555 timer circuit with nearly no added cost or weight.
Built 2018–19 · Patented 2020A free competitor-discovery tool trained on more than one million companies from Crunchbase, Product Hunt, YC, and Kickstarter.
Full-stack engineering · Machine learningEECS + Business at UC Berkeley, through the Management, Entrepreneurship, & Technology program.
From a timer circuit in a guide stick to GPU instructions for a language model, I’m interested in finding the smallest system that solves the problem well.
Irish patent IES87168 · IEEE GESSC publication · SciFest National Finals, Excellence in STEM (2023)
Validated a B2B agricultural-emissions platform and designed a marketplace connecting farmers with sustainable buyers.
One of approximately 30 fellows in a youth accelerator backed by Stripe and NDRC, with mentorship from Intercom and Stripe founders.
Worked in Back-End Metals at the 14 nm fab: physical vapor deposition, metal etch, and statistical process control.
I release music as SVT. Another place to experiment with structure, texture, and sound.
Listen on Spotify ↗