Lyndon Shi

Cross-engine lakehouse benchmarking has long depended on cross-functional collaboration and domain experts, and the same logical query is hard to compare fairly across execution engines. SpBench compiles platform-agnostic benchmark definitions into engine-specific implementations through typed constructs, records every run as queryable telemetry, and lets AI agents distill, build and analyze benchmarks through three composable skills. The system is in production use for benchmarking Snowpark, Snowpark Connect and other environments, with more than 400 queries running on a regular cadence to catch regressions, and the authoring cycle has shrunk from weeks or months to a single AI development loop.

Cross-engine lakehouse benchmarking has long depended on cross-functional collaboration and domain experts, and the same logical query is hard to compare fairly across execution engines. SpBench compiles platform-agnostic benchmark definitions into engine-specific implementations through typed constructs, records every run as queryable telemetry, and lets AI agents distill, build and analyze benchmarks through three composable skills. The system is in production use for benchmarking Snowpark, Snowpark Connect and other environments, with more than 400 queries running on a regular cadence to catch regressions, and the authoring cycle has shrunk from weeks or months to a single AI development loop.