You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Runs ~20 options strategies against live market data in shadow mode, records every hypothetical fill under worst/base/optimistic assumptions, and grades each with anytime-valid e-processes. Places no orders.
Which model is really behind your API relay or agent IDE? Behavioral fingerprinting + anytime-valid sequential tests (FPR<=1%). LLMs can't be random - measured on 9 frontier models.
Uplift targeting plus an evidence-grounded local LLM agent and always-valid experiments — a growth system built to say "not you" and "not worth it". Runs offline on a laptop, synthetic data. 9-min demo: https://youtu.be/RgPZ0DGvoOw
Measure your agent harness, find where it wastes the model, and prove the fix worked. Harness-agnostic, agent-agnostic, zero dependencies. Reference implementation of HTP-1.
A/B testing and causal inference scored against known answers: simulations where I set the effect, and a randomised benchmark the observational methods have to recover.
Bayesian multi-armed bandits for continuous prompt experimentation: Thompson sampling routes traffic to the best prompt variant and a stopping rule promotes a winner without a fixed-N A/B test. Zero dependencies, TypeScript-first.
Experiment design, CUPED, always-valid sequential testing (mSPRT) and uplift targeting, validated on the Hillstrom email experiment. Includes a live demo.
Statistics toolkit and CLI for A/B tests: sample-ratio and guardrail checks, z / Welch / Mann-Whitney / bootstrap / delta-method tests, CUPED, Bayesian win probability, mSPRT and group-sequential testing, power/MDE, with Monte-Carlo validation of alpha and power.
Your A/B test winner is about half as good as it looked. The winner's curse, peeking and power measured on 32,363 real randomised experiments -- with a live demo that re-splits the traffic in your browser.