Skip to content
View jcartu's full-sized avatar

Block or report jcartu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
jcartu/README.md

Joshua Cartu

Ferrari racing driver. Amateur AI researcher.

Empirical work on inference economics, agent memory, and tool-calling reliability.


Latest projects

My newest public projects and research, newest first. I build tools for local AI, measure what actually works, and publish the evidence—including failures.

November 2026 · LLM evaluation

Does a model admit when the source does not contain the answer, or invent one? A live terminal observatory and reproducible benchmark for epistemic abstention, SQuAD v2.0 grounding, and TruthfulQA MC1. Includes resumable runs, paired comparisons, and a published stock-vs-WARMIND case study.

October 2026 · GPU and inference telemetry

A zero-build web dashboard combining GPU telemetry with LLM-serving metrics: VRAM, power, PCIe traffic, token throughput, latency, KV-cache usage, and inference costs. FastAPI, NVML, server-sent events, and a single-file frontend.

October 2026 · Independent inference research

A measured comparison of a two-GPU serving recipe against four-GPU configurations. Includes long-context retrieval, tuning A/B tests, a scheduler-stall reproduction, and checksummed evidence. Completed and cancelled experiments are clearly separated.

September 2026 · Model and runtime qualification

Independent evaluation of FP8 and NVFP4 checkpoints: capability retention, quantization fidelity, serving repairs, long-context retrieval, and sustained load. The report preserves failures and explains why the candidate was not cleared for production.

September 2026 · Linux hardware tooling

Reverse-engineered USB HID controls for EHOMEWEI portable monitors. Brightness unlock, HDR enablement, color troubleshooting, and automatic re-application on plug-in—without the vendor's Windows application.

September 2026 · Reproducible serving experiments

A field-validation harness and results archive covering decode and prefill, cache persistence, eviction correctness, scheduler fairness, and serving-stack qualification on a four-GPU Blackwell workstation.


Approach

  • Measure, then claim. Preserve raw results and distinguish observations from explanations.
  • Make comparisons reproducible. Record model, runtime, configuration, and hardware.
  • Keep failures visible. A completed experiment is not automatically a production recommendation.

Contact

Twitter GitHub Sponsors

The Ferrari part is real. I race the 488 Challenge Evo. The AI part is also real — I just like the juxtaposition.

Pinned Loading

  1. rasputin-memory rasputin-memory Public

    The ultimate memory backend for OpenClaw and Claude Code. Persistent conversation memory with LLM fact extraction, foundation-model reranking, and 77.7% LoCoMo accuracy. MCP native, REST API, self-…

    Python 33 5

  2. llm-stress-harness llm-stress-harness Public

    Diagnostic toolkit for self-hosted LLM inference: failure-taxonomic stress harness + 4-phase orchestrator + parametric vLLM launchers

    Shell 1

  3. qwen-bench qwen-bench Public

    Hub for ongoing Qwen inference benchmarks on NVIDIA Blackwell. Indexes all studies, hosts the rolling SOTA leaderboard, points to the toolchain.

    Python 2 1

  4. qwen36-27b-blackwell-inference-study qwen36-27b-blackwell-inference-study Public

    Systematic 24-hour benchmark study of Qwen3.6-27B inference on dual NVIDIA RTX PRO 6000 Blackwell SM120 (TP=2). 8 experiments comparing repne/vllm fork vs upstream vLLM across FP8/BF16/NVFP4/Q8_0 q…

    Python 7 1

  5. rasputin-omnitool rasputin-omnitool Public

    OSS capability catalog + license review + library smoke harness for Manus-equivalent agent stacks. Kernel for the Rasputin Omnitool agent skill.

    Python

  6. closing-the-opus-gap closing-the-opus-gap Public

    Closing the Opus Gap: Systematic Optimization of Tool-Calling in Open-Weight LLMs on Wafer-Scale Hardware