HN The security paradox of local LLMs
Local LLMs prioritize privacy over security. Our research reveals a 95% backdoor injection success rate.
Quesma Blog
Insights on agentic coding tools, LLM evaluation, benchmarking, and simulation environments.
Get new posts by email
Subscribe via RSSHN 
AI for coding is still playing Go, not StarCraft
AI excels at clean algorithms but fails at messy, real-world codebases. The solution lies not in Go-like intelligence, but StarCraft-like complexity.
HN CompileBench: can AI compile 22-year-old code?
We tested 19 LLMs on their ability to handle real-world software engineering tasks like compiling old code and cross-compiling. See how Anthropic, OpenAI, and Google models stack up in our new benchmark – CompileBench.
HN Tau² benchmark: how a prompt rewrite boosted GPT-5-mini by 22%
We expected small models to be fast, but our benchmarks revealed a common reliability trap. Here’s our deep dive on finding and fixing it.
Featured 60-second Linux analysis - with Nix and LLMs
A one-line command to diagnose server health. Uses Nix to fetch tools without sudo and an LLM to summarize the output. No installation required.
Tau²: from LLM benchmark to blueprint for testing AI agents
Deep dive into the Tau² benchmark that goes beyond LLM evaluation to reveal innovative methodologies for testing AI agentic systems in realistic scenarios. Learn how this framework can transform how we test AI-powered software.
Observability in Go: what real engineers are saying in 2025
Learn how Go practitioners ship telemetry in 2025 – what works, what hurts, and the tools, workflows, and guardrails they rely on for metrics, traces, and logs.
Sandboxing AI-generated code: why we moved from WebR to AWS Lambda
Why we moved our AI chart generator from in-browser WebR (WASM) to AWS Lambda. A case study on the real-world trade-offs of running AI-generated R and ggplot2 code.
Claude Code + OpenTelemetry + Grafana: a guide to tracking usage and limits
Learn to monitor Claude Code costs, tokens, and latency in 5 minutes using its native OpenTelemetry support with Grafana Cloud.
Which chart would you swipe right?
Same dating data, 5 different charts: do you prefer the academic journal, The Economist, a Redditor’s take, or creating your own with AI?
Featured 5 Grafana in Docker examples to get started with metrics, logs, and traces
Learn how to spin up Grafana in Docker in 5 real-world examples - Prometheus metrics, Loki logs, Tempo traces, and Pyroscope profiling.
Featured Building Grafana dashboards with AI, CLI, and a bit of pragmatism
Discover a pragmatic approach to building Grafana dashboards more efficiently by combining the power of AI with the automation of a CLI workflow.
How does the Data Council conference keep finding future billion-dollar companies?
Data Council 2025 blended a unique Masonic temple venue with deep-tech talks. Discover insights from future billion-dollar companies before they make headlines.
Featured Don’t let Apache Iceberg sink your analytics: practical limitations in 2025
Apache Iceberg is a powerful open table format, but has practical limitations. Learn about its challenges with small data, metadata overhead, and real-time use cases.
Highlights from the Iceberg Summit 2025
Key insights from Iceberg Summit 2025 on Apache Iceberg’s evolution, including Table Spec V3, PyIceberg, Go, and its central role in modern data lakehouses.