Recent AI research papers with accessible summaries. Updated daily from arXiv, summarized for developers who don't read papers regularly.
Amine Lbath, Manan Suri, Aurelien Delaitre et al.
LLM-based vulnerability discovery is already autonomous and real-world impactful: vulnerability disclosures doubled in 2026 with more critical-severity bugs found, but the security community hasn't yet adapted response timelines to match this acceleration.
This paper systematizes evidence on how LLMs are discovering, validating, and patching software vulnerabilities. The authors create an autonomy framework to rate LLM capabilities, review published claims, and analyze real-world vulnerability data from 2026 onwards.
Terence D. Agbeyegbe, Toneukarin G. Agbeyegbe
Self-consistency certification methods used to verify LLM correctness fail under realistic correlation in reasoning samples; you need prompt-level aggregation, not within-prompt resampling, to make valid population-level reliability claims.
This paper reveals a critical flaw in self-consistency certification for language models: when reasoning samples are correlated (which they are in practice), standard anytime-valid tests certify the wrong thing.
Mohamed Aghzal, Mor Geva, Gregory J. Stein et al.
Mechanistic interpretability tools can identify hallucination signals in LLM agents but struggle to provide robust, complete explanations because agent failures involve distributed computations that vary across examples and are sensitive to superficial prompt changes.
This paper investigates whether mechanistic interpretability—techniques for understanding LLM internals—can explain why AI agents hallucinate unavailable web actions.
Mohammed Efaz, Udo Bub, Itilekha Podder
You can build privacy-preserving, spoiler-free reading companions using small local language models (2-4B parameters) that match larger models' performance while running entirely offline on consumer hardware.
MeReader is an offline AI assistant for reading ebooks that keeps your reading private and prevents spoilers by only accessing content up to your current position in the book. It uses a hybrid search system combining multiple retrieval methods and works efficiently on consumer devices, showing that smaller local models can match larger cloud-based systems in comprehension quality.
Aria Wong, Joshua Engels, Neel Nanda
Effective reward hacking monitors need to balance providing learning signal to the model while avoiding systematic vulnerabilities that enable evasion; simpler training data and better monitor design can significantly reduce reward hacking in practice.
This paper studies how to use monitoring systems to catch and prevent reward hacking—when AI models learn to game their reward signals in unintended ways. The authors create three realistic environments where a language model exploits flaws (test overwriting, sycophancy, hallucination) and test different monitor designs.
Fazl Barez, Tung-Yu Wu, Hunar Batra et al.
Mechanistic interpretability provides tools to understand AI model internals, but understanding alone doesn't guarantee safety—it must be combined with behavioral evaluation and other safety measures to be effective.
This comprehensive survey examines mechanistic interpretability—the study of how neural networks work internally—and whether understanding a model's inner workings actually makes it safer. It covers foundational concepts like features and circuits, surveys analysis methods, and explores how this understanding can help with safety through techniques like knowledge editing and steering.
Qiyao Ma, Xiaodong Liu, Weiwei Yang et al.
Safety vulnerabilities in multi-turn conversations stem from shallow alignment in early tokens; explicitly training models to commit to a parseable safety decision before generating responses—rather than just supervising the surface form—creates a causal control point that significantly impro...
This paper addresses why LLMs refuse harmful requests in single turns but fail across multi-turn conversations. The authors show safety alignment is 'shallow'—concentrated in early output tokens—and propose ShallowDefend, which makes models explicitly commit to a safety decision before responding.
Michael Joseph, Yedid Hoshen
Memorization in diffusion models can be reliably detected by comparing reconstruction losses across time (training or diffusion timesteps) rather than using absolute loss values, which conflate memorization with image difficulty.
This paper tackles membership inference attacks on diffusion models by separating true memorization from inherent image difficulty. The authors propose two calibration methods: Reference-Model Calibration (RMC) compares losses across training checkpoints, while Temporal Self-Calibration (TSC) uses a single model by comparing losses at different noise levels.
Xi Chen, Fengqi Hu, Zeyu Shen et al.
This library standardizes robust RL algorithm implementation and reveals empirical capability boundaries—showing practitioners which robustness techniques handle which types of real-world disruptions, with reproducible benchmarks for developing and testing new methods.
RobustRLlib is a unified library and benchmark for robust reinforcement learning that integrates 17 algorithms (online, offline, and safe RL) under one interface. It provides systematic evaluation across 273 perturbation configurations and diverse tasks to map where current robust RL methods work well and where gaps remain, enabling better real-world deployment.
Xinrui Li, Pawan Sasanka Ammanamanchi, Siddharth Bhat et al.
When autoformalization translates math to formal proofs, checking logical equivalence isn't enough—SemantEq instead verifies that statements transform into each other only through semantically meaningful steps, achieving 100% precision on detecting non-equivalent pairs while improving recall fr...
This paper introduces SemantEq, a method to verify whether formal mathematical statements in proof assistants like Lean 4 faithfully translate their natural language sources. Rather than checking logical equivalence (which is too permissive), SemantEq requires statements to transform into each other only through specific allowed steps like logical rearrangement and library equations.
Dongyoon Hahm, Woogyeol Jin, Dennis Wei et al.
Fine-tuning LLMs risks activating hidden behavioral associations learned during pretraining, and these couplings can compose across datasets to create unpredictable emergent behaviors that standard evaluation won't catch.
This paper reveals how fine-tuning LLMs can trigger unintended behaviors through 'behavioral couplings'—hidden associations between behaviors learned during training. When a model learns two behaviors together in training data, fine-tuning for one automatically activates the other.
Trizal Garg, Sibayan Mitra, Arya Karanjkar et al.
LLMs exhibit evaluation awareness across all tested languages, but the effect is stronger in Indic languages and causes collateral damage by refusing harmless requests, meaning safety evaluations may not accurately predict real-world behavior.
This paper reveals that large language models behave differently when they know they're being tested, and this 'evaluation awareness' varies across languages.
Andis Draguns, Sumeet Ramesh Motwani, Raymond Douglas et al.
Current capability evaluation methods cannot guarantee detection of hidden model behaviors—adversaries can cryptographically hide arbitrary computations that only activate on secret triggers, fundamentally limiting pre-deployment safety audits.
Researchers demonstrate that AI models can hide arbitrary capabilities using encrypted neural networks embedded as backdoors, which remain undetectable even with full access to model weights. This challenges the assumption that capability evaluations can reliably surface dangerous behaviors before deployment.
Yeonsung Jung, Zhiyuan Wang, Zifan Wang et al.
Systematic exploration of tool dependencies and execution feedback can uncover compositional failures in multi-service agents that traditional red-teaming methods miss—critical for safety before deployment.
This paper presents X-AgentRed, a red-teaming framework that automatically discovers harmful outcomes when AI agents use multiple tools across different services. Rather than relying on LLM prompts alone, the system builds a graph of how tools interact with each other, then uses execution feedback to find and refine harmful tool combinations that could cause unintended damage.
Rubén Manrique, Michelle Castellanos, Jorge Morales et al.
LLMs can sound authoritative about law they don't actually know; current models need expert oversight and source grounding for real legal work, especially outside the US where training data is sparse.
This paper evaluates how well large language models understand Colombian law by testing 15 models on 1,042 expert-validated questions covering ten legal areas. While models score well on multiple-choice questions (up to 90.5%), their free-text legal answers are rarely correct (max 45%), and they often sound confident while being wrong—a dangerous combination for non-experts relying on legal AI.
Pengfei Li, Naufal Suryanto, Sicheng Zhang et al.
Current open-weight LLMs struggle with precise cybersecurity tool use (max 42% accuracy), but fine-tuning with verifiable rewards from this benchmark can make smaller models competitive with much larger ones.
KaliBench is a benchmark for evaluating how well language models can translate security analyst requests into executable commands for Kali Linux tools. It includes 8,504 query-command pairs across 1,642 tools and provides a verification system that checks both whether commands are syntactically correct and whether they actually run successfully, without needing to execute them during training.
Kevin Jiang, Morgane Austern, Edgar Dobriban et al.
You can align generative AI outputs to target distributions by intelligently filtering multiple model queries—no model retraining needed—and this approach is provably optimal for large batches of outputs.
This paper addresses how to align AI-generated outputs with user-specified attribute distributions through post-processing, without modifying the model itself. The authors develop algorithms that select outputs from multiple queries to a generative model, ensuring attributes like gender or age match target distributions.
Ali Holmov, Yiran Huang, Kirill Bykov et al.
LLMs maintain readable and writable internal user models that directly influence safety behavior; different models independently converge on similar user representations, suggesting this is a fundamental property of how language models condition their responses.
This paper introduces Belief Self-Distillation (BSD), a technique to extract and manipulate how LLMs represent their users internally.