depthfirst (@depthfirstlabs) profile picture

Securing the world's software.

San Francisco
Joined April 2025
Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)Photo by depthfirst (@depthfirstlabs)
Our latest customer story: how Pax built continuous security into its engineering workflow depthfirst.com/customer-stor… Pax builds AI agents for public safety, providing critical infrastructure for nearly 200 Brazilian cities. Its engineers ship changes every day across backend services, web and mobile applications, machine-learning pipelines, and infrastructure, while protecting sensitive public-safety data. Pax uses depthfirst to review pull requests before merge, scan its repositories, and run agentic pentests in a staging environment that mirrors production. Threat models and infrastructure context help the team focus on credible risks, with evidence and remediation guidance for each finding. Through depthfirst’s MCP, Pax’s internal agents create Linear issues and route findings to the teams that own the affected code. This gives each actionable finding a clear owner and keeps remediation in the tools engineers already use.
1
23
850
Coding agents work best when they can run the full application and verify their own work. For complex applications, this means giving agents access to databases, background workflows, Kubernetes clusters, and everything else they need to test their changes. At depthfirst, we built our own secure cloud development environment in less than a week using AWS, Tailscale, Nix, and depthfirst. Each developer gets a persistent devbox, and each task runs in its own isolated environment, allowing agents to work in parallel. Everything stays within our private AWS network, with access controlled through Tailscale and package requests checked by depthfirst's Dependency Firewall in configured build and registry paths. Engineers can switch between Codex, Claude Code, and other agents without losing context. @andreamichi and @seshank_k share how we built it and how other engineering teams can do the same. depthfirst.com/post/secure-a…
10
4
1
40
1,128
Running a lower-cost model multiple times can match the vulnerability detection rate of frontier models at a small fraction of the cost. On a 30-task subset of dfbench, five runs of DeepSeek v4.1 Flash found about 71% of known vulnerabilities, up from about 52% with a single run, at $4.24 per task. Running it 15 times increased recall further to 80%, roughly 13% of Mythos 5’s cost, which found approximately 69% of the vulnerabilities. Because LLMs are stochastic, they can find different vulnerabilities each time they analyze the same codebase. Combining findings across runs increases coverage, but can also introduce more false positives. To control that noise, we used our harness to review and deduplicate findings across runs, then filter them by confidence. In separate validation experiments, this approach generally improves both recall and precision. These results suggest that repeated sampling can improve the tradeoff between coverage, precision, and cost. The gains depend on the model, the number of runs, and how findings are filtered. Read the research: depthfirst.com/research/bon-…
5
5
4
51
6,302
We are showcasing our work with @nvidia to post-train Nemotron 3.5 Lightning for defensive cybersecurity at GTC. As AI makes cyberattacks faster, cheaper, and more common, we need to equip defenders with advanced cyber intelligence that is affordable enough to be always on. That's what we're building at depthfirst: powerful, specialized security models that defenders can run on their own infrastructure, with full control over their models and data, at a fraction of today's cost. We're proud to work with NVIDIA to strengthen the U.S. AI cybersecurity ecosystem and help put sovereign security intelligence in the hands of defenders.
5
1
29
16,115
Today, we’re excited to introduce Agentic Pentesting on the depthfirst platform. Agentic Pentesting involves autonomous agents that attack your running application like a team of elite security researchers. Security teams can: - Find complex vulnerabilities in systems and running applications, with or without source code access - Confirm whether findings from code scans and other sources can be exploited at runtime - Run ad hoc agentic pentests or integrate them into CI/CD for new feature releases - Create tickets in Jira or Linear, or use depthfirst to autonomously remediate vulnerabilities - Replay an attack after remediation to verify that the vulnerability has been fixed We built Agentic Pentesting in close collaboration with our customers. We’re grateful to every security and engineering team that helped shape the product and to the depthfirst team that brought it to life. Learn more from the links in the comments.
4
3
7
54
341,673
We use Codex and other AI models at depthfirst. They’re useful for code review, and we run our Security Reviewer alongside them to see how each model performs when reviewing the same code. In one internal test repo, Codex raised 3,519 issues (123 security-related). depthfirst found 869 security issues at a >70% true-positive rate. We wrote about why security review needs deeper application context, how this context informs every pull request review on the depthfirst platform. Read more in the link in comments.
7
2
34
2,825
Our researchers built a vulnerability scanner that costs two cents per scan and completes a scan in around two seconds. The scanner is built with Jev, a classifier that outputs probabilities rather than generating tokens. On dfbench v1, our flagship model, it finds nearly as many real vulnerabilities as GPT-5.6 Luna, one of the most efficient models by cost per vulnerability. This new harness breaks vulnerability discovery into parallel tasks, making it possible to scan every package, repository, or commit quickly and at low cost before escalating the hardest cases to other frontier models on the depthfirst platform. Read more about how we built this in comments 👇
8
6
2
77
6,605
We're excited to share our new customer story with @ListenLabs! Listen Labs’ agentic SDLC enables developers to manage swarms of agents, so security reviews must deliver precise findings scale. When depthfirst flags a PR issue, it provides context, evidence, and recommended fixes, so agents can act on the finding before any human decides to merge, keeping security review in lockstep with development. Thank you Tobias Schindler and the Listen Labs team. Read the full customer story in the link in comments 👇
1
2
18
645
Applications today can pull thousands of third-party packages, and AI agents are accelerating how quickly those dependencies are introduced and changed. Scanners flag known vulnerabilities across that dependency tree, but security teams still need to know which vulnerable functions their application can reach. At depthfirst, we use agents to trace paths through startup commands, frameworks, and transitive dependencies, just like a team of security researchers. We explore where static analysis misses real execution paths and how we make agentic reachability practical at scale: depthfirst.com/post/reachabi…
5
3
22
1,728
If you’re tired of hearing about agents escaping the sandbox, our security researcher Leo dives into container security and better alternatives available today
Containers are no longer a security boundary. Over the past few months, we’ve seen a crazy amount of Linux kernel vulnerabilities and exploits. This has forced us to rethink the security of infrastructure that relies heavily on the underlying kernel, especially containers. As models become more capable, the barrier to escaping a container has fallen so much that adversaries can now generate working kernel exploits in a single shot. CVE-2026-80521 is one such example. We discovered it using dfs-large1 from @depthfirstlabs and generated the exploit in one shot with GPT-5.6 Sol. The exploit still works on the latest Ubuntu 26.04 release because the fix has not yet been backported. Read our full writeup: depthfirst.com/research/cont…
1
18
1,087
dfbench v1 is featured on @FireworksAI_HQ's Specialized Intelligence Index. Our flagship model, dfs-large1, is built on GLM 5.2 and post-trained with reinforcement learning in partnership with Fireworks AI. On dfbench, it achieves 62.2% vulnerability detection recall at $6.77 per task and 75.6% differential analysis macro recall at $1.34 per task, pushing the performance-cost frontier for both tasks. fireworks.ai/specialized-int…
Today we're launching the Specialized Intelligence Index (SII): one destination for real-work benchmarks across industries, built by the teams that use them every day. Hear from Fireworks co-founder @the_bunny_chen on the importance of specialized benchmarks:
2
5
1
37
3,707
Our co-founder and CEO @qasimmith sat down with @SaraIttelson at Accel, one of our earliest investors, to discuss the forces reshaping security: Starting depthfirst. Building secure software at speed. Finding the TikTok vulnerability with our flagship model dfs-large1, a flaw that could have exposed millions of users’ private photos and allowed hackers to access their camera feeds and microphones without their knowledge, and recently covered by @washingtonpost. Full interview in the link in comments.
1
10
4
32
15,717
We got early access to @spacexai's Grok 4.7’s red-team capabilities for defensive security research and evaluated it on dfbench. The model shows a solid combination of recall and precision on defensive cyber tasks, achieving 59% recall and 23.9% precision at roughly half the cost of GPT 5.6 Sol and one-fifth the cost of Mythos 5.
5
1
6
50
8,486
We are excited to introduce Dependency Firewall with On-Device Protection. It enforces security policies on devices and blocks malicious or untrusted packages across AI agents, applications, package managers, and registries. Centrally managed without changing how employees use their tools. Thread on supply chain attacks, how agents make this harder, and what device mode enables:
12
11
8
59
13,806
Recent supply chain attacks have shown how quickly compromised packages can steal credentials, execute malware, and spread across company environments.
1
5
594
AI agents are increasingly completing tasks even when that means bypassing guardrails set by security teams. We explore how malware moved into trusted dependencies, who sits behind the package ecosystem, and what enterprises need to do next. Read more: depthfirst.com/post/preventi…
1
10
2
26
2,723
Thank you for leading this initiative @OpenAI @gdb, we're proud to support
An open letter for a global surge in cyber defense, signed by over 100 organizations including Anthropic, AWS, Google, Microsoft, OpenAI, and Oracle.
1
2
1
16
2,413
Introducing Bug Bounty Verification: forward any vulnerability report to depthfirst to validate them against the running application and check if they’re already in your queue. AI can produce a convincing vulnerability report with a single prompt. Validating whether the finding is real can still take security engineers 30 minutes to three hours. Reports that are wrong but plausible enough to investigate are where the triage cost compounds. depthfirst turns each report into the hypothesis for a targeted Agentic Pentesting run. It tests the claim against the application’s threat model, codebase, and running environment, then returns one of three verdicts: exploitable vulnerability, false positive, or needs deeper validation. Each verdict includes the requests, responses, and full run log, so security teams can inspect what the agent tried before accepting, rejecting, or escalating the report. Bug Bounty Verification is available now in Private Preview for depthfirst customers. Read more in the blog in the comments 👇
8
4
3
47
9,846
Reachability made software composition analysis more useful. Instead of stopping at “you have this CVE,” it asks whether the application can invoke the vulnerable behavior. But knowing the vulnerable behavior can execute does not tell you whether an attacker can exploit it. depthfirst translates each exploit into a set of atomic conditions: an exploit recipe. The agent evaluates that recipe against the repository at the current commit, considering application code, configuration, threat model, middleware, Dockerfiles, CI, CLI and build usage, and deployment artifacts. Each condition is marked as met, not met, or uncertain, with direct repository evidence behind the assessment. This lets teams prioritize confirmed attack paths, followed by findings requiring further investigation. Read more in the blog in the comments 👇
2
7
3
35
3,327
Today we are announcing dfbench, a cybersecurity benchmark we developed to evaluate frontier models and agentic systems. A few weeks ago we posted about how it is time to graduate from CyberGym Level 1 as the primary measure of cyber capability, in favor of newer benchmarks. Eventually every public benchmark saturates: Level 1 is now there, and it’s also not a great representation of what AppSec teams care about. dfbench is a held-out evaluation for frontier models doing open-ended defensive security work. It measures whether an agent can provide broad, actionable security coverage at sustainable cost. That requires enough coverage to get ahead of exploitation, enough precision that security teams can act on what the agent finds, and enough efficiency to keep that coverage current. We received access to all providers’ relevant trusted access programs so we could run these evals without model refusals. Both GPT 5.6 Sol and Luna are strong at detection, and Luna is incredibly cheap for its quality. Grok 4.5 provides a nice middle ground between performance and cost. Validation and differential analysis results suggest plenty of room for improvement among frontier models. Moving forward, we plan on working closely with the security community to safely evaluate the cyber capabilities of frontier models ahead of their release to the general public.
9
17
8
96
13,641
Introducing Threat Model: living security artifacts that capture each repository’s architecture, trust boundaries, attacker-controlled inputs, and assumptions so vulnerability discovery reflects how your application actually works. Most security tools start every finding from scratch. They identify suspicious code, assign a severity, and leave teams to reconstruct whether the path is reachable, what an attacker controls, which trust boundary is crossed, and what impact the issue has in that application. Threat Model gives depthfirst durable security context for each repository. Teams can review and edit assumptions, accept suggested updates as the codebase changes, and carry that context into future scans. Findings can then be evaluated against the application’s real architecture and security model instead of relearning the same context every time. Threat Model is available now in Private Preview for depthfirst customers. Read more about Threat Model in the blog in the comments 👇
2
2
3
22
2,854