Pinned Tweet
Some patterns we're seeing across our engineering clients that tell you where AI adoption is actually heading:
1. Companies are done spending blind on AI. A few months ago, most were approving unlimited API budgets for OpenAI and Anthropic with no tracking on where the tokens went. Today they're asking us to build governance layers and monitor every dollar. One client had three teams running up five-figure token bills before a single production agent shipped. Now they want dashboards that show exactly what's AI-generated, what it costs, and whether it's actually faster than adding headcount. That means more diagnostic work for us and meaningful savings for them.
2. Companies are accepting the real timeline. A few months ago, leadership expected to go AI-native over a few workshops and a handful of tool subscriptions. Now they're calling us because the codebase is seven years old and can't absorb automation without a full foundation phase first. Their developers are using AI at 60-70% adoption, but nobody's tracking what's generated vs. human-written. QA hasn't been touched. There's no governance. Going AI-native means rethinking org charts, handoffs, and process ownership across every department. Not a software purchase.
3. Companies are walking away from the big firms. The Accentures and McKinseys are all pitching AI transformations. Our clients keep showing up saying the same thing: "We paid seven figures for a strategy deck and nothing shipped." This is why firms like ours have a market. We operate at the engineering layer while having the business sense to map a process end to end, then build the agents to automate it. A year ago we had to explain this on every first call. Now prospects open the conversation with it.
In the last 90 days we've taken calls with PE firms, law firms, healthcare companies, VPN providers, construction platforms, and retail tech businesses. Some are direct competitors with each other. Nearly all came through referral.
AI SaaS won't transform your company. Giving every developer a Copilot subscription and calling it a strategy won't either. The only path to real operational ROI is combining a team that learns your business processes on the ground with engineering capacity to automate every manual workflow worth automating.
We built Limestone Digital around this thesis ten years ago. AI made it urgent. If you're looking to transform engineering delivery or automate business processes with production-grade agents, visit limestonedigital.com.
An eval set made only of right answers will keep passing until a customer finds what it missed.
We build ours from real cases with agreed outcomes, and we compute the expected answer live from the database, with a query written separately from the agent, because an answer pasted into a fixture goes stale the first time the data moves.
Then we add the classes that match how operations fail in practice:
→ KPI correctness: does the number match the definition finance uses?
→ Refusal: does it decline to expose protected data, even when the question is clever?
→ Honesty about gaps: when the data isn't there, does it say so?
→ The query guard under pressure: does read-only stay read-only when a question pushes against it?
→ Domain logic: rules run as pure unit tests, with no model involved.
A fast subset runs on every change and the full set runs nightly. You promote real user questions into the library once you've removed patient and customer data, and when a person amends or rejects an answer, that correction becomes a test.
The people who own the numbers sign off what correct means before you trust a score.
3
311
Want to put AI to work in your operations next?
Get our free guide: how to pick your first workflow, measure the results and scale what works, with 3 case studies from healthcare, insurance and commercial lending.
thefoundation.limestonedigit…
1
102
12 ways AI agents fail in production, and the control that stops each one:
1. It runs forever.
→ Turn limits, timeouts and a spend cap per run, enforced in code.
2. It says it's done when it isn't.
→ Code or a person checks the result, and its own report counts for nothing.
3. It retries a write and charges someone twice.
→ An idempotency key on every tool that changes a record.
4. It reads a table that looks right and was retired last year.
→ An allowlist of authoritative sources and a freshness check on each one.
5. It gives a different number each time you ask.
→ Numbers that must never vary come from deterministic code.
6. It follows instructions hidden in a document.
→ Treat everything it reads as data, and keep privileged tools away from runs that read untrusted text.
7. It drowns in its own context.
→ Tools that filter and return only what the step needs.
8. It forgets what it was doing halfway through a long run.
→ Keep state in a file or database, and checkpoint so it can resume.
9. It picks the wrong tool.
→ Fewer tools, one job each, clear descriptions and evals on tool choice.
10. It gets worse after a model or data change and nobody notices.
→ Pin the model version, run regression evals on a schedule, and alert on override rate and on changes in the shape of the data it reads.
11. Its approvals turn into rubber stamps.
→ Ask a person only for high-impact actions, show the evidence with the request and sample the ones that got approved.
12. It does something you can't undo.
→ A named approver before any irreversible action, and a compensation path for everything else it can write.
Bookmark this and mark which ones your agent has no control for. Fix those before you add another feature.
Want to put AI to work in your operations next?
Get our free guide: how to pick your first workflow, measure the results and scale what works, with 3 case studies from healthcare, insurance and commercial lending.
thefoundation.limestonedigit…
1
2
143
đź‘€
The difference between an AI consultancy and a hands-on implementation firm is simple.
One sells a long transformation. The other ships work, gets first numbers on the board, and iterates from real metrics. That is the better path: implement, measure, adjust, move.
Not a year-long generic AI program with workshops, frameworks, and no operating data.
Every engagement we run at @LimestoneHQ has fewer people on it now than when it started. The firm is growing faster than it ever has.
A consultancy has to keep an expensive person busy.
$350 an hour, billed by the day. The work is built to last. Scope expands. The team expands. Phase two gets sold in month three. You end up with a $500K deck about “unlocking potential.”
Ask people two or three levels below the executive who signed. They can’t stand consultants. They watched the circus.
What the firm is really selling is cover: I hired a top firm, so I made the responsible choice. If it fails, I still hired a top firm and there's nothing else we can do.
For a mid-market company, that’s an expensive way to avoid deciding.
Consultants do earn it sometimes. A dynamic consultant at $5K an hour who unblocks the thing that’s been strangling operations for two years is worth every dollar. A specific, painful problem for the business solved. That’s a fair trade.
Generic advice is the trap. In 2026, if the advice isn’t tied to a real problem, you can open a model, ask for the top five strategy frameworks, give the output to your HR lead with deliverables attached, and start Monday.
You’ll learn more from the first failed iteration than from three months of workshops. If you need a $350-an-hour outsider to tell you what your strategy is, the honest move is to change your job.
Vendors are selling the same billable-day model with an AI sticker on it. When a mid-sized or large engineering shop says they’ve gone AI-native, I ask one question: how many people have you let go, and why are you still hiring more? If the answer is none and lots, they aren’t passing any efficiency to you.
They added “AI” to the rate card and kept the man-day model underneath.
The small firms are the newest version. A group assembles a team to ride the AI demand wave, hires people with case studies, and suddenly the firm has case studies. But there’s no history behind the logos.
Our @LimestoneHQ AI velocity pod is one senior engineer, agents across the whole SDLC, and a fractional architect. Roughly 1.5 FTE where a five-person team used to sit. 98% of the code we ship isn’t handwritten.
That’s why engagements shrink: the work gets done, the harness takes more of the load, and we pull people off.
We don’t know how to sell you more headcount.
We grow on demand and on the efficiency we hand each client. That’s the only thing that carries to the next one.
If your vendor’s team on your account has grown since AI arrived, you’re paying for their business model, not yours.
1
341
An AI pilot report that says "hours saved" hasn't measured anything a CFO can bank yet.
We measure pilots in 6 steps, agreed before the build starts:
2
6
1,688
1. Baseline together. Unit of work, volume, cycle time, touch time, rework, exception rate and cost. Signed, with sources and a measurement window.
2. Ship a narrow slice on real cases, with a person in control and parallel running where the risk needs it.
3. Compare throughput with the baseline: units per period, time per unit, queue age.
4. Compare quality with the baseline: accuracy, first-pass acceptance, rework, overrides by users.
5. Measure economics: capacity freed, rework avoided, extra output, adoption and run cost.
6. Decide together: continue, adjust, stop or expand.
1
1
109
The migration that takes production down is the one somebody tried to ship in a single PR.
The safe way has always been seven small PRs, and teams skipped it because it was tedious. Agents write tedious code all day, so that excuse is gone:
1. Expand. Add the new column or table, nullable, with nothing reading it, and deploy that alone.
2. Dual write. The app writes to old and new behind a flag, and reads stay on old.
3. Backfill. A throttled job copies old rows in small batches, can stop and restart at any row, and only writes rows the new column hasn't already got.
4. Verify. A script compares old and new row by row and lists every mismatch. The count has to reach zero.
5. Switch reads. Move reads behind the flag by percentage, watch errors and latency, and keep dual writes on through a full business cycle, including your month-end close or billing run, so you can flip back.
6. Stop old writes. Delete the old-column code and the flag, and deploy.
7. Contract. Drop the old column in its own PR, once query logs show nothing still reads it.
An agent can write all seven PRs, the backfill job and the comparison script. A person approves steps 5 and 7, and step 7 waits for a backup you've restored from at least once.
Tell the agent two things it can't work out from the repo: which tables lock on ALTER at your row counts, and which reports or nightly jobs outside the codebase read that column.
Want to put AI to work in your operations next?
Get our free guide: how to pick your first workflow, measure the results and scale what works, with 3 case studies from healthcare, insurance and commercial lending.
thefoundation.limestonedigit…
1
1
144
Agentic AI in Private Equity: From Deal Flow to Portfolio Ops
Read here:
limestonedigital.com/blog/ag…
deterministic code is underrated:
If you can write the rule down, it should be deterministic code, not an LLM call.
An LLM is probabilistic. Ask it the same question twice and you can get two different answers. That's what you want when the input is messy and somebody has to read context. It's exactly what you don't want for a rule you already know.
Yet a lot of agents in production pay a model, on every single run, to re-solve something the team solved months ago. That's a recurring cost on a one-time problem, and it's slower and less reliable than a few lines of code.
The rule we build on: if code can check it, code does it. In the agent orchestrator we're building, 14 of its 22 steps are deterministic code and only 3 belong to the model.
Same in the healthcare billing agent we built for a PE-backed company. The LLM reads the question and writes the query, and the database does the math. That's why the flagship denials answer reconciles to the penny, on $250 a month of infrastructure, all-in.
How I'd split it:
1. If you can express the decision as rules, it's deterministic code. If the rules have to be inferred from context, that's the LLM's job.
2. Anything that must give the same number every time comes from code: money, dates, eligibility, limits.
3. Retries and budgets are code. The model never decides how many times it tries again. Ours gets two CI runs, and then a person gets a failure report.
4. When the LLM keeps solving the same problem, turn its answer into a function. Have a coding agent write it and the tests. 98% of our code isn't handwritten, so that's a small job, and after that you never pay for inference on that step again.
The best agents get less dependent on the LLM over time, because more of what they do turns into reliable code. If your agent's bill keeps growing while the job stays the same, it's paying a model to re-solve what it already knows.
BREAKING: Claude Code can now check every privileged action your AI agent can take against the security lessons Uber published on 6 Nov.
Read-only, every finding cites a file and line, and a separate judge checks each one. The prompt is below:
Uber's engineers on running AI agents in production:
→ Authorization tells you who may act. It doesn't tell you whether this action fits this request.
→ Limiting each agent to explicit intents and constraints cut the most risk, at some cost to flexibility.
→ Every privileged action should trace back to what the user asked. Uber calls that an added defense against injected instructions.
→ Human oversight can't carry it alone. Automated controls have to back it up.
A May 2026 paper on ADR, the detection system deployed at Uber, reports hundreds of credential exposures across 26 categories.
2
3
181
Everyone's an AI engineer on their CV now. These 12 interview questions show you who's run agents in production, and each one comes with what a good answer sounds like:
1. "Tell me about an agent you built that failed in production."
→ They name the failure, how they found out and what they changed.
2. "How do you know a prompt change made things better?"
→ A fixed eval set, run before and after, with the pass rates. "I tried a few examples" is a no.
3. "What's in your eval set besides the easy cases?"
→ Exceptions, refusals, missing data and real past failures.
4. "Which steps in your last agent were plain code, and why?"
→ Anything with one right answer: calculations, validation, routing, permissions.
5. "A tool call times out halfway through a write. What happens?"
→ Idempotency keys and safe retries, so nobody gets charged twice.
6. "How does your agent stop?"
→ A turn limit, a budget, a timeout and code that checks the result. The model saying it's done doesn't count.
7. "What did one run cost, and what did you do about it?"
→ A real number per completed task, then caching or a smaller model for the easy steps.
8. "A web page the agent reads tells it to email your customer list. Now what?"
→ Retrieved text is data, and tool permissions stop the email. A line in the system prompt won't.
9. "Whose credentials does your agent run under?"
→ The user's own permissions or a scoped service account. A shared admin key ends the interview.
10. "You get paged because an agent gave a wrong answer. What do you open first?"
→ The trace for that run: input, retrieved context, tool calls and model version.
11. "An agent just opened an 800-line PR. How do you review it?"
→ Tests first, then run it, then ask for it to be split. Reading all 800 lines before doing any of that is the wrong answer.
12. "When wouldn't you use an agent?"
→ When a script does the job, nobody can check the output or a wrong answer costs too much. If they can't name a case, keep looking.
Bookmark this for your next AI hire, and answer all 12 yourself first.
Want to put AI to work in your operations next?
Get our free guide: how to pick your first workflow, measure the results and scale what works, with 3 case studies from healthcare, insurance and commercial lending.
thefoundation.limestonedigit…
3
263
Most agent demos have never had their worker killed halfway through a run.
A harness is the code around the model, and you find out if it's any good by breaking it on purpose. We designed our own agent orchestrator around checks like these, and it has to pass them before it touches a live ticket:
1. Kill the worker while it waits on CI. It has to resume the wait and never push twice.
2. Turn off the CI webhook. Polling still has to finish the run, and two nudges for one event count once.
3. Cancel during implementation. The agent stops and the harness destroys the sandbox.
4. Send the same ticket twice. An open PR gets continued, and you don't get a second one.
5. Deploy a new worker while runs are parked. It has to pick up runs from the two previous versions.
6. Replay a run a week later. The working copy lives as a git patch against the start commit, so any sandbox can rebuild it.
7. Go over budget. One budget per run counts CI runs, fix attempts, time and cost, and the gateway refuses the model call over the limit.
8. Hide an instruction in a ticket. Ticket text is data and side effects only happen in code steps, so the agent can't push, comment or call out, and a person reviews whatever reaches the diff.
Try number 1 on your own harness this week. If a killed worker pushes twice or loses the run, that's your next ticket.
Want to put AI to work in your operations next?
Get our free guide: how to pick your first workflow, measure the results and scale what works, with 3 case studies from healthcare, insurance and commercial lending.
thefoundation.limestonedigit…
1
6
667
BREAKING: Coding agents followed an outdated CLAUDE.md or AGENTS.md over the actual code in 90% of choices, in an October study of Claude Code and Codex.
One sentence fixed most of it. The sentence and a prompt that finds the stale lines in your files are below:
The researchers built 40 Python projects where the instruction file asked for one convention and the code used another, then ran Claude Code and Codex 320 times, half of them without a fix.
→ Without a fix, 90.1% of choices followed the stale file
→ Claude Code spotted the conflict in 79 of 80 runs and still followed the file in 86% of its choices
→ Codex rewrote working code to match the file in 20 of 80 runs, and the tests then failed in 17
One sentence in the user-level instruction file, giving the existing code precedence, moved code-following from 4.2% to 91.4%. Codex stopped rewriting code, and the test pass rate went from 89.4% to 100%.
(Xu and Wu, arXiv 2610.30571, 22 Oct 2026)
Your team uses AI every day. That's step 1 of 6. An AI agent running a workflow on its own is step 4.
Skip a step and the next one breaks:
1
5
1,039
1. Local assistance. People use copilots, scripts and tools to finish tasks faster.
2. Hosted automation. The useful tools leave personal laptops and get managed identity, scheduling and a lifecycle.
3. Observable workflow. Inputs, decisions, outputs, cost, quality, failures and human interventions all get measured.
4. Headless execution. One bounded workflow runs end to end and hands exceptions and approvals to people.
5. Agent-to-agent orchestration. Proven components pass results to each other, with lineage and evaluation between steps.
6. Operating-model redesign. Roles, team boundaries and capacity planning change, because the new way of running the work is proven.
1
4
336
Top Toptal Alternatives for Hiring Senior Engineers in 2026
Read here:
limestonedigital.com/blog/to…
BREAKING: Claude Code can now write the data dictionary your first AI agent needs, straight from your warehouse, and flag the columns that look alike but mean different things.
Read-only, and a separate judge re-runs every check:
Before an agent touches your data, someone writes down what the data means. For one workflow, that's two small documents:
→ A data dictionary slice: purpose, grain, keys, joins, coded values, and where two similar columns differ
→ A business glossary, signed off by the people who own the numbers today
Then a read-only probe confirms each table exists and holds data, so the dictionary never promises what the warehouse can't supply. Curated views drop sensitive columns before the agent sees them.
1
3
413
1. A long discovery phase that ends without a build decision.
2. A prototype called production-ready without evals, controls, monitoring and a named owner.
3. A platform purchase before your workflows show they need the same parts.
4. Model performance claims that never show you a failure.
5. A system only their team can run: no docs, no handover, no keys in your name.
1
2
211
BREAKING: Claude Code can now patch your vulnerable dependencies one at a time, show each upgrade passes your build and tests, and leave it as a draft PR for a person to merge.
Attackers now move before the fix ships, so every day after it ships counts. The prompt is below:
Mandiant's M-Trends 2026 puts the mean time to exploit at an estimated minus 7 days: on average, the flaws attackers used were exploited a week before a patch came out.
Verizon's 2026 DBIR puts the median time to fully patch a known-exploited flaw at 43 days, up from 32.
You can't close that gap by merging upgrades blind. The prompt below makes every upgrade pass your build and tests before a person reviews it. Changes to auth, payments and key management code stay with people.
1
1
649
BREAKING: Claude Code can now tell you whether a job needs parallel agents at all, with a 2-unit pilot and a budget, before it launches the parallel run.
The 3-condition test and the prompt are below:
Parallel agents pay when 3 things are true:
→ The work splits into independent units: files, repos, documents, accounts
→ Code or a person can check every result
→ The budget is set before the run
Stripe merges over 1,000 agent-written pull requests a week, and a person reviews every one. The work splits and every result gets checked.
One AI coding tool maker's first try had 20 agents claim tasks from a shared file with locks. They spent most of their time waiting and got the throughput of 2 or 3. It worked once planners split the job into separate tasks for workers.
Anthropic's 16 agents built a C compiler in two weeks for just under $20,000. That's a research budget. Count your units and your checks before you set yours.
2
1
262
10 mistakes CTOs make when implementing AI.
A working demo tells you very little about what happens when AI meets your production systems, sensitive data and everyday workflows.
Before you expand the rollout, check these ten things:
1. Buying tools before choosing the work.
→ Pick one workflow and name its owner. Measure the time, cost and error rate today so you can tell whether AI improves it.
2. Expecting AI to fix broken context.
→ Stale documents and missing business rules give the model little to work with. Assign owners to critical information and test retrieval against real questions.
3. Assuming a paid plan makes data safe.
→ Check retention, training policies and access permissions before sharing code or customer records. Approve tools for specific data types.
4. Using a prompt as the whole specification.
→ Write acceptance criteria, edge cases and allowed actions. Turn those requirements into repeatable evaluations.
5. Buying seats and calling it enablement.
→ Train people on work they actually do. Give them time to practise, share useful workflows and make review expectations clear.
6. Letting AI mark its own homework.
→ An agent saying “done” is no reason to merge. Run tests, security checks and independent evaluations, with accountable human review.
7. Giving agents access before setting limits.
→ Grant minimum permissions, require approval for high-impact actions and define when the agent must stop. Someone needs to own the outcome.
8. Building a demo that avoids the hard parts.
→ Test a complete workflow with the people who own the systems. Include permissions, integration failures and recovery from the start.
9. Leaving compliance until launch.
→ Identify the obligations that apply to your use case, data and users early. Build the required oversight and evidence into the workflow.
10. Treating go-live as the finish line.
→ Track quality, latency and cost per outcome. Re-test changes, keep rollback ready and retire workflows that aren’t delivering value.
At Limestone Digital, we start with one workflow, define what improvement means and build toward production with the people who will own it.
Planning an AI rollout? Book a discovery call with us.
Book a call with Limestone Digital here:
limestonedigital.com/book-a-…
2
300
Velocity Core by Limestone Digital turns engineering tickets into reviewed pull requests, on your own infrastructure.
We built it to move work through your existing software delivery process, with clear rules for what the agent can do and when a person needs to step in.
Add a label to a ticket, and the workflow starts:
→ Check the task before writing code. Admission checks catch missing requirements. If the ticket is unclear, the run stops and asks for an answer.
→ Build with the right context. The agent uses your repository, engineering rules and task context to write a specification and produce a patch inside an isolated sandbox.
→ Validate the change. Lint, type checks and fast tests run before delivery. Failed checks enter a repair loop with limits on steps and spending.
→ Inspect the diff before pushing. The diff guard checks for deleted tests, protected-file changes and secrets. Critical changes wait for human approval, then go through validation again.
→ Work through CI and review. Velocity Core opens the pull request, handles failed builds within configured limits and responds to review comments. A person always makes the merge decision.
→ Keep costs visible and capped. Every run has a hard spending limit. Retries stay inside that budget, and costs appear in the ticket, pull request and dashboard.
The agent holds no credentials. A separate worker handles pushes, and model calls go through your gateway to the provider you choose. There is no Limestone control plane or standing Limestone access.
Autonomy is earned per repository. A repo can start with plans or draft PRs and progress as its results justify it. Your team approves every promotion.
We start with a pilot on live tickets you choose. A Limestone engineer helps install the system, reviews the work and trains your team.
Then we measure what matters: first-pass CI rate, cost per merged PR and reviewer time.
Want to see how Velocity Core would work with your backlog?
Book a discovery call below.
Book a discovery call with us: limestonedigital.com/book-a-…
2
239

