
Founder & CEO @Architect_Fi, ex-Citadel Securities/Jane Street, dev, dad
Joined May 2021
- Tweets5.4K
- Following3.5K
- Followers71K
- Likes31.1K
Pinned Tweet
Introducing the American Innovation Exchange, the first U.S. derivatives exchange designed for trading the AI economy. Trade futures and options on compute, metals, energy, and other critical instruments in the AI supply chain. Coming soon from Architect.
Mean reversion in the GPU rental market. Over the past month, 1-year US GPU rental rates for A100, H100, and H200 have reverted back to mid-October levels, while B300 has given back most of its late-October gains. What we think is driving the divergence:
- Neocloud credit pressure. With neocloud equities down sharply and borrowing costs rising, some operators are moving B300 capacity at a discount to raise cash.
- Inference is driving demand. Neocloud demand continues to shift from training to inference (Bloomberg, below). Better small-to-mid-size open-weight models make older Nvidia accelerators more economical for many common inference workloads.
- B300 supply is catching up. B300s are the most commonly requested chip in the OTC market, and availability has historically been scarce. But we now see a number of B300/GB300 clusters coming online between end of Q4 2026 and mid Q1 2027.
We're brokering spot and options trades across the accelerator spectrum — reach out if interested.
Drinks on Architect, Luxor, and CMT for @Supercomputing SC26 on 11/17! Come hang out and share ideas on inference and compute trading. luma.com/ComputeCocktailsChi…
It’s compute day at FIA Chicago. Index providers are up first at 1:30pm, exchanges offering compute futures to follow at 2:20pm. Compute Desk, Silicon Data, NativX, Ornn, Architect, CME, ICE, and Nodal all in one place. Expect new alpha to be dropped.
A story about how Jane Street unwittingly reinvented datacenters in 2012, involving office server rooms, natural disasters, market maker obligations, recovery sites, colocation facilities, and old limestone telco buildings in lower Manhattan.
When I joined Jane Street from college in 2010, all of the firm’s proprietary trading systems ran out of a 8’X12’ server room on the 33rd floor of 1 New York Plaza, on the southern tip of Manhattan. Jane Street’s ETF market-making, options vol pricing, intercountry ADR arbitrage, and pan-equity stat-arb operated from this small deployment. The room itself was an engineering feat: the Dell server arrays were too heavy for the 1960s building’s floors to support, so the racks were affixed to the ceiling with concrete.
By 2012 Jane Street was not yet a member of most major US exchanges, even NYSE, and had virtually no presence in colocation facilities. Nevertheless, it was a ~$2B company experiencing rapid growth, a designated liquidity provider in most listed ETFs, a significant percentage of US and international equity volume, and a critical operator in capital markets.
In October 2012, Hurricane Sandy devastated lower Manhattan. 1 New York Plaza, Jane Street’s home, flooded to street level and the basement power generators were fully submerged. The resulting gas leaks made the office building hazardous to enter, and power and water were weeks away from being restored. Unprecedentedly, all major US exchanges closed for two business days after the storm but would be back up by day three. Jane Street was in danger of failing its lead-market-maker obligations if it didn’t relocate its business in time.
Jane Street had recently set up a partial office in a central New Jersey office park to comply with FINRA/SEC regulatory obligations for business continuity planning. A few engineers and I showed up to the empty site during the hurricane to begin mass-redeploying the firm’s software and infrastructure for the next critical 48 hours. A truckload of Dell PowerEdge R610s arrived the next morning, some salvaged from 1 New York Plaza’s server room, carried down 33 floors in pitch black by Jane Street’s IT team. For the next few months, everyone at the company from Rob Granieri to new-hires rode rented regional travel buses from Manhattan to NJ to keep Jane Street alive and growing.
When we all returned to Jane Street’s repaired 1 New York Plaza office in January 2013, the technology team realized something that’s obvious now: hardware doesn’t need to be colocated with people. The NJ disaster site had accidentally become Jane Street’s first firm-wide datacenter. The site afforded significantly more space, cheaper electricity, ground-floor weight support, and abundant cooling. This decision, to leave Jane Street’s servers in post-hurricane locations, would have profound effects on the firm’s infrastructure footprint and growth.
In 2013 it became a top priority for the technology and infrastructure teams to move all latency-sensitive trading into colocation facilities in order to cross-connect directly to exchange matching engine switches. And the search began for a new primary datacenter to house the firm’s research cluster and non-latency-sensitive applications.
In 2015 Jane Street found its new electronic home: lower Manhattan, limestone and 32-story windows, originally owned by the New York Telephone Company. It had retina-scan security and neon-colored liquid cooling and everything else we know today. They joined other major financial firms and software companies who had operated there for years.
In modeling disaster scenarios, experts tend to underrate the technological redundancies that already exist, or can be willed into rapid deployment, to ensure the US financial system remains secure.
Superintelligence markets will begin in Chicago due to DRW, Jump, CME, Architect, and hundreds of CFTC-regulated industry partners working to financialize compute and inference in the US. If you’re at FIA come visit Architect’s office, trade B300s, and play our CTO in 301.
Built a game like the forgotten N64 hit Tetrisphere in the browser for $0.15 using Liquid Inference’s auto-router.
Playable demo and exact steps in the reply.
Play it here: liquidinference.ai/showcase/…
Total cost: $0.15
3.2M uncached input + 26M cache reads + 91k output
Wall time: 1h46m
Steps:
1. Setup Liquid Inference
• Sign up liquidinference.ai
• Top up, add Claude API key to BYOK (“Bring Your Own Key”) section
• Setup Liquid Inference cli: inference.ai.exchange/docs/c…
2. Planning: I prefer to use Opus to plan the in-depth prompt to be given to more cost-efficient LLMs
• Use the cli to set the model to BYOK Opus 5.5, run claude code
• Save Google Image results for Tetrisphere for reference images
• Ask Opus to create a detailed prompt for implementing a complete Tetrisphere-like game for desktop and mobile browsers using three dot js
3. Implementation: I use liquid dot auto auto-routing model to get the lowest token cost inclusive of caching
• Use /model in claude code to set the model to liquid dot auto
• Paste the prompt and reference images saved from step 2
• Wrote a few followup prompts to adjust difficulty, add help section, and deploy to the Liquid Inference domain
11
1,079
In agentic trading, exchanges without MCP will be invisible.
It was an honor to join the CFTC’s Frontier Forum on super intelligence. A big question is how exchanges/brokers enable agents to trade derivatives while ensuring appropriate risk management. Exchange protocols and MCP:
Liquid Inference is serving 10B tokens/day and growing 200% week over week.
Most of the traffic is agents and long chats. Across 470k charged jobs, 88.7% of input tokens were cache reads.
Here’s how our matching algorithm prices offers with cache hit rate included:
In multi-turn and agentic workloads, the biggest cost and latency wins come from prefix/KV cache reuse. Each turn resends the full conversation, so if a provider still has that prefix in its cache it can bill those tokens at its cache-read rate, often a small fraction of the normal input rate.
Naive load balancing or pure price auctions scatter a session across different providers or replicas, forcing full prefill on every turn and destroying the savings.
Our matching algorithm ranks offers on the expected charge inclusive of cache hit rate rather than the full list price:
1. We measure how much of each workspace’s input repeats from one turn to the next (7-day window, at least 50 jobs).
2. We multiply that share by the measured cache hit rate of each deployment.
3. We price those tokens at the offer’s cache-read rate and subtract the expected saving from the offer’s ranking charge.
4. The deployment that served the previous turn keeps a 5% margin, so a cheaper offer has to win by more than 5% to pull a warm session away. In other words, for the right price we will abandon the cache and choose the cheaper alternative.
The credit only changes the order of the offers. A wrong estimate cannot make a job cost more than its price cap. Every receipt shows the cache share we expected, the share that was realized, and the credit in dollars.
That’s how we continue to improve on cache hit rate and provide the best economics for our clients’ sessions.
Announcing Reservations on Liquid Inference. Inference buyers can now reserve batches of tokens in advance at fixed prices over any time period. Providers compete to offer the best terms and SLAs instantly. How it works:
• Enter a lock-in duration from 1 to 12 months
• Specify token rate and uptime requirements
• Select from ZDR, SOC2, and other compliance/privacy features
• Receive multiple quotes and terms
• Negotiate through in-app messaging directly with providers
• Optionally allow overage to automatically query the spot market
Providers benefit from standardized contracts, automated billing, SLA monitoring, and zero additional fees to participate. Check it out and let us know, we’re here for all feedback.
We work closely with businesses, individual developers, and inference providers.
inference.ai.exchange/sign-u…
1
5
979
Fifty providers are now in the Liquid Inference network, up 22 in a week, over half the size of competitors’ networks in two weeks since launch. Every frontier open-weight LLM is quoted, and we actively benchmark all model+provider pairs to ensure model weight fidelity.
I’m honored to speak at the @CFTC’s first Frontier Forum in DC next week. Looking forward to discussing the role of SI in US futures markets. Thank you to Chairman Selig and the Innovation Task Force.
Super intelligence is poised to transform our financial markets.
Through the @CFTC's inaugural Frontier Forum, we are bringing together leaders at the intersection of technology and finance to explore the opportunities and risks of super intelligence and help shape the next frontier of American financial innovation.
Read more about our first Frontier Forum on October 28:
cftc.gov/PressRoom/PressRele…
More Liquid Inference integrations launched over the weekend:
- @Deepseek_ai V4.1-Flash-1017 model support and Deepseek Harness integration
- @Openclaw plugin for agent backend
- @ComfyUI plugin for image and video generation and editing
- Embedding models
We ship every day.
With open-weight model use surpassing frontier models among developers, even ahead of the IPOs, inference tokens are now behaving like commodities.
What if AI inference were priced like stocks?
@Architect_Fi Founder and CEO @BrettHarrison explains how an auction-based marketplace could drive down the cost of running AI models:
“In our version of this sort of competitive inference exchange, people can constantly move their prices around based on their marginal cost.”
Thank you @akashpasricha and @theinformation for having me on to talk about the launch of Liquid Inference.
Liquid Inference now supports images and video! Video inference costs aren’t optimized to the same level as text, and a fair auction brings iterative AI content creation in line. Access via our API or check out the compare tool in our web playground.
The Liquid Inference router network is growing quickly. We now have 28 verified companies serving >1000 models, offering capacity dynamically and updating quotes in real-time. Average time for providers to onboard and integrate models is 3 hours, full verification within a day.
Trillions of daily tokens ready to be served, with the best cost-efficiency across open-weight models, thanks to our new provider partners:
- Blackfuel @blackfuelai
- Dolphin: @dphnAI
- Doubleword @doublewordai
- Fortytwo @fortytwo
- Instant: @thinkinstant
- Jetinfer: @jetinfer
- Luminal @luminal_ai
- Muna @usemuna
- Pareton @pareton_ai
- Pera: @peracomputing
- Silares: @silares_ai
- Subconscious: @subsysdev
- TensorX @tensorx_ai
Liquid Inference is now a supported model provider plugin for @NousResearch Hermes. Providers compete on price for every backend prompt, powering your Hermes Agent with low-cost inference across a variety of LLMs.










