Unified Data Platform – One interface to query, discover, and collaborate on data. Data versioning & federation, built with Postgres, inspired by Docker & Git.
📍 Remote — USA, UK, Europe
Joined October 2018
- Tweets92
- Following2
- Followers154
- Likes39
Pinned Tweet
Thrilled to announce that Splitgraph has been acquired by EDB!
From all of us at Splitgraph, thanks for being part of our journey these past five years. We can't wait to share more as we continue it under EDB's flag.
Read more in our blog post: splitgraph.com/blog/splitgra…
Splitgraph retweeted
📢 Exciting News! We have acquired @splitgraph, a serverless SQL API disruptor. This strategic move enhances our commitment to solving diverse data challenges, & will make data lake/warehousing operations more efficient, streamlined, and collaborative. ⬇ okt.to/271y0b
Splitgraph indexes 40,000 public datasets and makes them queryable via SQL.
We're experimenting with @OpenAI and @langchain to generate SQL queries from questions, like "Which residential neighborhood of Chicago is the most expensive?"
Read the blog: splitgraph.com/blog/gpt-powe…
How?
1. Index each repository in a namespace (e.g. 𝚍𝚊𝚝𝚊.𝚌𝚒𝚝𝚢𝚘𝚏𝚌𝚑𝚒𝚌𝚊𝚐𝚘.𝚘𝚛𝚐) to create @OpenAI embeddings via @langchain and PgVector.
2. Compare the question to embeddings
3. Retrieve schemas from Splitgraph API
4. Generate SQL
github.com/splitgraph/splitg…
5
680
People often assume that "Splitgraph" must have something to do with GraphQL, but nope 🙂We're a serverless data platform!
BUT! We do *use* GraphQL in our web stack...
Here are some best practices we've learned about @apollographql cache invalidation:
splitgraph.com/blog/keeping-…
Seafowl is a serverless OLAP database for analytics "at the edge." It needs to store metadata (schemas, etc.) in a SQLite or Postgres DB, but how do we avoid that bottlenecking?
We can deploy to @googlecloud and mount the #SQLite catalog with GCS FUSE!
splitgraph.com/blog/deployin…
See the code, and try deploying your own instance to your @googlecloud account (it all fits within the free tier!)
github.com/splitgraph/seafow…
94
Splitgraph retweeted
Seafowl lets you deliver query results for data visualizations, dashboards and notebooks in milliseconds.
The team at Splitgraph published a neat guide on using Dagster to orchestrate these interactive analytical applications:
splitgraph.com/blog/seafowl-…
Splitgraph retweeted
I'll be on stage in a rather intimidating-looking palazzo at #ijf23 in about an hour, talking about @acdatacollectiv and demo-ing a new map we've built with tech from @splitgraph. blog.datadesk.eco/p/tracking…
SQLite Postgres
🤝
Splitgraph
🔼 Upload SQLite files to the Data Delivery Network
🔐Share tables publicly, or invite collaborators
📈 Query them with SQL
splitgraph.com/blog/sqlite-f…
End result...
Repository: splitgraph.com/miles/chinook…
Query: (click the Twitter card, it's long link with the SQL query in it!)
splitgraph.com/query?id=a998…
1
56
Splitgraph indexes 40,000+ open datasets, from 200+ government data portals - like those from @CDCgov and @USAID - and makes them all queryable with #SQL
We made a newsfeed for tracking daily additions (and deletions!) of datasets on those data portals:
open-data-monitor.splitgraph…
BLOG: Seafowl's storage layer is now built on delta-rs, a Rust native interface to Delta Lake (a protocol pioneered by @databricks for the "Lakehouse" pattern).
It's a perfect fit for Seafowl, a database optimized for cache-friendly queries "at the edge"
splitgraph.com/blog/seafowl-…
Seafowl is an analytical database for modern data-driven Web applications, written in @rustlang with #Datafusion and optimized for running cache-friendly queries "at the edge."
The storage layer is now based on the Delta Lake protocol, thanks to delta-rs
github.com/splitgraph/seafow…
↗️ Import data into @splitgraph
↘️ Export it to Seafowl (deployed to @flydotio, cached with @Cloudflare)
🧑💻Query it from @nextjs with 𝚞𝚜𝚎𝚂𝚚𝚕 from our new library @𝚖𝚊𝚍𝚊𝚝𝚍𝚊𝚝𝚊/𝚛𝚎𝚊𝚌𝚝
🚀 Deploy to @stackblitz
😎Try it now: github.com/splitgraph/madatd…
ALT useMetricsByQuery hook demonstrating usage of useSql from splitgraph/madatdata (npm @madatdata/react)
Great work by the @ipinfoio team releasing free data downloads of country and ASN data! As a demo, we loaded the latest downloads into a Splitgraph repository ⤵️
splitgraph.com/miles/ipinfo-…
Since Splitgraph is built on @PostgreSQL, it's easy to work with columns as `inet` or `cidr`
Splitgraph retweeted
The folks at @splitgraph are doing some interesting things with @ApacheArrow DataFusion. Foreign data wrappers!
splitgraph.com/blog/datafusi…
Splitgraph retweeted
Seafowl: a CDN-friendly analytical database that uses Apache DataFusion
seafowl.io
Discussions: discu.eu/q/https://seafowl.i…
#programming #rustlang
by @splitgraph
Splitgraph retweeted
Seafowl, the database for analytics at the edge, is now out!
A blog post about how our demo deployment (running on @flydotio's free tier) uses @Cloudflare CDN to cache and deliver SQL query results globally.
splitgraph.com/blog/seafowl-…