Unified Data Platform β One interface to query, discover, and collaborate on data. Data versioning & federation, built with Postgres, inspired by Docker & Git.
π Remote β USA, UK, Europe
Joined October 2018
- Tweets92
- Following2
- Followers154
- Likes39
βοΈ Import data into @splitgraph
βοΈ Export it to Seafowl (deployed to @flydotio, cached with @Cloudflare)
π§βπ»Query it from @nextjs with ππππππ from our new library @πππππππππ/πππππ
π Deploy to @stackblitz
πTry it now: github.com/splitgraph/madatdβ¦
ALT useMetricsByQuery hook demonstrating usage of useSql from splitgraph/madatdata (npm @madatdata/react)
β Query Splitgraph from @observablehq
Let's graph border crossing data by state, sourced from @TransportStats and available on Splitgraph
Hmmm... is that peak Niagra Falls season showing up in the data? π€
See for yourself: observablehq.com/@milesrichaβ¦
β Query and map geodata with Splitgraph, πππππ, and @Mapbox
Example: Mapping traffic accidents in Fort Worth, TX
π See it: neumark.github.io/splitgraphβ¦
π How to: splitgraph.com/jumpstart/mapβ¦
β Query Splitgraph from @streamlit with πππ’πππππΈ
Let's graph NYC turnstile data since March 2020, sourced from @MTA, cleaned up by @jadelharake and imported into Splitgraph by @onpaws
Dashboard: share.streamlit.io/splitgrapβ¦
Data: splitgraph.com/paws/nyc-tranβ¦
𧡠Want to try?
Since Splitgraph is compatible with the @PostgreSQL wire protocol, you can connect to it with any Postgres client, just like it's a normal database.
1
6οΈβ£ We query the data!
π» We can use the built-in web client with autocompletion across all data on Splitgraph.
β§ We can even query across versions of the same dataset, to see exactly what changed over time.
1
5οΈβ£ We browse the repository in the catalog. Once we push data to Splitgraph (or build it automatically), it's instantly discoverable, and we can:
π Search across all repositories
π¦ Discover data with up to date metadata
π Document data in the same place we query it
1
4οΈβ£ We make a change to our @getdbt models measuring active users and feature usage, to exclude activity from users with known spam e-mails.
1
1
3οΈβ£ We wait for Splitgraph to build the next image like we scheduled in ππππππππππ.π’ππ
π‘ Or, we can orchestrate our entire infrastructure βΒ from ingestion of raw data to new builds of @getdbt models β with @github Actions!
π We're releasing scaffolding tools soon!
1
2οΈβ£ We create a ππππππππππ.π’ππ file defining the structure of our datasets β
π ππππππππππ.π’ππ is a declarative syntax for describing and mapping your data infrastructure
π Think of it like #terraform for your Data Stack.
1
𧡠Here's an example of how we use this on our private Splitgraph Cloud (want one? DM us) β
1οΈβ£ We import the raw @stopforumspam data into its own repository at πππππ’ππππ/πππππππππππππ
1
1
π Create a repository from @getdbt models.
π Build versioned Splitgraph images from them, on demand or on a schedule.
β Query the images like any other @PostgreSQL table.
β§ Easily πΉπΎπΈπ½ across versions for time-travel queries.
Invite collaborators to query your repository with you... share data as easily as you share a Notion doc or Figma file β
Do you recognize these tools? Maybe even work with them on a daily basis? Then we want to talk to you! Sign up here: forms.gle/GWY7wM6W9Sz2FWJ39
You will be compensated for your time, and you'll help us with our user research!
#dbt #snowflake #stitch #collibra #immuta #fivetran
ALT Are you a Data Engineer or Data Scientist? We have some questions for you! 30 Minute Interview $50 Amazon Gift Card If you use any of the following tools, we want to talk to you: dbt Snowflake Stitch Collibra Immuta PopSQL Matillion Alteryx Fivetran Teradata Presto et. al dvc Metabase Amundsen BigQuery Looker
We're hiring at Splitgraph across the stack, but especially on the #frontend. This isn't just pushing #react components β we've got some serious frontend application features we want to build.
Interested? Know somebody who is? Retweet or apply here: notion.so/splitgraph/Splitgrβ¦
