Dat is a grant-funded, open-source, decentralized data sharing tool for efficiently versioning and syncing changes to data.
Dat can be used to version data locally, or to share and sync data over the internet. Dat includes an optional peer-to-peer distribution system, meaning that the more widely that a dataset is shared, the faster it is for users to retrieve or sync a copy, and the more redundant that the dataset’s availability becomes.
The first code went into Dat on August 17, 2013. The first six months were spent making a prototype (thanks to the John S. and James L. Knight foundation Prototype Fund), followed by taking Dat beyond the prototype phase and into an alpha release.
In the spring of 2014 we were able to expand the team working on Dat from one to three people, thanks to support from the Alfred P. Sloan foundation. Sloan’s proposition was that they like the initial Dat prototype, but wanted to see scientific data use cases be treated as top priority. As a result we expanded the scope of the project from its tabular data specific beginnings, and have focused on adding features that will help us work with larger open scientific datasets. Sloan redoubled their support in the spring of 2015, allowing us to continue to fund three positions for another two years.
In the winter of 2016, the Knight Foundation provided significant funding to create a registry for Dat-hosted datasets, as well as enabling the project to grow and establish a 501(c)(3) non-profit.