Your datasets,
right there with your code.
Joule is a command-line utility that stores and retrieves datasets for you, just like Git does for your code.
Scroll down to see how
Managing datasets used to be complex
Download instructions are burried within long READMEs
Hosting sites are erratic and inconsistent
Downloads are split between multiple archives, are slow to complete, and fail easily
File archives take up space and can become corrupted during download
That's where Joule comes in
Joule aims at making dataset management easy
joule pull
One command to rule them all...
git clone `https://gitlab.com/joule-host/that-state-of-the-art-research-paper.git` Cloning into 'that-state-of-the-art-research-paper'...remote: Enumerating objects: 6, done.remote: Counting objects: 100% (6/6), done.remote: Compressing objects: 100% (4/4), done.remote: Total 6 (delta 0), reused 0 (delta 0)Unpacking objects: 100% (6/6), done.cd `that-state-of-the-art-research-paper`/dataset joule pull Pulling dataset...Download is complete ls -A .joule-spec.yaml cropped_faces labels GTDB_README.txt gt_db
Give it a try!
Features
|
Google Drive Dropbox |
Github Gitlab |
Self-hosting Cloud-hosting | Joule | |
|---|---|---|---|---|
| Stores Datasets | ||||
| Set & Forget | ||||
| Cost efficient | ||||
| Handles large files | ||||
| Battery-friendly | ||||
| Straightforward/Standardized | ||||
| Script-friendly | ||||
| Large storage | ||||
| Compressed storage | ||||
| Built for you |
Pricing
All new Joule accounts come with the free Hobbyist plan, which is enough for most people and allows you to greatly improve your workflow!
Hobbyist
Free
1GB of compressed Storage
7 pulls/month
Unlimited pushes
Non-commercial use only
-
Data Scientist
€2.99/month
25GB+ of compressed Storage
Unlimited pulls
Unlimited pushes
Commercial use
-
Research Team
€9.99/month
300GB+ of compressed Storage
Unlimited pulls
Unlimited pushes
Commercial use
Multiple account seats