StaticSection Batch Download

To download multiple files at one time you first need to get a metadata.tsv file that contains the information necessary for download as well as additional helpful information about the selected files. First select and filter the file(s) from either the browse Experiment Sets page, the search Files page, or from the page of an Experiment Set containing the desired files using the selector check boxes and facet filters. The Download button will generate and download a file 'metadata.tsv' to your local machine.

Instructions to download the files included in the metadata.tsv file as well as some general statistics on the files you selected are included at the bottom of the file itself.

You will need to create a new access key, if you don't have an access key already. Note that access keys created for Jupyterhub can't be used for the rest of the portal.

To create a new access key, first log in to the data portal, then click on your account in the upper right and click on Profile from the dropdown menu. There will be a button near the bottom of the page to add an access key. Save the key and secret; typically this is done by creating a file in your home directory called keypairs.json with the following contents/format (replacing the x’s with the appropriate key and secret, of course):

{
    "default": {
        "key": "XXXXXXXX",
        "secret": "xxxxxxxxxxxxxxxx",
        "server": "https://data.4dnucleome.org"
    }
}

Once the access key is created and stored, a file can be downloaded via curl with the following command:

curl -O -L --user <key>:<secret> <download-url>