# My rule based uploader recipe for EBI ENA

**URL:** https://help.galaxyproject.org/t/my-rule-based-uploader-recipe-for-ebi-ena/4393
**Category:** Uncategorized
**Tags:** upload
**Created:** [September 2, 2020, 9:42am UTC](https://help.galaxyproject.org/t/my-rule-based-uploader-recipe-for-ebi-ena/4393 "2020-09-02T09:42:57Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![pvanheus](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/pvanheus/32/117_2.png) [@pvanheus](https://help.galaxyproject.org/u/pvanheus)
#### Post date: [September 2, 2020, 9:42am UTC](https://help.galaxyproject.org/t/my-rule-based-uploader-recipe-for-ebi-ena/4393/1 "2020-09-02T09:42:57Z")

</div>

The [Rule based uploader tutorial](https://training.galaxyproject.org/training-material/topics/galaxy-interface/tutorials/upload-rules/tutorial.html) by @jmchilton and @hexylena provides an example of creating a list of dataset pairs. I find a slightly adapted version of the procedure very useful for loading collections of sequences from EBI’s European Nucleotide Archive into Galaxy. Since once can now save and share “recipes” from the uploader I though I’d share my recipe here.

My starting point is a project page in ENA, e.g. the one for [PRJNA522942](https://www.ebi.ac.uk/ena/browser/view/PRJNA522942), which is data from this [paper](https://www.frontiersin.org/articles/10.3389/fmicb.2019.01741/full) by Chen et al. On that page, choose to download the report in TSV format (i.e. click on the TSV - see the image below where that link is highlighted):

 ![ena](https://us1.discourse-cdn.com/flex020/uploads/galaxy/original/2X/3/38a4b02c5eb3c4b8673ed22f574b94a30372a528.png)

In the rule based uploader choose to upload data as a collection and choose to load the tabular data from a pasted table. Paste the TSV report from ENA into the form and click the build button.

In the rule based uploader, click the spanner icon (highlighted in the image below), paste the recipe from [here](https://gist.github.com/pvanheus/5d5cf14e3602ab462f0b6125d52344f5), give your new collection a name and click Upload.

![rule](https://us1.discourse-cdn.com/flex020/uploads/galaxy/original/2X/d/d1d3c9d94be14b0651935c5eddddc79feb7d40ff.png)

Then sit back and wait. Galaxy will download the files from ENA and create a list of paired dataset collections with the name you gave it. Note that this recipe filters out non-paired end datasets - it will not work with single-ended data or ENA projects that contain a mix of single and paired end data.

---

<div class="post-metadata">

### Author: ![pvanheus](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/pvanheus/32/117_2.png) [@pvanheus](https://help.galaxyproject.org/u/pvanheus)
#### Post date: [September 3, 2020, 8:16am UTC](https://help.galaxyproject.org/t/my-rule-based-uploader-recipe-for-ebi-ena/4393/2 "2020-09-03T08:16:13Z")

</div>

btw I have noticed that due to network problems on the EBI ENA side (variable network speeds and connection problems when doing automated retrieval from ENA are common) this procedure does not work for all ENA projects. Perhaps some additional work on the Galaxy uploader can help fix this.

---

<div class="post-metadata">

### Author: ![bjoern.gruening](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/bjoern.gruening/32/10_2.png) [@bjoern.gruening](https://help.galaxyproject.org/u/bjoern.gruening)
#### Post date: [September 8, 2020, 2:10pm UTC](https://help.galaxyproject.org/t/my-rule-based-uploader-recipe-for-ebi-ena/4393/3 "2020-09-08T14:10:12Z")

</div>

Super cool, thanks for sharing!
