# Downloading a collection from usegalaxy.org fails to complete

**URL:** <https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649>\
**Category:** usegalaxy.org support\
**Tags:** download\
**Created:** [February 19, 2019, 2:47pm UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649 "2019-02-19T14:47:05Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![kees](https://avatars.discourse-cdn.com/v4/letter/k/7bcc69/32.png) [@kees](https://help.galaxyproject.org/u/kees)\
**Post date:** [February 19, 2019, 2:47pm UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649/1 "2019-02-19T14:47:05Z")

</div>

Hi,  
I’m trying to download a collection of wiggle files from the [usegalaxy.org](http://usegalaxy.org) server, using instructions from this page: [https://galaxyproject.org/support/download-data/](https://galaxyproject.org/support/download-data/). I have tried using Chrome and using curl command in terminal. Downloads start fine, however, both methods fail after ±1GB has been downloaded. Terminal output below (links redacted). Would appreciate any suggestions to make this work.

```auto
mlp-varo-010:~ k.boogerd$ curl -o collection.tar.gz https://usegalaxy.org/api/dataset_collections/REDACTED/download?key=REDACTED
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 1029M 0 1029M 0 0 2028k 0 --:--:-- 0:08:39 --:--:-- 3283k
curl: (18) transfer closed with outstanding read data remaining

```

```auto
mlp-varo-010:~ k.boogerd$ curl -C - -o collection.tar.gz https://usegalaxy.org/api/dataset_collections/REDACTED/download?key=REDACTED
** Resuming transfer from byte position 1079838960
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
  0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.

```

---

<div class="post-metadata">

**Author:** ![jennaj](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/jennaj/32/27_2.png) [@jennaj](https://help.galaxyproject.org/u/jennaj)\
**Post date:** [February 19, 2019, 6:20pm UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649/2 "2019-02-19T18:20:06Z")

</div>

> [@kees](#):
>
> curl: (18) transfer closed with outstanding read data remaining

Hi - Could you give this another try? I cannot reproduce the problem with a 1.7G BAM collection.

The incomplete transfer may have been due to a transient server issue or downloading from a slower internet connection.

_Small gotcha:_ The resume command can fail like this with older versions of `curl` when the file is already downloaded completely. That doesn’t seem to be your case if the original collection size is over 1029M – that said, updating `curl` anyway to eliminate any legacy issues with older versions would be a good idea.

If after updating curl, rerunning, and the complete collection fails to download completely, please write back and we can troubleshoot from there.

Thanks!

---

<div class="post-metadata">

**Author:** ![kees](https://avatars.discourse-cdn.com/v4/letter/k/7bcc69/32.png) [@kees](https://help.galaxyproject.org/u/kees)\
**Post date:** [April 3, 2019, 8:15pm UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649/3 "2019-04-03T20:15:14Z")

</div>

Thanks for the suggestions. It appears that my local settings indeed are the issue. Although not resolved yet, I’ve been able to download the files using another PC. Thanks!

---

<div class="post-metadata">

**Author:** ![nate](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/nate/32/1752_2.png) [@nate](https://help.galaxyproject.org/u/nate)\
**Post date:** [August 18, 2020, 2:57pm UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649/4 "2020-08-18T14:57:18Z")

</div>

I believe this was due to the nginx buffer temp file max size being 1GB by default. We probably can’t support buffer temp files large enough for collections, but I have disabled buffering for collection downloads on [usegalaxy.org](http://usegalaxy.org/) entirely, which may fix this issue (hopefully without creating more issues). Please give it a try and let us know if it’s still not working.

---

<div class="post-metadata">

**Author:** ![bernt-matthias](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/bernt-matthias/32/502_2.png) [@bernt-matthias](https://help.galaxyproject.org/u/bernt-matthias)\
**Post date:** [November 16, 2020, 8:30am UTC](https://help.galaxyproject.org/t/downloading-a-collection-from-usegalaxy-org-fails-to-complete/649/5 "2020-11-16T08:30:33Z")

</div>

Hi @nate … I believe we have the same issue on our server. Could you share the part of the nginx configuration that you changed?
