# usegalaxy.eu: gz file getting corrupted during ftp import cycle

**URL:** <https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855>\
**Category:** usegalaxy.eu support\
**Tags:** upload\
**Created:** [October 18, 2021, 10:55am UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855 "2021-10-18T10:55:33Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![marten](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/marten/32/6_2.png) [@marten](https://help.galaxyproject.org/u/marten)\
**Post date:** [October 18, 2021, 10:55am UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/1 "2021-10-18T10:55:33Z")

</div>

## Any ideas on what can be causing the following file corruption?

### Path 1

- I have a `example.fastq.gz` file on remote server.
- I upload it to [usegalaxy.eu](http://usegalaxy.eu) using `curl -T {"example.fastq.gz"} --user user@name.de --ssl ftp://ftp.usegalaxy.eu`
- I import it to galaxy setting it’s datatype to `fastq.gz`
- I execute fastQC on it and end up with `Ran out of data in the middle of a fastq entry. Your file is probably truncated` or `ID line didn't start with '@'`
- I download the `example.fastq.gz` from Galaxy to disk
- I run `gunzip` on the file and get `unexpected end of file``uncompress failed`

### Path 2

- I have a `example.fastq.gz` file on remote server (this is identical file from Path 1)
- I use scp to copy it to my local disk
- I use `gunzip` to extract it
- I run fastQC locally
- All works fine

edit: the md5 has changed  
original

```auto
md5sum CB1A1_S1_R2_001.fastq.gz
33462a19ef9cb2595ffa06a849b062ff CB1A1_S1_R2_001.fastq.gz

```

downloaded from [usegalaxy.eu](http://usegalaxy.eu)

```auto
md5 CB1A1_S1_R2_001.fastq.gz
MD5 (CB1A1_S1_R2_001.fastq.gz) = 45284f73109d8866cfe81f3cdb2014ca

```

---

<div class="post-metadata">

**Author:** ![bjoern.gruening](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/bjoern.gruening/32/10_2.png) [@bjoern.gruening](https://help.galaxyproject.org/u/bjoern.gruening)\
**Post date:** [October 18, 2021, 12:55pm UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/2 "2021-10-18T12:55:48Z")

</div>

@marten does that also happen when you upload the file via web?

---

<div class="post-metadata">

**Author:** ![gmauro](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/gmauro/32/904_2.png) [@gmauro](https://help.galaxyproject.org/u/gmauro)\
**Post date:** [October 18, 2021, 1:12pm UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/3 "2021-10-18T13:12:43Z")

</div>

@marten Does it happen only with a specific file? Can you share that file with me?

---

<div class="post-metadata">

**Author:** ![marten](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/marten/32/6_2.png) [@marten](https://help.galaxyproject.org/u/marten)\
**Post date:** [October 18, 2021, 1:48pm UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/4 "2021-10-18T13:48:17Z")

</div>

> [@bjoern.gruening](#):
>
> does that also happen when you upload the file via web?

I tried once with the same file and it worked fine.

> [@gmauro](#):
>
> Does it happen only with a specific file? Can you share that file with me?

It happened with many files in that batch of 192 datasets. I’ll share a history with you

---

<div class="post-metadata">

**Author:** ![marten](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/marten/32/6_2.png) [@marten](https://help.galaxyproject.org/u/marten)\
**Post date:** [October 18, 2021, 5:47pm UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/5 "2021-10-18T17:47:56Z")

</div>

update: I’ve followed the same steps as in Path 1 on the whole set (182 files) at [usegalaxy.org](http://usegalaxy.org) and everything worked without an error.

---

<div class="post-metadata">

**Author:** ![gmauro](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/gmauro/32/904_2.png) [@gmauro](https://help.galaxyproject.org/u/gmauro)\
**Post date:** [October 27, 2021, 8:05am UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/6 "2021-10-27T08:05:12Z")

</div>

I uploaded a set of 57 fastq.gz files, from 400MB to 12GB, using curl from 3 different location in Europe (DE, IT, UK) to our FTP server. All of them were successfully transferred and verified.  
As I told you, I think something really weird it’s happening over the network between you and us.

---

<div class="post-metadata">

**Author:** ![marten](https://sea2.discourse-cdn.com/flex020/user_avatar/help.galaxyproject.org/marten/32/6_2.png) [@marten](https://help.galaxyproject.org/u/marten)\
**Post date:** [October 27, 2021, 8:35am UTC](https://help.galaxyproject.org/t/usegalaxy-eu-gz-file-getting-corrupted-during-ftp-import-cycle/6855/7 "2021-10-27T08:35:48Z")

</div>

Thank you very much for checking. That is a disturbing find nevertheless. 😕
