Slow downloading

Hello,

I am trying to download BAM files from my usegalaxy.eu history, but the rate is <20 KB/s. An internet speed test shows no problem with my connection. Could there be an issue on the server side? Note: I am located in the US.

Hi @imperialadmiral121,

As a test, I downloaded a small BAM file from Galaxy Europe. I got 2-3 MB/sec at some point, but I have slow internet at home, and I am in Australia. It took about a minute for 90 MB file.

Kind regards,

Igor

Thanks Igor. My download speeds are currently ~100KB/s from usegalaxy.eu (still extremely slow). They are much faster (at least 20MB/s) from usegalaxy.org. Still trying to figure it out

No change today - downloading still slow

So I just tried to download a 500MB file from Galaxy Europe from Freiburg (so kind of next door) and I’m seeing 20MB/sec just like you observe it for .org.

Just to exclude that possibility: is your data in any special storage location or just in our permanent default storage?

Good observation. It is in the 2TB temporary storage. I will test the default storage when I get the chance.

Downloading from the unshareable storage (250GB) is also slow (similar speeds)

I’m having really slow too. Moving some files from .eu to .org, been running about 1.5hrs so far and the only thing completed so far is 2 very small files. I was moving 4 sets, where each set is approximately 3GBx3GB and 5mb, 2 sets have been running 1.5hrs, the other two sets hasn’t even started.

I also noticed that I’m currently running Bowtie2 on my files at .eu, they seem to be taking much longer than normal. Maybe it’s related?

@Jon_Colman Are you based in the US? The other users who have noted higher speeds are in Australia and Germany

Yes I’m in the US, though it shouldn’t make a difference as I was trying to transfer from server to server

@wm75 I am getting very slow transfer for BAM files between Galaxy Europe and Galaxy Australia (data transfer by URL from Europe to Australia), less than 3 MB of data per minute (based on tmp file in the working directory). As a test, I copied ~2 GB BAM from .org to the Australian server. The transfer was completed in in ~2 minutes, and total run time for the job was under 4 minutes.

Update: it took 40 minutes to copy 120 MB BAM file from Galaxy Europe to Australia. Coping the same file from Aus back to Eu took one minute. It seems the connection between the servers is OK.

My university’s IT department says that there is a bottleneck slowing things down around Switzerland (using a traceroute)

Downloads are currently fast (>15MB/sec) on my home internet. I will check tomorrow to see if the issue is resolved when downloading at my university

Downloading is still slow from my university (Wifi and ethernet). Not sure if this is conclusive, as I’m seeing other posts that the Galaxy EU server is slow today. Will have to do another download test at home later to confirm whether or not my issue is related to specific download locations

Downloads from home are not as fast as before (<10MB/sec), but still much faster than at my university.

My university believes it is an issue with usegalaxy.eu. Perhaps download restrictions based on source region, or other traffic rules.
Based on the summarized observations, ChatGPT says the most likely issue is “a routing/peering problem somewhere on the [university] → GEANT → European research network → usegalaxy.eu path”

Chiming in to say that I’m experiencing slow download speeds in the US from the EU Galaxy site. I haven’t changed any settings, and a 500 MB file that used to take 10-15 minutes to download is now taking two hours.