Hi, I encountered another issue about the speed to upload files to this platform. A 1.4G file took 18 hours to be uploaded 99%, but finally failed. Is that also related to the infrastructure? Would this be solved? Thank you!
Hi @Xinyang
Uploading data would be a bit different that the tool box not loading so let’s split this out.
How are you using the Upload tool? URLs to a remote site? Or is this local file browsing from your computer? What is the file type? Just one file or several? Was this working faster before and now is slow, or has it always been slow, or is this the first time loading this data this way? Have you tried again since posting?
You can share more details, too, and confirm this was at UseGalaxy.org.
Hopefully we can sort this out!
Hi @jennaj
I’m uploading several files browsing from my computer to UseGalaxy.org when the tool box has been loaded. The files are .fq.gz files and there are 12 totally. Each of them is around 1.5G. It is working slower than in the past. In the past, it took around 3min to upload a file in such a size but now it takes around 18 hours. I have tried several times since posting and it remains slow. Any suggestions to fix this? Thanks
I’ve done a bit of testing and am unable to reproduce speeds this slow - from my institutional network I was uploading at around 8 MB/s (66 mb/s) and from home internet at 1.4 MB/s (11 mb/s). 18 hours for 1.5 GB puts you around 0.02 MB/s.
We have made a bunch of infrastructure changes in the past week so it’s entirely possible something on our end is causing this for you, but it’s going to be difficult to track down what it is. Can you try from a different internet connection and see if you get the same results? The galaxy-upload command line upload tool might be useful for testing.
I have also been experiencing slow upload speeds over the past few weeks. Fastq files of ~1G size take 15min to upload, which is much slower than before. I have tried different hard drives and different PCs, with the same result.
Just to be clear, are you seeing the slowness in the progress bar of the upload dialog, or in the time it takes for those datasets in the history to go from gray → yellow → green in your history?
Progress bar, although it also seems to be slower in reaching ‘green’ status
Are you able to test with other public Galaxy servers such as usegalaxy.eu, usegalaxy.org.au, and usegalaxy.fr for comparison?
I have not tested on other servers. I’m currently uploading a large dataset to usegalaxy.org and don’t want to do anything to disrupt this at the moment, but if it is as simple as logging into the same account on another server, then I will test it at some point
The accounts are independent, so you’d need to create one on the other servers. But it’d be useful as a test since I’m not able to reproduce such slow speeds on our side.
I’m experiencing slow upload onto usegalaxy.org, too. My home internet upload speed is 300mbps, but right now it’s uploading at 8mbps over wifi and 12mbps over ethernet. I’ll try again with my institutional network on Monday.
Update: no issue uploading to usegalaxy.eu. Speed was ~30mbps over wifi and ~60mbps over ethernet there, all done from home internet
Upload speeds are much faster on galaxy.eu. Thanks for the suggestion