import big file from protected cloud to my usegalaxy account

hi, I have a personal WGS BAM from YSEQ lab that I’d like to import to my usegalaxy.eu account directly because it’s too flat (134 Gb) for upload from my PC via FTP (Filezilla). I could transfer directly from YSEQ database to my Gdrive with google colab code:

admin-redacted

I made 4 part.bam by range and merged with cat after download.

Could I program by console this kind of direct transfer from cloud to usegalaxy?
thanks

1 Like

Welcome, @Miquel_R

Galaxy can import any data with a public URL link. This means not password protected but API keys can be involved.

Using the Google API should work. This would allow you to load files from your drive account – you can set the permissions to public sharing (anyone with a link). So, two steps but a potential solution that doesn’t involve a download. Splitting the files up into smaller chunks might be needed (what you seem to already be doing).

Other options involve setting up authentication inside your Galaxy account. Dropbox is one choice.

And this utility can be helpful for batch data loading from inside of an environment where the data is hosted.

I’ve cross-posted this over to the Admin chat to see if there is more advice. If you could confirm that you are working at the UseGalaxy.eu public server that might be relevant.

Hope this helps! :slight_smile:

Note: If you posted anything sensitive (I wasn’t sure?), you should update those credentials immediately since they were exposed publicly here.

1 Like

Thank you, Jenna, I masked all sensitive data, agreed by Google APIs to import data

1 Like