all stories purged, nothing to free in the storage manager, still 57% full

Hi
I had a history occupying half the storage but the storage was full. After looking for deleted but not purged datasets, I decided to purge all histories and start from scratch. Si I did, I purged all histories, when I go to see all datasets are purged. I should have empty storage, but it says it’s 57% full.
I need to reupload 100 GB of original data to restart, but I can’t.
Please help.

Welcome @ed_bahnson

Full data purges run as a background process. The purge is likely still running if you used the Storage Dashboard → Refresh function already but just a short time ago. If you haven’t done that, you could now since it will speed it up a bit.

However, since you are working at UseGalaxy.org you have access to an additional 1 TB of temporary “scratch” working space. That is a great place to store raw data files since those are usually not needed again after the data is run through QA steps.

If you are not sure where to find that space, this topic explains the overview details, and we can follow up here about anything not clear.

For what you are doing now, you could do any of these

  1. Create a new history and give it a name. Set that history to use the scratch space (database icon at the top), and Upload data into that history. Then continue to use the scratch space or toggle the space to the permanent storage for next processing steps (the purge might complete by then).

    • However the storage space is assigned for a history is where any new datasets in that history will write. Existing datasets will keep the original assignment. You can change that assignment per dataset on the job details page using the i-icon.
  2. Set the entire account to use the scratch space as a default, then either toggle histories to the other space as wanted, or send workflow outputs to the different spaces (you can split where data writes).

If your scratch space is also full, and you are stuck, I can look at your account details (I’m an admin at this server). Let me know if you need this review and I’ll send you a direct message.

Please let us know how this works out or if you need more help! :slight_smile:

Thank you very much!

1 Like