This chapter describes some common problems that may happen during the usage of the archive, together with possible solutions and how to better submit a problem to the technical staff.
Make always a preventive estimation of the total size of data and the number of files you want before starting automated commands with wildcards or loops!
It is useless for example to first stage 500 GB of files and then copy them to the scratch of another system: you can be sure that at the time the last file is staged to the cache, the first ones would have been already released...
If you need to retrieve bigger amount of data, split the task in smaller chunks of 10 to 50 GB and copy each one of them to wherever you want before staging the next one.
See the following real example for a script doing that.
Separating a 500GB staging action in 10 parallel task of 50 GB would also be useless: submit them sequentially
- The procedures described in this chapter are to be considered for 'advanced users' and may require some degree of Unix knowledge. Normal users probably want to submit a request to the technical staff in order to be assisted instead of trying those procedures themselves.
Please, look at this examples: