For large archives, 10GB in our case, we had issues exporting to gzip or bzip2--it would crash before the archive was completed. Sort of annoying in that it took almost 24 hours from the start of the archive creation to the crash event. The help desk could not resolve the issue for us. Originally, we chose gzip/bzip2 formats instead of getting a series of files with zip (i.e. zip max file size is 4GB)
At end of the day, we had success choosing the zip archive format. We did not receive a series of zip files, but just one large uncompressed text file in mbox format.
Our last big data dump was down back in late December 2013, so I am not sure if these issues persist regarding bzip/gzip2 and 10GB size archives.
At end of the day, we had success choosing the zip archive format. We did not receive a series of zip files, but just one large uncompressed text file in mbox format.
Our last big data dump was down back in late December 2013, so I am not sure if these issues persist regarding bzip/gzip2 and 10GB size archives.