Version 3 (modified by knpa, 4 years ago) (diff)

--

Back up

This page describes how data is backed-up at ARSF-DAN.

Back-up data should be linked from /users/rsg/arsf/backups/

The PML overnight back-up only covers home directories and does not make copies of anything on the arsf data storage disks.

We therefore have our own scripts to backup things nightly to a different server.

There are two types of back-up:

  1. Mirror of arsf_data:
    This is located at ~arsf/backups/arsf_data_mirror/. It is an exact copy of everything under ~arsf/arsf_data/ EXCEPT flights which have been archived with NEODC.
    If you accidently delete a file in arsf_data while processing, you can come here and retrieve a copy, as long as it was present for the overnight backup.
  1. Record of past changes:
    This is located at ~arsf/backups/rdiff_backup/. This hold a record of changes to small files (anything under 1MB I think). This way, we can recover changes to text files e.g. configs, made weeks or months ago. We can also find out the details of how something was processed by looking here. The rsync related comman rdiff is used to create these. Each flight is in a different folder. The past changes are help in ~arsf/backups/rdiff_backup/<flight_dir>/rdiff-backup-data/. To recover the changes, please see documentation on rdiff.

All backups are performed by the script at: ~arsf/usr/bin/repos_back_up_rsync_rdiff.sh

The cronjob that calls the above script is located at: /users/rsg/rsgcode/linux-i386/in_house/configs/cronjobs/crontab-arsf.gridmaster-SEC
Which writes to this log@ ~arsf/backups/backup_log.txt

The crontab is currently set up on gridmaster3 to run at 4am every morning.