Difference between revisions of "Backup scripts"

From OpenKM Documentation
Jump to: navigation, search
(Created page with '== Remote backup == == Local backup to usb disk == <source lang="bash"> #!/bin/bash # ## BEGIN CONFIG ## MYSQL_PASS="" JBOSS_HOME="/home/openkm/jboss-4.2.3.GA" DATABASE_EXP="/h…')
 
 
(77 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
== Remote backup ==
+
{{TOCright}} __TOC__
  
 +
These backup scripts use rsync to minimize network load and creates incremental backups, preserving last four backups. For more info, read http://www.mikerubel.org/computers/rsync_snapshots/. Also recommend the article [http://dar.linux.free.fr/doc/mini-howto/dar-differential-backup-mini-howto.es.html DAR differential backup mini-howto].
 +
 +
To install the cron job, run:
 +
 +
$ sudo crontab -e
 +
 +
And add these lines according to your personal configuration:
 +
 +
<source lang="bash">
 +
MAILTO=nomail@openkm.com
 +
@weekly /root/backup.sh | tee -a /root/backup.log
 +
</source>
 +
 +
Or, if you want to separate log reports by date:
 +
 +
<source lang="bash">
 +
MAILTO=nomail@openkm.com
 +
@weekly /root/backup.sh | tee /root/backup.$(date +\%Y.\%m.\%d_\%H.\%M.\%S).log
 +
</source>
 +
 +
{{Note|MAILTO may also be used to direct mail to multiple recipients by separating recipient users with a comma.}}
 +
 +
This script will export all databases from a MySQL installation:
  
−
== Local backup to usb disk ==
 
 
<source lang="bash">
 
<source lang="bash">
 
#!/bin/bash
 
#!/bin/bash
Line 8: Line 30:
 
## BEGIN CONFIG ##
 
## BEGIN CONFIG ##
 
MYSQL_PASS=""
 
MYSQL_PASS=""
−
JBOSS_HOME="/home/openkm/jboss-4.2.3.GA"
 
 
DATABASE_EXP="/home/openkm/db"
 
DATABASE_EXP="/home/openkm/db"
−
BACKUP_DIR="/media/Backup"
 
−
FILES="$JBOSS_HOME $DATABASE_EXP"
 
 
## END CONFIG ##
 
## END CONFIG ##
  
−
if [ $(id -u) != 0 ]; then echo "Yu should run this script as root"; exit; fi
 
−
 
−
# Mount disk
 
−
mount $BACKUP_DIR
 
−
 
−
echo -e "### BEGIN: $(date +"%x %X") ###\n"
 
 
rm -rf $DATABASE_EXP
 
rm -rf $DATABASE_EXP
 
mkdir -p $DATABASE_EXP
 
mkdir -p $DATABASE_EXP
−
 
−
# Stop JBoss
 
−
/etc/init.d/jboss stop
 
−
 
−
while [ "$(ps -ef | grep java | grep jboss | wc -l)" -gt "0" ]; do
 
−
  sleep 5; echo ".";
 
−
done
 
−
 
−
# Clean logs
 
−
echo "Clean JBoss temporal files."
 
−
rm -rf $JBOSS_HOME/server/default/log
 
−
rm -rf $JBOSS_HOME/server/default/tmp
 
−
rm -rf $JBOSS_HOME/server/default/work
 
  
 
# Backup de MySQL
 
# Backup de MySQL
 
if [ -n "$MYSQL_PASS" ]; then
 
if [ -n "$MYSQL_PASS" ]; then
−
   MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) && ($2 != "mysql") && ($2 != "test") && ($2 != "information_schema") { print $2 }');
+
   MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $2 }');
−
 
+
−
  for DB in $MYSQL_DBS ; do
+
  for DB in $MYSQL_DBS; do
−
    echo "* Backuping MySQL data from $DB...";
+
    if [[ $DB != "mysql" && $DB != "test" && $DB != "information_schema" && $DB != "performance_schema" ]]; then
−
    mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
+
      echo "* Backuping MySQL data from $DB..."
 +
      mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
 +
    fi
 
   done
 
   done
−
  echo "-------------------------------------";
 
 
fi
 
fi
 +
</source>
  
−
# Rotate and copy files
+
This script will export all databases from a PostgreSQL installation:
−
cd $BACKUP_DIR; rm -rf mv backup.3 backup.4; mv backup.2 backup.3; mv backup.1 backup.2; mv backup.0 backup.1; cd
+
 
−
rsync -apzhR --stats --delete --exclude=*~ --exclude="$JBOSS_HOME/cache" --delete-excluded --link-dest="$BACKUP_DIR/backup.1" $FILES "$BACKUP_DIR/backup.0"
+
<source lang="bash">
 +
#!/bin/bash
 +
#
 +
## BEGIN CONFIG ##
 +
DATABASE_EXP="/home/openkm/db"
 +
## END CONFIG ##
  
−
# Start JBoss
+
rm -rf $DATABASE_EXP
−
/etc/init.d/jboss start
+
mkdir -p $DATABASE_EXP
−
echo -e "\n### END: $(date +"%x %X") ###"
 
  
−
# Status
+
# Backup de PostgreSQL
−
echo "=================================";
+
POSTGRESQL_DBS=$(su postgres -c "psql -l" | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $1 }');
−
du -hs $BACKUP_DIR
 
−
echo "*********************************";
 
−
du -hs --time $BACKUP_DIR/*
 
−
echo "=================================";
 
−
df -h | grep "$BACKUP_DIR"
 
−
echo "=================================";
 
  
−
# Umount disk
+
for DB in $POSTGRESQL_DBS ; do
−
sync
+
  if [[ $DB != "template0" && $DB != "template1" && $DB != "postgres" ]]; then
−
umount $BACKUP_DIR
+
    echo "* Backuping PostgreSQL data from $DB..."
 +
    su postgres -c "pg_dump -Fc -b $DB" > $DATABASE_EXP/pg_$DB.dmp
 +
  fi
 +
done
 
</source>
 
</source>
  
−
To install the cron job, run:
+
For more information take a look at [http://adminschoice.com/crontab-quick-reference Crontab quick reference]
  
−
$ sudo crontab -e
+
* [[Backup with LFTP]]
−
 
+
* [[Backup with rsync]]
−
And add these lines according to your personal coniguration:
+
* [[Backup with rdiff-backup]]
−
 
+
* [[Backup with duplicity]]
−
<source lang="bash">
 
−
MAILTO=openkm@nomail.com
 
−
@weekly /root/backup.sh
 
−
</source>
 
  
 
[[Category: Installation Guide]]
 
[[Category: Installation Guide]]
−
[[Category: OKM Network]]
 

Latest revision as of 15:01, 10 March 2014

These backup scripts use rsync to minimize network load and creates incremental backups, preserving last four backups. For more info, read http://www.mikerubel.org/computers/rsync_snapshots/. Also recommend the article DAR differential backup mini-howto.

To install the cron job, run: 

$ sudo crontab -e

And add these lines according to your personal configuration: 

MAILTO=nomail@openkm.com
@weekly /root/backup.sh | tee -a /root/backup.log

Or, if you want to separate log reports by date: 

MAILTO=nomail@openkm.com
@weekly /root/backup.sh | tee /root/backup.$(date +\%Y.\%m.\%d_\%H.\%M.\%S).log

Nota clasica.png MAILTO may also be used to direct mail to multiple recipients by separating recipient users with a comma.

This script will export all databases from a MySQL installation: 

#!/bin/bash
#
## BEGIN CONFIG ##
MYSQL_PASS=""
DATABASE_EXP="/home/openkm/db"
## END CONFIG ##

rm -rf $DATABASE_EXP
mkdir -p $DATABASE_EXP

# Backup de MySQL
if [ -n "$MYSQL_PASS" ]; then
  MYSQL_DBS=$(mysqlshow -h localhost -u root -p$MYSQL_PASS | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $2 }');
 
  for DB in $MYSQL_DBS; do
    if [[ $DB != "mysql" && $DB != "test" && $DB != "information_schema" && $DB != "performance_schema" ]]; then
      echo "* Backuping MySQL data from $DB..."
      mysqldump -h localhost -u root -p$MYSQL_PASS $DB > $DATABASE_EXP/mysql_$DB.sql
    fi
  done
fi

This script will export all databases from a PostgreSQL installation: 

#!/bin/bash
#
## BEGIN CONFIG ##
DATABASE_EXP="/home/openkm/db"
## END CONFIG ##

rm -rf $DATABASE_EXP
mkdir -p $DATABASE_EXP

# Backup de PostgreSQL
POSTGRESQL_DBS=$(su postgres -c "psql -l" | awk '(NR > 2) && (/[a-zA-Z0-9]+[ ]+[|]/) { print $1 }');

for DB in $POSTGRESQL_DBS ; do
  if [[ $DB != "template0" && $DB != "template1" && $DB != "postgres" ]]; then
    echo "* Backuping PostgreSQL data from $DB..."
    su postgres -c "pg_dump -Fc -b $DB" > $DATABASE_EXP/pg_$DB.dmp
  fi
done

For more information take a look at Crontab quick reference

Retrieved from "https://www.openkm.com/wiki/index.php?title=Backup_scripts&oldid=11336"