Difference between revisions of "Synchronisation of data between NASs"

From LinnDocs
Jump to: navigation, search
(Configure timed auto-execute of rsync)
Line 37: Line 37:
  
  
== Configure timed auto-execute of rsync ==
+
=== Configure timed auto-execute of rsync ===
  
 
The rsync command line which is required (to sync between 2 USB drives both called USBDrive1) is
 
The rsync command line which is required (to sync between 2 USB drives both called USBDrive1) is
 
  rsync --quiet --update --recursive --whole-file --delete-during <user>@<address>:/Volumes/USBDrive1/Music /Voumes/USBDrive1
 
  rsync --quiet --update --recursive --whole-file --delete-during <user>@<address>:/Volumes/USBDrive1/Music /Voumes/USBDrive1
  
This can be made to auto-execute at regular time intervals using the ''launchctl'' executor on Mac (or by using ''cron'' on unix)
+
This can be made to auto-execute at regular time intervals using '''launchctl''' on Mac  
 
 
Create the ''plist'' file ~/Library/LaunchAgents/com.user.sync.plist
 
  
 +
* Create the ''plist'' file '''~/Library/LaunchAgents/com.user.sync.plist'''
 +
* Ensure this is created under the '''same user''' that the SSH keys setup above
 +
* Update '''name''' and '''address''' in the file below
 +
* This gives a repetition interval of 1 hour (3600 secs) as defined at end
 
  <?xml version="1.0" encoding="UTF-8"?>
 
  <?xml version="1.0" encoding="UTF-8"?>
 
  <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">  
 
  <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">  
Line 69: Line 71:
 
  </plist>
 
  </plist>
  
 +
Add this file to the launchctl executor
 +
launchctl load ~/Library/LaunchAgents/com.user.sync.plist
  
 +
To test this
 +
launchctl start com.user.sync
  
 
+
Any time changes are made to the plist file, launchctl must be reloaded
launchctl load ~/Library/LaunchAgents/com.user.sync.plist
+
launchctl unload ~/Library/LaunchAgents/com.user.sync.plist
launchctl start com.user.sync
+
<update plist>
 
+
launchctl load ~/Library/LaunchAgents/com.user.sync.plist
update
 
launchctl unload ~/Library/LaunchAgents/com.user.sync.plist
 
update plist
 
launchctl load ~/Library/LaunchAgents/com.user.sync.plist
 
launchctl start com.user.sync (to check)
 

Revision as of 11:00, 22 April 2013

This describes the means of synchronising data between several Mac mini NASs.

We have a single master NAS on the main plant network, and 3 NASs in the South Wing area, one for each of the isolated networks.

  • Linn Home
  • Dem Rooms
  • Welcome Area

Due to the network topology, the isolated networks can access the main plant network, but access the other way round is not available (without some non-default reconfiguration of network components). Hence a pull synchronisation method was required, so that changes from the master NAS are pulled in by the slave NASs in a regular manner.

This has been achieved using the standard OS/X tools rsync, launchctl and ssh. As this uses an SSH connection the synchronisation method described below should be extensible to any setup where the NASs can be connected using SSH, including remotely across the internet (although bandwidth requirements are likely to be a major factor in this case).


Configure Remote Access on Server

On the server (master), remote (ssh) access must be enabled

  • System Preferences -> Internet & Wireless -> Sharing
  • Check the Remote Login service


Configure SSH access from Clients

For every client (slave), it is necessary to configure SSH access to the server. The method described here includes steps to remove the requirement for a password to be entered (so that the synchronisation can be executed automatically). As described this leaves a security hole in that anyone with access to the client machine can access the server machine without any further restrictions.

On client

  • Open terminal window and execute ssh-keygen -t dsa
    • Accept defaults for all prompts (file location and blank passkey)
  • Open the file ~/.ssh/id_dsa.pub and copy the entire (one line) contents
  • Open another terminal window and connect to the server
    • ssh <user>@<address>
    • Answer yes if prompted to accept new connection
    • Enter password for server to connect
  • In the server window create (or open) the file ~/.ssh/authorized_keys
  • Append the contents of the clients id_dsa.pub to this file and save it
  • Exit the server, and try reconnecting
    • ssh <user>@<address>
    • This time should connect without requiirement to enter password


Configure timed auto-execute of rsync

The rsync command line which is required (to sync between 2 USB drives both called USBDrive1) is

rsync --quiet --update --recursive --whole-file --delete-during <user>@<address>:/Volumes/USBDrive1/Music /Voumes/USBDrive1

This can be made to auto-execute at regular time intervals using launchctl on Mac

  • Create the plist file ~/Library/LaunchAgents/com.user.sync.plist
  • Ensure this is created under the same user that the SSH keys setup above
  • Update name and address in the file below
  • This gives a repetition interval of 1 hour (3600 secs) as defined at end
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd"> 
<plist version="1.0">
<dict>
    <key>Label</key>
    <string>com.user.sync</string>
    <key>Program</key>
    <string>/usr/bin/rsync</string>
    <key>ProgramArguments</key>
    <array>
        <string>--update</string>
        <string>--recursive</string>
        <string>--whole-file</string>
        <string>--delete-during</string>
        <string>--verbose</string>
        <string>name@address:/Volumes/USBDrive1/Music</string>
        <string>/Volumes/USBDrive1</string>
    </array>
    <key>StartInterval</key>
    <integer>3600</integer>
</dict>
</plist>

Add this file to the launchctl executor

launchctl load ~/Library/LaunchAgents/com.user.sync.plist

To test this

launchctl start com.user.sync

Any time changes are made to the plist file, launchctl must be reloaded

launchctl unload ~/Library/LaunchAgents/com.user.sync.plist
<update plist>
launchctl load ~/Library/LaunchAgents/com.user.sync.plist