Re:  sshfs to access volumes
 
Hi Robert,
Awesome tip, thanks for sharing! You could even do this in a StarCluster
plugin. This would completely automate the process and eliminate needing
to look up the master's dns name each time. Here's a draft
implementation to get you started (untested but should work):
https://gist.github.com/3223691
The gist includes the plugin (sshfs.py) as well as an example
StarCluster config for the plugin...
HTH,
~Justin
On Thu, Jun 07, 2012 at 08:42:54PM -0700, Robert Yu wrote:
>    Hello,
>    I thought I'd pass along this method to access a volume you have attached
>    to the master node (and shared with all slave nodes) from any machine.  To
>    me this was easier than having the master node do the setup and collecting
>    of results.  I prefer to keep the master as a pure submit host.
>    I am using ubuntu 10.04.
>    1.  Iinstall sshfs
>         % sudo apt-get install sshfs
>         % sudo modprobe fuse
>    2. Run sshfs:
>       % mkdir <mount_point>
>       % sshfs -o ssh_command="ssh -i /full/path/to/your/private/RSA/key"
>    <user>_at_<aws IP addresss>:/<volume> <mount_point>
>        Example:
>        % mkdir ./results
>        % sshfs -o ssh_command="ssh -i $PWD/id_rsa.key"
>    sgeadmin_at_ec2-01-23-45-678.us-west-1.compute.amazonaws.com:/results
>    ./results
>    To unmount, do:
>        % fusermont -u <mount_point>
>    --
>    Robert Yu, Member Technical Staff
>    [1]www.aditazz.com | [2]robert.yu_at_aditazz.com
>    1111 Bayhill Drive Suite 260 | San Bruno | CA 94066
>    510.459.0216 | cell
>    650.627.7357 | 650.492.7000 x1008 | work
>    650.684.1149 | fax
> 
> References
> 
>    Visible links
>    1. http://www.aditazz.com/
>    2. mailto:robert.yu_at_aditazz.com
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
- application/pgp-signature attachment: stored
 
Received on Wed Aug 01 2012 - 00:42:48 EDT
 
This archive was generated by
hypermail 2.3.0.