Differences

This shows you the differences between two versions of the page.

Link to this comparison view

i:placenta:data [2019/07/22 12:10]
Igor Chernyavsky [DLS registration & data access]
i:placenta:data [2019/09/24 19:18] (current)
Igor Chernyavsky [Mounting misc Remote file systems on Linux]
Line 16: Line 16:
 **[[https://icat.diamond.ac.uk/#/login | DLS Data Archive ]]** (accessing long-term storage for scans older than 40 days; see [[https://www.diamond.ac.uk/Users/Experiment-at-Diamond/IT-User-Guide/Not-at-DLS/Retrieve-data.html|data retrieval]] for more tips). **[[https://icat.diamond.ac.uk/#/login | DLS Data Archive ]]** (accessing long-term storage for scans older than 40 days; see [[https://www.diamond.ac.uk/Users/Experiment-at-Diamond/IT-User-Guide/Not-at-DLS/Retrieve-data.html|data retrieval]] for more tips).
  
 +[[https://savu.readthedocs.io/en/latest/user_guides/user_training/ | Savu ]] is a preferred Python-based tool for reconstructing raw DLS tomography data (i.e. radiographic projections).
 ==== Setting-up and Connecting ==== ==== Setting-up and Connecting ====
  
Line 29: Line 29:
 From now on, all you need to do is to double-click on the desktop NoMachine link and enter your //Federal User ID// and password. Note that you will need to select (or create a new) //Virtual Desktop//. From now on, all you need to do is to double-click on the desktop NoMachine link and enter your //Federal User ID// and password. Note that you will need to select (or create a new) //Virtual Desktop//.
  
 +Alternatively, you could connect via ''ssh'' (e.g. to run a download operation remotely: ''wget https...'')
 +  $ YourFedID@nx.diamond.ac.uk
 ==== Remote SuRVoS operation ==== ==== Remote SuRVoS operation ====
  
 Run the following commands in a Terminal: ''Applications --> System Tools --> Terminal''.  Run the following commands in a Terminal: ''Applications --> System Tools --> Terminal''. 
 <code> <code>
-$ module load global/cluster +$ module load hamilton 
-$ qlogin -q high.q@@com14 -l exclusive -l gpu_arch=Pascal -P i13+$ qlogin -P i13 -l gpu=1 -l gpu_arch=Pascal -l exclusive
 $ module load survos $ module load survos
 $ survos & $ survos &
Line 47: Line 49:
 List of Compute Nodes: ''qhost''\\ List of Compute Nodes: ''qhost''\\
 Other possible graphical options for high GPU / Memory Usage: Other possible graphical options for high GPU / Memory Usage:
-<code>qlogin -q high.q@@com14 -l exclusive -l gpu=1,nvidia_tesla -P i13</code>+<code> 
 +module load global/cluster 
 +qlogin -q high.q@@com14 -l exclusive -l gpu=1,nvidia_tesla -P i13 
 +</code> 
 + 
 +Similarly, to run Avizo 2019.1 (//on DLS campus only//) 
 +<code>module load avizo/2019.1; avizo</code>
  
 Further details are available in the [[http://www.diamond.ac.uk/Beamlines/Mx/I24/I24-Manual/Remote-Access/Connection-to-Diamond/data-processing.html|online beamline manual]]. Further details are available in the [[http://www.diamond.ac.uk/Beamlines/Mx/I24/I24-Manual/Remote-Access/Connection-to-Diamond/data-processing.html|online beamline manual]].
Line 100: Line 108:
 |  k        | cs11 |  32  | 3.0 GHz (AMD Opteron 6220)     |  256  | CPU-intensive | |  k        | cs11 |  32  | 3.0 GHz (AMD Opteron 6220)     |  256  | CPU-intensive |
 |  l        | cs12 |  12  | 2.5 GHz (Intel Xeon E5-2430v2) |  192  | | |  l        | cs12 |  12  | 2.5 GHz (Intel Xeon E5-2430v2) |  192  | |
-|    | citadel |  8 (x2)  | 3.4 GHz (Intel Xeon E5-1680v4) |  128  | GPU-intensive (Nvidia GTX1080 8GB 1.6GHz)  |+|    | citadel |  8 (x2)  | 3.4 GHz (Intel Xeon E5-1680v4) |  256  | GPU-intensive (Nvidia GTX1080 8GB 1.6GHz)  |
  
 Note that all CS cores run in a single-thread mode (HT is switched off). Note that all CS cores run in a single-thread mode (HT is switched off).
Line 139: Line 147:
  
 ===== Mounting misc Remote file systems on Linux ===== ===== Mounting misc Remote file systems on Linux =====
 +
 +Before you start, make sure there is an empty directory (e.g. ''~/PDrive/...'') in your ''home'' directory that you are going to mount.
  
   * Mount UoM **RDS-SSH Data Share**   * Mount UoM **RDS-SSH Data Share**
Line 162: Line 172:
 dbxfs ~/PDrive/Dropbox/ dbxfs ~/PDrive/Dropbox/
 fusermount -u ~/PDrive/Dropbox/ fusermount -u ~/PDrive/Dropbox/
 +</code>
 +
 +  * Mount **DLS I13 Data Storage** (only available for **60 days** after the beamtime) 
 +<code>
 +sshfs FedID_USERNAME@nx.diamond.ac.uk:/dls/i13/data/ ~/PDrive/DLS/
 +fusermount -u ~/PDrive/DLS/
 </code> </code>
  
 <div rightalign>--- //Igor Chernyavsky, 2019/05/24 21:12// ---</div> <div rightalign>--- //Igor Chernyavsky, 2019/05/24 21:12// ---</div>
  
i/placenta/data.1563793817.txt.gz · Last modified: 2019/07/22 12:10 by Igor Chernyavsky
Recent changes RSS feed
CC Attribution 3.0 Unported
Driven by DokuWiki Valid XHTML 1.0