github.com/wtsi-ssg/wrstat@v1.1.4-0.20221008232152-3030622a8cf8/README.md (about)

     1  # wrstat
     2  Efficiently walk a tree then get stats of all files in parallel across many
     3  nodes using wr.
     4  
     5  This is a replacement for https://github.com/wtsi-hgi/mpistat that doesn't use
     6  any run-time inter-process communication, for greater reliability and speed.
     7  
     8  It relies on https://github.com/VertebrateResequencing/wr to do the scheduling
     9  of its work.
    10  
    11  ## Build
    12  ```
    13  git clone https://github.com/wtsi-ssg/wrstat/
    14  cd wrstat
    15  make
    16  ```
    17  
    18  ## Useage
    19  As a user that has permission to see all files on the disks of interest:
    20  
    21  ```
    22  wr manager start -s lsf
    23  wrstat multi -w /working/dir -f /final/dir /disk1 /disk2
    24  wr status -i wrstat -z -o s
    25  ```
    26  
    27  Or if your user account has the ability to sudo without a password when
    28  executing the wrstat executable, add the --sudo option to `wrstat multi`.
    29  If you're running `wr` and `wrstat` without custom configurations, `wr` must
    30  be run as the root user, because `wrstat` will generate `sudo` commands that
    31  attempt to connect to a port number based on the user, which will be the root
    32  user, not the running user.
    33  
    34  To do certain chmod and chown operations on desired paths to bring them in to
    35  line with desired unix groups, create a YAML file like the example ch.yml in the
    36  git repository, and supply it as the --ch option to `wrstat multi`.
    37  For more details on ch, see `wrstat stat -h`.
    38  
    39  Generally, use the `-h` option on wrstat and its sub commands for detailed
    40  help.