github.com/rclone/rclone@v1.66.1-0.20240517100346-7b89735ae726/fstest/testserver/images/test-hdfs/README.md (about)

     1  # Test HDFS
     2  
     3  This is a docker image for rclone's integration tests which runs an
     4  hdfs filesystem in a docker image.
     5  
     6  ## Build
     7  
     8  ```
     9  docker build --rm -t rclone/test-hdfs .
    10  docker push rclone/test-hdfs
    11  ```
    12  
    13  # Test
    14  
    15  configure remote:
    16  ```
    17  [TestHdfs]
    18  type = hdfs
    19  namenode = 127.0.0.1:8020
    20  username = root
    21  ```
    22  
    23  run tests
    24  ```
    25  cd backend/hdfs
    26  GO111MODULE=on go test -v
    27  ```
    28  
    29  hdfs logs will be available in `.stdout.log` and `.stderr.log`
    30  
    31  # Kerberos
    32  
    33  test can be run against kerberos-enabled hdfs
    34  
    35  1. configure local krb5.conf
    36      ```
    37      [libdefaults]
    38          default_realm = KERBEROS.RCLONE
    39      [realms]
    40          KERBEROS.RCLONE = {
    41              kdc = localhost
    42          }
    43      ```
    44  
    45  2. enable kerberos in remote configuration
    46      ```
    47      [TestHdfs]
    48      ...
    49      service_principal_name = hdfs/localhost
    50      data_transfer_protection = privacy
    51      ```
    52  
    53  3. run test
    54      ```
    55      cd backend/hdfs
    56      KERBEROS=true GO111MODULE=on go test -v
    57      ```