github.com/Jeffail/benthos/v3@v3.65.0/website/docs/components/inputs/hdfs.md (about)

     1  ---
     2  title: hdfs
     3  type: input
     4  status: stable
     5  categories: ["Services"]
     6  ---
     7  
     8  <!--
     9       THIS FILE IS AUTOGENERATED!
    10  
    11       To make changes please edit the contents of:
    12       lib/input/hdfs.go
    13  -->
    14  
    15  import Tabs from '@theme/Tabs';
    16  import TabItem from '@theme/TabItem';
    17  
    18  
    19  Reads files from a HDFS directory, where each discrete file will be consumed as
    20  a single message payload.
    21  
    22  ```yaml
    23  # Config fields, showing default values
    24  input:
    25    label: ""
    26    hdfs:
    27      hosts:
    28        - localhost:9000
    29      user: benthos_hdfs
    30      directory: ""
    31  ```
    32  
    33  ### Metadata
    34  
    35  This input adds the following metadata fields to each message:
    36  
    37  ``` text
    38  - hdfs_name
    39  - hdfs_path
    40  ```
    41  
    42  You can access these metadata fields using
    43  [function interpolation](/docs/configuration/interpolation#metadata).
    44  
    45  ## Fields
    46  
    47  ### `hosts`
    48  
    49  A list of target host addresses to connect to.
    50  
    51  
    52  Type: `array`  
    53  Default: `["localhost:9000"]`  
    54  
    55  ### `user`
    56  
    57  A user ID to connect as.
    58  
    59  
    60  Type: `string`  
    61  Default: `"benthos_hdfs"`  
    62  
    63  ### `directory`
    64  
    65  The directory to consume from.
    66  
    67  
    68  Type: `string`  
    69  Default: `""`  
    70  
    71