github.com/Jeffail/benthos/v3@v3.65.0/website/docs/components/inputs/hdfs.md (about) 1 --- 2 title: hdfs 3 type: input 4 status: stable 5 categories: ["Services"] 6 --- 7 8 <!-- 9 THIS FILE IS AUTOGENERATED! 10 11 To make changes please edit the contents of: 12 lib/input/hdfs.go 13 --> 14 15 import Tabs from '@theme/Tabs'; 16 import TabItem from '@theme/TabItem'; 17 18 19 Reads files from a HDFS directory, where each discrete file will be consumed as 20 a single message payload. 21 22 ```yaml 23 # Config fields, showing default values 24 input: 25 label: "" 26 hdfs: 27 hosts: 28 - localhost:9000 29 user: benthos_hdfs 30 directory: "" 31 ``` 32 33 ### Metadata 34 35 This input adds the following metadata fields to each message: 36 37 ``` text 38 - hdfs_name 39 - hdfs_path 40 ``` 41 42 You can access these metadata fields using 43 [function interpolation](/docs/configuration/interpolation#metadata). 44 45 ## Fields 46 47 ### `hosts` 48 49 A list of target host addresses to connect to. 50 51 52 Type: `array` 53 Default: `["localhost:9000"]` 54 55 ### `user` 56 57 A user ID to connect as. 58 59 60 Type: `string` 61 Default: `"benthos_hdfs"` 62 63 ### `directory` 64 65 The directory to consume from. 66 67 68 Type: `string` 69 Default: `""` 70 71