github.com/observiq/bindplane-agent@v1.51.0/docs/plugins/hadoop_logs.md (about)

     1  # Apache Hadoop Plugin
     2  
     3  Log parser for Apache Hadoop
     4  
     5  ## Configuration Parameters
     6  
     7  | Name | Description | Type | Default | Required | Values |
     8  |:-- |:-- |:-- |:-- |:-- |:-- |
     9  | enable_datanode_logs | Enable collection of Hadoop data node logs | bool | `true` | false |  |
    10  | datanode_log_path | The absolute path to the data node logs | []string | `[/usr/local/hadoop/logs/hadoop-*-datanode-*.log]` | false |  |
    11  | enable_resourcemgr_logs | Enable the collection of ResourceManager logs | bool | `true` | false |  |
    12  | resourcemgr_log_path | The absolute path to the DataNode logs | []string | `[/usr/local/hadoop/logs/hadoop-*-resourcemgr-*.log]` | false |  |
    13  | enable_namenode_logs | Enable collection of Hadoop NameNode logs | bool | `true` | false |  |
    14  | namenode_log_path | The absolute path to the NameNode logs | []string | `[/usr/local/hadoop/logs/hadoop-*-namenode-*.log]` | false |  |
    15  | start_at | At startup, where to start reading logs from the file (`beginning` or `end`) | string | `end` | false | `beginning`, `end` |
    16  
    17  ## Example Config:
    18  
    19  Below is an example of a basic config
    20  
    21  ```yaml
    22  receivers:
    23    plugin:
    24      path: ./plugins/hadoop_logs.yaml
    25      parameters:
    26        enable_datanode_logs: true
    27        datanode_log_path: [/usr/local/hadoop/logs/hadoop-*-datanode-*.log]
    28        enable_resourcemgr_logs: true
    29        resourcemgr_log_path: [/usr/local/hadoop/logs/hadoop-*-resourcemgr-*.log]
    30        enable_namenode_logs: true
    31        namenode_log_path: [/usr/local/hadoop/logs/hadoop-*-namenode-*.log]
    32        start_at: end
    33  ```