Skip to content

Latest commit

 

History

History

flume

README.md

Agent Check: Flume

Overview

This check monitors Apache Flume.

Setup

The Flume check is not included in the Datadog Agent package, so you need to install it.

Installation

For Agent v7.21+ / v6.21+, follow the instructions below to install the Flume check on your host. See Use Community Integrations to install with the Docker Agent or earlier versions of the Agent.

  1. Run the following command to install the Agent integration:

    datadog-agent integration install -t datadog-flume==<INTEGRATION_VERSION>

  2. Configure your integration similar to core integrations.

Configuration

  1. Configure the Flume agent to enable JMX by adding the following JVM arguments to your flume-env.sh:
export JAVA_OPTS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=5445 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false"

  1. Edit the flume.d/conf.yaml file, in the conf.d/ folder at the root of your Agent's configuration directory to start collecting Flume performance data. See the sample flume.d/conf.yaml file for all available configuration options.

    This check has a limit of 350 metrics per instance. The number of returned metrics is indicated in the status output. You can specify the metrics you are interested in by editing the configuration below. For detailed instructions on customizing the metrics to collect, see the JMX Checks documentation. If you need to monitor more metrics, contact Datadog support.

  2. Restart the Agent

Validation

Run the Agent's status subcommand and look for flume under the Checks section.

Component metrics

The metrics retrieved by this check depend on the source, channel, and sink used by your Flume agent. For a full list of metrics exposed by each component, review Available Component Metrics from the Apache Flume documentation. For a list of the metrics that you can see in Datadog, see the Metrics section on this page.

Data Collected

Metrics

See metadata.csv for a list of metrics provided by this check.

Events

Flume does not include any events.

Service Checks

See service_checks.json for a list of service checks provided by this integration.

Troubleshooting

Need help? Contact Datadog support.