Flumeġ.9.0 is stable, production-ready software, and is backwards-compatible with Version 1.9.0 is the eleventh Flume release as an Apache top-level project. The Apache Flume team is pleased to announce the release of Flume 1.9.0. The ability to retrieve the Flume configuration from a remote source such as a SpringĬloud Config Server, and support for composite configurations.įlume has been updated to use Log4j 2.x instead of Log4j 1.x. This version of Flume upgrades many dependencies, resolving the CVEs associated with them.Įnhancements included in this release include the addition of a LoadBalancingChannelSelector, See the Flume Security page for more details. The Apache Flume team is pleased to announce the release of Flume 1.10.0.įlume 1.10.0 is stable, production-ready software, and is backwards-compatible withįlume 1.10.0 contains a fix for CVE-2022-25167.
#Flume flume how to
Your contributions, feedback, help and support make Flume better!įor more information on how to report problems or contribute,
#Flume flume download
This release can be downloaded from the Flume Download page.
#Flume flume full
The full change log and documentation are available on the Jars allowing them to be usable in applications using the Java Platform Module System. This version of Flume adds the automatic module name to the manifest of the various Flume Previous versions of the Flume 1.x codeline. Trim_nl: Trim new line from thrift body (default: true)Ĭopyright © 2012 - 2013 Treasure Data, Inc.The Apache Flume team is pleased to announce the release of Flume 1.10.1.įlume is a distributed, reliable, and available service for efficientlyĬollecting, aggregating, and moving large amounts of streaming event data.įlume 1.10.1 is stable, production-ready software, and is backwards-compatible with Remove_prefix: prefix string, removed from the tag (default: nil)įormat: The format of the thrift body (default: json) Timeout: thrift protocol timeout (default: 30)
Host: host name or address (default: localhost) The format can be adjusted via formatters. Thus the plugin translates semi-structured data into JSON data by default and conveys it to Flume. Note that fluentd conveys semi-structured data while Flume conveys unstructured data. This allows fluentd to output its logs into another Flume server. Please add the following configurations to nf. Use flume-ng-fluentd-sink to send events from flume-ng to fluentd. Tag_field: key name of fluentd 'tag' that is stored in ThriftFlumeEvent.fields (default: nil)ĭefault_tag: default fluentd 'tag' (default: 'category')Īdd_prefix: prefix string, added to the tag (default: nil) Is_framed: use framed protocol or not (default: false) Server_type: server architecture either in 'simple', 'threaded', 'thread_pool', (default: simple) How to use? ¶ ↑įluent-plugin-flume contains both input and output. A key of the value enables be specified by users as configuration parameter. Oneway void append( 1:ThriftFlumeEvent evt ),ĮventStatus ackedAppend( 1: ThriftFlumeEvent evt ),Ī value that is stored in the ThriftFlumeEvent.fields map is used as fluentd 'tag'. # Instead of using thrift's serialization, we just assume the contents are serialized already.
Flume protocol is defined as follows, in Thrift-IDL format: typedef i64 Timestamp The Flume plugin for fluentd, which enables fluentd to talk the Flume protocol. It uses Thrift, a cross-language RPC framework, to communicate between clients and servers. What's Flume? ¶ ↑įlume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. This plugin adds the Flume compatible interface to fluentd. This is a plugin for fluentd data collector. Flume input/output plugin for Fluentd ¶ ↑ Overview ¶ ↑