Explain about the core components of Flume

[DataFlair Team]

What are the core components of Flume?

[DataFlair Team]

core components of Flume

a. Flume Events
It is a basic unit of the data that is transported inside Flume. It attains a payload of the byte array. Generally, accompanied by optional headers, it can be transported from the source to the destination.

b. Flume Agent

It is an independent daemon process (JVM). The agent receives events from clients or other agents and then forwards it to its next destination, sink or agent.we can have multiple flume agents. 3 main components of Agent.
i. Flume Source
ii. Flume Channel
iii. Flume Sink

c. Flume Client
Clients generate events and then sent it to one or more agents.

learn more about Flume Architecture in detail, follow the link: Apache Flume Architecture – Flume Agent, Event, Client

[Author]

Posts