{"id":22410,"date":"2018-08-09T08:00:16","date_gmt":"2018-08-09T08:00:16","guid":{"rendered":"https:\/\/data-flair.training\/blogs\/?p=22410"},"modified":"2018-08-09T08:00:16","modified_gmt":"2018-08-09T08:00:16","slug":"avro-serialization","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/avro-serialization\/","title":{"rendered":"Avro Serialization | Serialization In Java & Hadoop"},"content":{"rendered":"

Today, we will learn Avro<\/strong> Serialization in detail. It includes Serialization Encodings in Avro, brief knowledge on Avro Serialization in Java<\/strong> and also we will\u00a0cover Avro Serialization in Hadoop in detail.<\/p>\n

Also, we will see the advantages and disadvantages of Hadoop<\/strong> over Java Avro Serialization.\u00a0However, there is much more to learn about Avro Serialization in detail. <\/span><\/p>\n

So, let\u2019s begin with the introduction to Avro Serialization.<\/span><\/p>\n

\"Avro<\/a>

Avro Serialization | Serialization In Java & Hadoop<\/p><\/div>\n

What is Avro Serialization?<\/span><\/h2>\n

In order to transport the data over the network or to store on some persistent storage, we use the process of translating data structures or objects state into binary or textual form, that process is what we call Serialization in Avro<\/strong>.<\/span><\/p>\n

However, we need to deserialize the Data again, once the data transport over the network or retrieved from the persistent storage. In other words, Avro Serialization is known as marshaling<\/em> and deserialization in Avro is known as unmarshalling<\/em>.<\/span><\/p>\n

Moreover, we can say, with its schema<\/strong> only Avro data serializes. Although, the Files\u00a0which store Avro data\u00a0must also involve the schema for that data in the same file. <\/span><\/p>\n

However, there is a Remote Procedure Call (RPC) systems which is based on Avro, that must guarantee when the remote recipients of data have a copy of the schema which is used to write that data.<\/span><\/p>\n

However, when the data is read, the schema which is used to write data is always available, that means Avro data is not tagged with type information, itself. \u00a0We need a schema to parse data.<\/span><\/p>\n

Generally, the\u00a0way in which both the Avro serialization as well as deserialization proceed is, depth-first, left-to-right traversal of the schema. Especially, by serializing primitive types\u00a0since they encounter.<\/span><\/p>\n

Encodings in Avro Serialization<\/span><\/h2>\n

There are two serialization encodings available in Avro.\u00a0One of them is binary encoding and the other one is JSON encoding<\/em>. Since Binary coding is smaller and faster, most applications use the binary encoding. <\/span><\/p>\n

Although, sometimes the JSON encoding is appropriate for debugging as well as web-based applications. So, let\u2019s learn both the encodings in detail:<\/span><\/p>\n

\"Avro<\/a>

Encodings in Avro Serialization<\/p><\/div>\n

a. Binary Encoding in Avro<\/span><\/h3>\n

Primitive Types<\/strong><\/p>\n

In binary, Primitive types are encoded as:<\/span><\/p>\n