{"id":392,"date":"2016-06-13T11:16:38","date_gmt":"2016-06-13T11:16:38","guid":{"rendered":"http:\/\/data-flair.training\/blogs\/?p=392"},"modified":"2021-05-28T14:34:19","modified_gmt":"2021-05-28T09:04:19","slug":"big-data-history-use-cases","status":"publish","type":"post","link":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/","title":{"rendered":"Big Data History, Technologies and Use Cases"},"content":{"rendered":"<p>This tutorial provides you with a detailed introduction to big data and big data history. We will also discuss the big data technologies like &#8211; Hadoop, Apache Spark, and Flink. Various real-life use cases of big data are also discussed in this tutorial.<\/p>\n<h3>Big Data &#8211; Introduction<\/h3>\n<p>Day by day the big world of internet is creating 2.5 quintillion bytes of data on regular basis according to the statistics the percentage of data that has been generated from the last two years is 90%.<\/p>\n<p>This data comes from many industries like climate information collects by the sensor, different stuff from social media sites, digital images and videos, different records of the purchase transaction. This data is big data.<\/p>\n<h3>Big Data History<\/h3>\n<p>This section of tutorial gives you a clear picture of big data history-<\/p>\n<ul>\n<li>Research &amp; Development in these Big Data native businesses are very close, and very close to the research and open source community.<\/li>\n<li>Each paper on the cost-efficient innovative information processing techniques has been accompanied by open source adoption within an ever growing ecosystem called Hadoop.<\/li>\n<\/ul>\n<p>Two major milestones in the development of Hadoop also added confidence into the Power of open source and Big Data Technologies.<\/p>\n<p>Only two years after its first release, in 2008, Hadoop won the terabyte sort benchmark in big data history. This is the first time that either a Java or an open source program has won. In 2010 Facebook claimed that they had the largest Hadoop cluster in the world with 21 PB of storage for their social messaging platform.<\/p>\n<h3>Facts and Figures<\/h3>\n<ul>\n<li>91% of leaders belongs to marketing believe successful brands use customer data to drive business decisions.<\/li>\n<li>The overall percentage of the world\u2019s total data has been created just within the past two years is 90%.<\/li>\n<li>87% companies agree capturing and sharing the right data is important to effectively measure ROI in their own company.<\/li>\n<li>500 million calls record daily analyzed by IBM to predict the customer\u2019s churns.<\/li>\n<li>350 billion annual meter readings converted by IBM through Big Data to better predict power consumption.<\/li>\n<li>On Facebook, 30 billion pieces of content are sharing by users in each month.<\/li>\n<\/ul>\n<h3>Big Data Technologies<\/h3>\n<p>While the topic of Big Data is broad and encompasses many trends and new technology developments, the top emerging technologies are given below that are helping users cope with and handle Big Data in a cost-effective manner.<\/p>\n<h4>1. Apache Hadoop<\/h4>\n<p>The backbone of every Big Data solution, It is anticipated that world&#8217;s 75% of the data will be stored in Hadoop by 2017.<\/p>\n<h4>2. Apache Spark<\/h4>\n<p>Apache Spark is considered as next generation Big Data tool, It is lightening fast cluster computing engine which is 100 times faster than Hadoop-MapReduce. Learn more about Apache Spark<\/p>\n<h4>3. Apache Flink<\/h4>\n<p>Apache Flink is called 4G of Big Data. It is an open source framework that can handle streaming as well as batch data. Learn more about Apache Flink<\/p>\n<h3>Figures Of Big Brands<\/h3>\n<h4>1. Facebook<\/h4>\n<p>Because of more than 950 million users, Facebook is collecting a huge amount of data. Every time whenever you are clicking a notification, visiting a page, uploading a photo, or checking out a friend\u2019s link, you\u2019re generating data for the company to track various records.<\/p>\n<p>Users shared 2.5 billion content items daily (status updates + wall posts + photos + videos + comments). 300 million photos are uploaded by users per day. 105 terabytes of data scanned via Hive, Facebook\u2019s Hadoop query language in every 30 minutes. 70,000 queries executed on these databases per day. 500+terabytes of new data ingested into the databases every day.<\/p>\n<h4>2. Twitter<\/h4>\n<p>Twitter \u2013 the second biggest social network generating less social data as compared to dating app, Tinder. Tinder users swipe 290,278 matches per minute \u2013 that is potentially 35 million lovers per hour! on the other hand, twitter users generate 347,222 Tweets each minute \u2013 or 21 million Tweets per hour.<\/p>\n<h4>3. Youtube<\/h4>\n<p>The video is a big part of our everyday lives on the internet, and although Facebook is also trying really hard to fit in and it is succeeding, with over 3 billion video views per day but YouTube is still the king. Every minute users are uploading over 300 hours of new video on YouTube.<\/p>\n<h3>Big Data Use-cases<\/h3>\n<p><strong>Financial services<\/strong><\/p>\n<ul>\n<li>360-degree complete view of customer<\/li>\n<li>Risk and fraud monitoring and management<\/li>\n<li>Real-time transaction tracking and analytics<\/li>\n<\/ul>\n<p><strong>Healthcare\/Life sciences<\/strong><\/p>\n<ul>\n<li>Disease diagnosis analysis<\/li>\n<li>Medical record text analysis<\/li>\n<li>Genomic analytics<\/li>\n<\/ul>\n<p><strong>Telecommunications<\/strong><\/p>\n<ul>\n<li>Real-time Call detail record CDR processing and analysis<\/li>\n<li>Customer profile monetization and analysis<\/li>\n<li>Real-time network element\u00a0monitoring<\/li>\n<li>Real-time Network fault analysis<\/li>\n<li>IVR calls analytics<\/li>\n<\/ul>\n<p><strong>Digital media<\/strong><\/p>\n<ul>\n<li>Real-time ad matching, analysis, and targeting<\/li>\n<li>Website analytics and conversion tracking<\/li>\n<\/ul>\n<p><strong>Retail<\/strong><\/p>\n<ul>\n<li>Cross-channel marketing<\/li>\n<li>Customer Clustering and\u00a0Segmentation<\/li>\n<li>Click-stream analysis<\/li>\n<li>Market Basket Analytics<\/li>\n<li>Real-time Recommendation<\/li>\n<li>Sentiment Analysis<\/li>\n<\/ul>\n<p><strong>Law enforcement<\/strong><\/p>\n<ul>\n<li>Multimodal surveillance<\/li>\n<li>Real-time Cybersecurity detection<\/li>\n<li>Energy and utilities<\/li>\n<li>Smart meter analytics<\/li>\n<li>Asset management<\/li>\n<\/ul>\n<p>To get deep dive into Big data real-life use cases follow this comprehensive guide.<\/p>\n<p>So this was all in Big Data History. Hope you like our explanation.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This tutorial provides you with a detailed introduction to big data and big data history. We will also discuss the big data technologies like &#8211; Hadoop, Apache Spark, and Flink. Various real-life use cases&#46;&#46;&#46;<\/p>\n","protected":false},"author":6,"featured_media":41901,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[1907,16894,1973,4229,5656],"class_list":["post-392","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","tag-big-data","tag-big-data-technologies","tag-big-data-use-cases","tag-evolution-of-big-data","tag-history-of-big-data"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Big Data History, Technologies and Use Cases - DataFlair<\/title>\n<meta name=\"description\" content=\"Big data introduction- what is big data, big data history, big data technologies &amp; techniques- Hadoop, Spark, Flink.Big data Applications,big data use cases\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Big Data History, Technologies and Use Cases - DataFlair\" \/>\n<meta property=\"og:description\" content=\"Big data introduction- what is big data, big data history, big data technologies &amp; techniques- Hadoop, Spark, Flink.Big data Applications,big data use cases\" \/>\n<meta property=\"og:url\" content=\"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/\" \/>\n<meta property=\"og:site_name\" content=\"DataFlair\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/DataFlairWS\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-13T11:16:38+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-05-28T09:04:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"DataFlair Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:site\" content=\"@DataFlairWS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"DataFlair Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Big Data History, Technologies and Use Cases - DataFlair","description":"Big data introduction- what is big data, big data history, big data technologies & techniques- Hadoop, Spark, Flink.Big data Applications,big data use cases","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/","og_locale":"en_US","og_type":"article","og_title":"Big Data History, Technologies and Use Cases - DataFlair","og_description":"Big data introduction- what is big data, big data history, big data technologies & techniques- Hadoop, Spark, Flink.Big data Applications,big data use cases","og_url":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/","og_site_name":"DataFlair","article_publisher":"https:\/\/www.facebook.com\/DataFlairWS\/","article_published_time":"2016-06-13T11:16:38+00:00","article_modified_time":"2021-05-28T09:04:19+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg","type":"image\/jpeg"}],"author":"DataFlair Team","twitter_card":"summary_large_image","twitter_creator":"@DataFlairWS","twitter_site":"@DataFlairWS","twitter_misc":{"Written by":"DataFlair Team","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#article","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/"},"author":{"name":"DataFlair Team","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89"},"headline":"Big Data History, Technologies and Use Cases","datePublished":"2016-06-13T11:16:38+00:00","dateModified":"2021-05-28T09:04:19+00:00","mainEntityOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/"},"wordCount":812,"commentCount":5,"publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg","keywords":["big data","Big Data Technologies","big data use-cases","evolution of big data","history of big data"],"articleSection":["Big Data Tutorials"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/","url":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/","name":"Big Data History, Technologies and Use Cases - DataFlair","isPartOf":{"@id":"https:\/\/data-flair.training\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#primaryimage"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#primaryimage"},"thumbnailUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg","datePublished":"2016-06-13T11:16:38+00:00","dateModified":"2021-05-28T09:04:19+00:00","description":"Big data introduction- what is big data, big data history, big data technologies & techniques- Hadoop, Spark, Flink.Big data Applications,big data use cases","breadcrumb":{"@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#primaryimage","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/06\/Big-Data-01.jpg","width":1200,"height":628,"caption":"Big Data - History, Use Cases and Technology"},{"@type":"BreadcrumbList","@id":"https:\/\/data-flair.training\/blogs\/big-data-history-use-cases\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog Home","item":"https:\/\/data-flair.training\/blogs\/"},{"@type":"ListItem","position":2,"name":"Big Data Tutorials","item":"https:\/\/data-flair.training\/blogs\/category\/big-data\/"},{"@type":"ListItem","position":3,"name":"Big Data History, Technologies and Use Cases"}]},{"@type":"WebSite","@id":"https:\/\/data-flair.training\/blogs\/#website","url":"https:\/\/data-flair.training\/blogs\/","name":"DataFlair","description":"Learn Today. Lead Tomorrow.","publisher":{"@id":"https:\/\/data-flair.training\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/data-flair.training\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/data-flair.training\/blogs\/#organization","name":"DataFlair","url":"https:\/\/data-flair.training\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","contentUrl":"https:\/\/data-flair.training\/blogs\/wp-content\/uploads\/sites\/2\/2016\/07\/Data-Flair.png","width":106,"height":48,"caption":"DataFlair"},"image":{"@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/DataFlairWS\/","https:\/\/x.com\/DataFlairWS","https:\/\/www.linkedin.com\/company\/dataflair-web-services-pvt-ltd\/","https:\/\/www.youtube.com\/user\/DataFlairWS"]},{"@type":"Person","@id":"https:\/\/data-flair.training\/blogs\/#\/schema\/person\/2c58ecb4f73a39f0ef993f1ddfcd7b89","name":"DataFlair Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ce4a0e3e542444fc73bbebf83e89e8b73e2d95ccb1fcee64da9945f078b97c5?s=96&d=mm&r=g","caption":"DataFlair Team"},"description":"The DataFlair Team provides industry-driven content on programming, Java, Python, C++, DSA, AI, ML, data Science, Android, Flutter, MERN, Web Development, and technology. Our expert educators focus on delivering value-packed, easy-to-follow resources for tech enthusiasts and professionals.","url":"https:\/\/data-flair.training\/blogs\/author\/dfteam2\/"}]}},"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/392","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/comments?post=392"}],"version-history":[{"count":9,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/392\/revisions"}],"predecessor-version":[{"id":96236,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/posts\/392\/revisions\/96236"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media\/41901"}],"wp:attachment":[{"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/media?parent=392"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/categories?post=392"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/data-flair.training\/blogs\/wp-json\/wp\/v2\/tags?post=392"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}