Apache Big Data Workshop

Cost for Conducting Workshop:   Contact to Our Admin for Details : support@lwindia.com

Workshop Content for Big Data

Basic Discussion on Subject :

• Whats Big Data and its Present and Future
• Why Apache Hadoop and Discussion on Its vendor company Cloudera

Internal Concept and Practical Implementation :

• Setup Hadoop v1 and v2 Cluster
• Implementation of Distributed Storage : HDFS
• How data processes in Distributed Computing World into our OWN deploy cluster using MapReduce version 1 and 2 (using YARN implementation)
• How to Get Real data sets and develop our own datasets for benchmarking our cluster
• Understanding MapReduce Programming
• Develop Basic MapReduce Program for processing Real World data sets from our OWN develop Cluster
• Perform Data Analytics using High-Level Framework using PIG or HIVE

Overview Only :

• Overview of Hbase,Oozie, Zookeeper, Sqoop, HDFS Federation, NameNode HA

• Basic knowledge of any Operating System preferable Linux, like basic commands, basic networking knowledge like IP address, etc

Note: If Required, We will take half-hour session about Basic Linux and Basic Networking before starting the Hadoop workshop to take each participant at the same level.

• Internal Concepts from the Scratch with Real Time Practical Implementation of each and every technology mentioned in workshop Content

Why Learn Big Data and Hadoop?

• What is the Big Data problem?

Big Data is a set of unstructured and structured data that is complex in nature and is growing exponentially with each passing day. Organizations are facing a major challenge in storing and utilizing this enormous data. This problem spans across the world because of a serious dearth of skilled programmers.

"The United States alone faces a shortage of 140,000 to 190,000 people with analytical expertise and 1.5 million managers and analysts with the skills to understand and make decisions based on the analysis of big data."

• BiG Data! A Worldwide Problem?

According to Wikipedia, “Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.” In simpler terms, Big Data is a term given to large volumes of data that organizations store and process. However, It is becoming very difficult for companies to store, retrieve and process the ever-increasing data. If any company gets hold on managing its data well, nothing can stop it from becoming the next BIG success!

The problem lies in the use of traditional systems to store enormous data. Though these systems were a success a few years ago, with increasing amount and complexity of data, these are soon becoming obsolete. The good news is - Hadoop, which is not less than a panacea for all those companies working with BIG DATA in a variety of applications has become an integral part for storing, handling, evaluating and retrieving hundreds or even petabytes of data.

• Apache Hadoop! A Solution for Big Data!

Hadoop is an open source software framework that supports data-intensive distributed applications. Hadoop is licensed under the Apache v2 license. It is therefore generally known as Apache Hadoop. Hadoop has been developed, based on a paper originally written by Google on MapReduce system and applies concepts of functional programming. Hadoop is written in the Java programming language and is the highest-level Apache project being constructed and used by a global community of contributors. Hadoop was developed by Doug Cutting and Michael J. Cafarella. And just don’t overlook the charming yellow elephant you see, which is basically named after Doug’s son’s toy elephant!

• Some of the top companies using Hadoop:

The importance of Hadoop is evident from the fact that there are many global MNCs that are using Hadoop and consider it as an integral part of their functioning, such as companies like Yahoo and Facebook! On February 19, 2008, Yahoo! Inc. established the world's largest Hadoop production application. The Yahoo! Search Webmap is a Hadoop application that runs on over 10,000 core Linux cluster and generates data that is now widely used in every Yahoo! Web search query.

Facebook, a $5.1 billion company has over 1 billion active users in 2012, according to Wikipedia. Storing and managing data of such magnitude could have been a problem, even for a company like Facebook. But thanks to Apache Hadoop! Facebook uses Hadoop to keep track of each and every profile it has on it, as well as all the data related to them like their images, posts, comments, videos, etc.

• Opportunities for Hadoop Administrator!

Opportunities for You are infinite - from a Hadoop Developer, to a Hadoop Tester or a Hadoop Architect, and so on. If cracking and managing BIG Data is your passion in life, then think no more and Join course and carve a niche for yourself!

• Participation Certificate from LinuxWorld Informatics Pvt. Ltd
• Resources / Software / Tools
• Printed Study Material for reference
• Life time Support