The Hadoop Cluster Administration course at SPectramind starts with the fundamental concepts of Apache Hadoop and Hadoop Cluster. It covers topics to deploy, manage, monitor, and secure a Hadoop Cluster. You will learn to configure backup options, diagnose and recover node failures in a Hadoop Cluster. The course will also cover HBase Administration. There will be many challenging, practical and focused hands-on exercises for the learners. Software professionals new to Hadoop can quickly learn the cluster administration through technical sessions and hands-on labs. By the end of this 2 days Hadoop Cluster Administration training, you will be prepared to understand and solve real world problems that you may come across while working on Hadoop Cluster.
Our course now covers Hadoop 2.0 Administration. The course content, quizzes, assignment, labs, and hands on practical's have been updated to cover new features in Hadoop 2.0, namely YARN, NameNode High Availability, HDFS Federation, Snapshot and so forth.
Course Objectives
After the completion of ‘Hadoop Administration' course at SPectramind, you should be able to:
• Get a clear understanding of Apache Hadoop, HDFS, Hadoop Cluster and Hadoop Administration.
• Hadoop 2.0, Name Node High Availability, HDFS Federation, YARN, MapReduce v2.
• Plan and Deploy a Hadoop Cluster.
• Load Data and Run Applications.
• Configuration and Performance Tuning.
• Manage, Maintain, Monitor and Troubleshoot a Hadoop Cluster.
• Secure a deployment and understand Backup and Recovery.
• Learn what Oozie, Hcatalog/Hive, and HBase Administration is all about.
Who should go for this course?
Students, DBAs, System Administrators, Software Architects, Data Warehouse Professionals, IT Managers, and Software Developers interested in learning Hadoop Cluster Administration should go for this course.
Pre-requisites
This course assumes no prior knowledge of Apache Hadoop and Hadoop Cluster Administration.Good knowledge of Linux is required as Hadoop runs on Linux. Fundamental Linux system administration skills such as Linux scripting (perl / bash), good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks are preferable.
Why Learn Hadoop?
BiG Data! A Worldwide Problem?
According to Wikipedia, “Big data is collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications.” In simpler terms, Big Data is a term given to large volumes of data that organizations store and process. However, It is becoming very difficult for companies to store, retrieve and process the ever-increasing data. If any company gets hold on managing its data well, nothing can stop it from becoming the next BIG success!
The problem lies in the use of traditional systems to store enormous data. Though these systems were a success a few years ago, with increasing amount and complexity of data, these are soon becoming obsolete. The good news is - Hadoop, which is not less than a panacea for all those companies working with BIG DATA in a variety of applications and has become an integral part for storing, handling, evaluating and retrieving hundreds of terabytes, and even petabytes of data.
Apache Hadoop! A Solution for Big Data!
Hadoop is an open source software framework that supports data-intensive distributed applications. Hadoop is licensed under the Apache v2 license. It is therefore generally known as Apache Hadoop. Hadoop has been developed, based on a paper originally written by Google on MapReduce system and applies concepts of functional programming. Hadoop is written in the Java programming language and is the highest-level Apache project being constructed and used by a global community of contributors. Hadoop was developed by Doug Cutting and Michael J. Cafarella. And just don’t overlook the charming yellow elephant you see, which is basically named after Doug’s son’s toy elephant!
Some of the top companies using Hadoop:
The importance of Hadoop is evident from the fact that there are many global MNCs that are using Hadoop and consider it as an integral part of their functioning, such as companies like Yahoo and Facebook! On February 19, 2008, Yahoo! Inc. established the world's largest Hadoop production application. The Yahoo! Search Webmap is a Hadoop application that runs on over 10,000 core Linux cluster and generates data that is now widely used in every Yahoo! Web search query.
Facebook, a $5.1 billion company has over 1 billion active users in 2012, according to Wikipedia. Storing and managing data of such magnitude could have been a problem, even for a company like Facebook. But thanks to Apache Hadoop! Facebook uses Hadoop to keep track of each and every profile it has on it, as well as all the data related to them like their images, posts, comments, videos, etc.
Opportunities for Hadoopers!
Opportunities for Hadoopers are infinite - from a Hadoop Developer, to a Hadoop Tester or a Hadoop Architect, or a Hadoop Cluster Administrator and so on. With the growing adoption of Apache Hadoop as the platform for big data analysis across various industries, the need for IT professionals with expertise in operating Hadoop clusters is increasing rapidly. If cracking and managing BIG Data is your passion in life, then think no more and Join SPectramind’s Hadoop Online course and carve a niche for yourself! Happy Hadooping!
Module 1
Overview of Hadoop Cluster Administration
Learning Objectives - In this module, you will understand what is Big Data and Apache Hadoop, How Hadoop solves the Big Data problems, Various data loading techniques, Basics of Map Reduce, Introduction to Hadoop 2.0, Role of a Hadoop Cluster Administrator.
Topics - Introduction to Big Data, Introduction to Apache Hadoop, MapReduce Framework, A typical Hadoop Cluster, Data Loading into HDFS, Hadoop Cluster Administrator: Roles and Responsibilities.
Module 2
Hadoop 2.0 and Hadoop Cluster Configuration
Learning Objectives - After this module, you will understand the Hadoop 2.0 NameNode High Availability, HDFS Federation, YARN, Hadoop Cluster Architecture, Hadoop Cluster setup and configuration, Hive and Pig Installation, Setting up Hadoop Clients, Managing a Cluster using Cloudera Manager.
Topics - Hadoop 2.0 New Features, Hadoop Cluster Architecture, Planning the Hadoop Cluster, Cluster Size, Hardware and Software considerations, Hadoop Installation and Initial Configuration, Deploying Hadoop in pseudo-distributed mode, deploying a complete, multi-node Hadoop cluster, Installing and Configuring Hive and Pig, Installing Hadoop Clients, Cloudera Manager.
Module 3
Node roles, Data Processing, and Network configuration
Learning Objectives - In this module, you will understand Multiple Hadoop Server roles such as NameNode, DataNode, Journal Node etc. in detail, Quorum Journal Manager (QJM), MapReduce and YARN Data Processing, Unbalanced and Balanced Cluster, Advance Cluster Configuration, and Cluster Network configuration.
Topics - Quorum Journal Manager (QJM), Hadoop server roles and their usage, Rack Awareness, Anatomy of Write and Read, Replication Pipeline, Data Processing: YARN, Map and Reduce, Unbalanced Cluster, Cluster Balancing, Advanced Cluster Configuration, and Cluster Network configuration.
Module 4
Managing, Monitoring and Maintaining a Hadoop cluster
Learning Objectives - In this module, you will understand Oozie Workflow Scheduler, Managing and Scheduling Jobs, Fair and Capacity Scheduler, Hadoop Cluster Monitoring and Troubleshooting, Analyzing logs, and Auditing.
Topics - Oozie, Managing and Scheduling Jobs, Configuring a Fair Scheduler, Configuring a Capacity Scheduler Cluster Monitoring and Troubleshooting, Cluster Maintenance, Service and Log Management, Auditing and Alerts, Service Monitoring.
Module 5
Security, Backup and Recovery
Learning Objectives - In this module, you will understand basics of Hadoop security, Managing security with Kerberos, HDFS Federation setup, how to configure Backup and Recovery in Hadoop, Diagnosting the Node Failures in the Cluster.
Topics - Basics of Hadoop Platform Security, Securing the Platform, Configuring Kerberos, Configuring HDFS Federation, Backup, Diagnostics and Recovery.
Module 6
Hcatalog/Hive and Hbase Administration
Learning Objectives - Hcatalog/Hive Administration, deploying HBase with other Hadoop components, Monitoring and Optimizing HBase deployments, Using HBase effectively to load data, writing to and reading from HBase, Securing data in HBase with access control.
Topics - Hcatalog/Hive Administration, HBase Architecture, HBase Cluster, Configuring, Monitoring and Troubleshooting Hbase Cluster, Hbase and Hive Integration, HBase performance optimization.
Registration Details
Course Fee:
Single Nomination:
Training Fees : INR 15,000 (Inclusive of +12.36% service tax).
| Avail Special Discounts | Avail Special Discounts | Avail Special Discounts | Avail Special Discounts |
|---|---|---|---|
| 5% Discount for Early Bird Registrations (15 Days in advance to the program date) | 5% Discount on Task force of 4 to 7 | 10% Discount on task Force of 8 and above | 10% discount applicable to BA/PMP/CSBA/IREB/CSTE / CSQA/CISSP/CFPS/CSPM/CAPM /CISA/ Qualified Professionals, IIBA/PMI /SEG /CII/SPIN /CSI and NASSCOM Members |
NOTE: Only one discount option is applicable at any time
Course Dates, Venue & Timings:
| Sl.No. | State | City | Batch1-Date | Batch1-Date | Batch2-Date | Batch2-Date | Batch3-Date | Batch3-Date | Batch4-Date | Batch4-Date | Venue | Contact |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 01 | AP | Hyderabad | 14-Oct’13 | 15-Oct’13 | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Flat 617,Annapurna block, Aditya enclave, Ameerpet, Hyderabad-500016 | Jason-91-40-64568797 |
| 02 | AP | Hyderabad | 14-Oct’13 | 15-Oct’13 | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Software Units layout , inside side of Raheja Mind Space , back of Inorbit mall , Hightech City , Hyderabad-500081 | Jason-91-40-64568797 |
| 03 | Karnataka | Bangalore | - | - | 2-Nov’13 | 3-Nov'13 | 7-Dec’13 | 8-Dec’13 | 4-JAN’14 | 5-JAN’14 | DBS center , Cunningham road , Bangalore | Sundar Raju |
| 04 | Tamilnadu | Chennai | - | - | 9-Nov’13 | 10-Nov’13 | 14-Dec’13 | 15-Dec’13 | 11-JAN’14 | 12-JAN’14 | CHENNAI, CitiCentre , Level 6, 10/11 Dr.Radhakrishna Salai,Chennai,Tamil Nadu,600 004,India | Mr.Balaji : 0 87545 11800 |
| 05 | Maharashtra | Mumbai | 19-oct'13 | 20-Oct'13 | 9-Nov’13 | 10-Nov’13 | 14-Dec’13 | 15-Dec’13 | 18-JAN’14 | 19-JAN’14 | DBS Heritage,Prescot Road,Opp. Cathedral Sr. School,Fort, Mumbai 400001. DBS Heritage (From Airport instruct the car / cab driver to drive to Fort, Fashion Street. It’s near Siddharth College, Budha Bhavan. Also there are schools like J. P. Pettit School & Cathedral Sr. School | Mr.Vasudev |
| 06 | Delhi | Delhi/Gurgaon/Noida | 26-Oct'13 | 27-Oct'13 | 23-Nov'13 | 24-Nov'13 | 28-Dec’13 | 29-Dec’13 | 25-JAN’14 | 26-JAN’14 | Paharpur Business Centre, 21, Nehru Place Greens, New Delhi - 110019 | Arun |
| 07 | Maharashtra | Pune | - | 9-Nov’13 | 10-Nov’13 | 9-Dec’13 | 10-Dec’13 | 9-JAN’14 | 10-JAN’14 | Panchasheel tech park,Yerwada, Pune | Mr.Manish | |
| 08 | Westbengal | Kolkata | 19-Oct’13 | 20-Oct’13 | 19-Nov’13 | 20-Nov’13 | 19-Dec’13 | 20-Dec’13 | 20-JAN’14 | 21-JAN’14 | Constantia, 6/F,Constantia, Dr. U. N. Brahmachari Marg, Kolkata | Mr.Hamid : 9088159989 |
| 09 | Gujarat | Ahmedabad | 23-OCT’13 | 24-OCT’13 | 23-NOV'13 | 24-NOV'13 | 23-DEC'13 | 24-DEC'13 | 24-JAN’13 | 25-JAN’13 | Aakruti Complex,Nr. Stadium Cross Road, Navrangpura,Ahmedabad-380009, Gujarat, INDIA | Mr.Alok |
| 10 | AP | Vishakhapatnam | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS center | Vijay -94400 89341 |
| 11 | Bihar | Patna | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS Center, Patna | Jason |
| 12 | Chhattisgarh | Raipur | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS center ,Raipur | Jason |
| 13 | Madhya Pradesh | Indore | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Indore | Arun :9755598333 |
| 14 | Haryana | Chandigarh | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Spectramind, 1708/1, Sector – 39-B, Chandigarh- 160 036 | Kavita |
| 15 | Kerala | Cochin | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | ThomasMount ,ICTA Building,Changampuzha Nagar P.O.,Cochin- 682 033 | Mr.Manoj: 9995881093 |
| 16 | Kerala | Trivandrum | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Hotel Classic Avenue, Thampanoor, Trivandrum, Kerala. | Mr.Manoj |
| 17 | Orissa | Bhubaneshwar | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | Vani Vihar, Bhubaneshwar | Mr. Satya Deep : 95811 98770 |
| 18 | Rajasthan | Jaipur | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS center,Jaipur | Mr.Manish |
| 19 | Tamilnadu | Coimbatore | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS Center | Mr.Balaji |
| 20 | Uttar Pradesh | Lucknow | - | - | 4-Nov’13 | 8-Nov’13 | 2-Dec’13 | 6-Dec’13 | 6-JAN’14 | 10-JAN’14 | DBS center,Lucknow | Mr.Sandeep |
Call/SMS :vijay :0-9440089341 ; EMail : moc.snoitulosdnimartceps|ofni#moc.snoitulosdnimartceps|ofni
Pls send us your query , will answer back within 24Hrs: Thanks in advance for contacting us