How to install MapR M3 on Ubuntu through Ubuntu Partner Archive.

-
In a recent post of mine I had mentioned about the partnership between MapR and Canonical towards an initiative to make Hadoop available with Ubuntu natively through Ubuntu Partner Archive. Since, the package has been released now, I thought of showing how to get it done. Trust me it's really cool to install Hadoop by just one apt-get install :)

First things first. Open your sources.list file and add the MapR repositories into it.

deb http://package.mapr.com/releases/v2.1.2/ubuntu/ mapr optional
deb http://package.mapr.com/releases/ecosystem/ubuntu binary/

Now, update your repository.
sudo apt-get update

 Note : If it throws any error regarding MapR repositories, just uncomment the lines which allow us to add software from Canonical's partner repository.

## Uncomment the following two lines to add software from #Canonical's
## 'partner' repository.
## This software is not part of Ubuntu, but is offered by #Canonical and the
## respective vendors as a service to Ubuntu users.
deb http://archive.canonical.com/ubuntu precise partner 
deb-src http://archive.canonical.com/ubuntu precise partner
Install hadoop.
sudo apt-get install mapr-single-node

 1, 2, 3..and you are done. Isn't that cool?Just three easy steps and you have your brand new single node hadoop cluster in your lap. But, there are some pre-requisites and it's very important to satisfy them.

CPU : 64-bit

OS : Red Hat, CentOS, SUSE, or Ubuntu

Memory : 4 GB minimum, more in production

Disk : Raw, unformatted drives and partitions

DNS : Hostname, reaches all other nodes

Users : Common users across all nodes; Keyless ssh

Java : Must run Java

Other : NTP, Syslog, PAM


The above procedure will install following services on your machine :

CLDB : mapr-cldb

JobTracker : mapr-jobtracker

MapR Control Server : mapr-webserver

MapR Data Platform : mapr-fileserver

Metrics : mapr-metrics

NFS : mapr-nfs

TaskTracker : mapr-tasktracker

ZooKeeper : mapr-zookeeper

In order to install other hadoop projects and for further documentation you can visit the official documentation here.

I hope you found this post helpful, and as always comments and suggestions are welcome.


Comments

  1. PadminiprwatechFebruary 28, 2020 at 10:27 AM

    You are doing a great job by sharing useful information about Apache spark course. It is one of the post to read and improve my knowledge in Apache spark.You can check our Mapr Installation Steps,for more information about Mapr Installation guide.

    ReplyDelete

Post a Comment

Popular posts from this blog

Fun with HBase shell

-
Image
HBase shell is great, specially while getting yourself familiar with HBase. It provides lots of useful shell commands using which you can perform trivial tasks like creating tables, putting some test data into it, scanning the whole table, fetching data from a specific row etc etc. Executing  help  on HBase shell will give you the list of all the HBase shell commands. If you need help on a specific command, type help "command" . For example, help "get" will give you a detailed explanation of the get command. But this post is not about the above said stuff. We will try to do something fun here. Something which is available, but less known. So, get ready, start your HBase daemons, open HBase shell and get your hands dirty. For those of us who are unaware, HBase shell is based on  JRuby , the Java Virtual Machine-based implementation of Ruby. More specifically, it uses the  Interactive Ruby Shell (IRB) , which is used to enter Ruby commands and get an immedia
Read more

BETWEEN OPERATOR IN HIVE

-
Hive is a wonderful tool for those who like to perform batch operations to process their large amounts of data residing on a Hadoop cluster and who are comparatively new to the NOSQL world. Not only it provides us warehousing capabilities on top of a Hadoop cluster, but also a superb SQL like interface which makes it very easy to use and makes our task execution more familiar. But, one thing which newbies like me always wanted to have is the support of BETWEEN operator in Hive. Since the release of version 0.9.0  earlier  this year, Hive provides us some new and very useful features. BETWEEN operator is one among those.
Read more

HOW TO SETUP AND CONFIGURE 'ssh' ON LINUX (UBUNTU)

-
SSH (Secure Shell) is a network protocol  secure data communication, remote shell services or command execution and other secure network services between two networked computers that it connects via a secure channel  over an insecure network. The ssh server runs on a machine (server) and ssh client runs on another machine (client). ssh has 2 main components : 1- ssh : T he command we use to connect to remote machines - the client.  2-  sshd : T he daemon that is running on the  server  and allows clients to connect to the server. ssh is pre-enabled on Linux, but in order to start sshd daemon , we need to install ssh first. Use this command to do that : $ sudo apt-get install ssh This will install ssh on your machine. In order to check if ssh is setup properly do this : $ which ssh It will throw this line on your terminal /usr/bin/ssh $ which sshd It will throw this line on your terminal /usr/bin/sshd SSH uses  public-key cryptography  to  authenticate  the remote co
Read more