As I wanted to install sqoop on my Red Hat box, I went to https://ccp.cloudera.com/display/CDHDOC/Sqoop+Installation where I found some install steps. For Red Hat Linux it said to do a "yum install", but that failed on my box.
I then ended up installing the mapr packages from http://package.mapr.com/releases/v1.2.2/redhat/
As per the http://www.mapr.com/doc/display/MapR/Local+Packages+-+Red+Hat you required the following packages
At this point only the sqoop rpm's were added, the hbase rpm had not yet been added to the linux box that is why we get a warning message when invoking sqoop as shown below.
We now get the hbase rpm and then install the hbase rpm on the linux host.
No warning messages this time around.
[root@isvx7 ~]# sudo yum install sqoop Loaded plugins: rhnplugin, security There was an error communicating with RHN. RHN Satellite or RHN Classic support will be disabled. Error communicating with server. The message was: Error Message: Please run rhn_register as root on this client Error Class Code: 9 Error Class Info: Invalid System Credentials. Explanation: An error has occurred while processing your request. If this problem persists please enter a bug report at bugzilla.redhat.com. If you choose to submit the bug report, please be sure to include details of what you were trying to do when this error occurred and details on how to reproduce this problem. Setting up Install Process No package sqoop available. Nothing to do |
I then ended up installing the mapr packages from http://package.mapr.com/releases/v1.2.2/redhat/
As per the http://www.mapr.com/doc/display/MapR/Local+Packages+-+Red+Hat you required the following packages
| Role | Package | Dependencies |
| Sqoop | mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm | mapr-core-1.2.2.12455.GA-1.x86_64.rpm mapr-hbase-internal-1.2.2.12455.GA-1.x86_64.rpm mapr-sqoop-internal-1.2.2.12455.GA-1.x86_64.rpm |
[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-s qoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm --2012-03-06 15:52:34-- http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqo op-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm Resolving package.mapr.com... 205.251.215.104, 205.251.215.186, 205.251.215.219, ... Connecting to package.mapr.com|205.251.215.104|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 3425149 (3.3M) [application/x-redhat-package-manager] Saving to: `mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm' 100%[======================================>] 3,425,149 347K/s in 8.4s 2012-03-06 15:52:42 (399 KB/s) - `mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x8 6_64.rpm' saved [3425149/3425149] |
[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm --2012-03-06 15:48:30-- http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm Resolving package.mapr.com... 216.137.43.10, 216.137.43.125, 216.137.43.136, ... Connecting to package.mapr.com|216.137.43.10|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1973 (1.9K) [application/x-redhat-package-manager] Saving to: `mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm' 100%[======================================>] 1,973 --.-K/s in 0s 2012-03-06 15:48:30 (125 MB/s) - `mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm' saved [1973/1973] |
[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-c ore-1.2.2.12455.GA-1.x86_64.rpm --2012-03-06 15:48:49-- http://package.mapr.com/releases/v1.2.2/redhat/mapr-cor e-1.2.2.12455.GA-1.x86_64.rpm Resolving package.mapr.com... 216.137.43.136, 216.137.43.174, 216.137.43.203, .. . Connecting to package.mapr.com|216.137.43.136|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 112941895 (108M) [application/x-redhat-package-manager] Saving to: `mapr-core-1.2.2.12455.GA-1.x86_64.rpm' 100%[======================================>] 112,941,895 678K/s in 3m 36s 2012-03-06 15:52:25 (511 KB/s) - `mapr-core-1.2.2.12455.GA-1.x86_64.rpm' saved [ 112941895/112941895] |
[root@isvx7 bigdata]# ls mapr-core-1.2.2.12455.GA-1.x86_64.rpm mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm |
[root@isvx7 bigdata]# rpm -i mapr-core-1.2.2.12455.GA-1.x86_64.rpm [root@isvx7 bigdata]# rpm -i mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64. rpm [root@isvx7 bigdata]# rpm -i mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm [root@isvx7 bigdata]# which sqoop /usr/bin/sqoop |
At this point only the sqoop rpm's were added, the hbase rpm had not yet been added to the linux box that is why we get a warning message when invoking sqoop as shown below.
[root@isvx7 bigdata]# sqoop -h Warning: /opt/mapr/hbase/hbase-0.90.4 does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. No such sqoop tool: -h. See 'sqoop help'. |
We now get the hbase rpm and then install the hbase rpm on the linux host.
[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm --2012-03-06 16:47:39-- http://package.mapr.com/releases/v1.2.2/redhat/mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm Resolving package.mapr.com... 205.251.215.160, 205.251.215.180, 205.251.215.222, ... Connecting to package.mapr.com|205.251.215.160|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 29024196 (28M) [application/x-redhat-package-manager] Saving to: `mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm' 100%[========================================>] 29,024,196 1.56M/s in 38s 2012-03-06 16:48:17 (755 KB/s) - `mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm' saved [29024196/29024196] [root@isvx7 bigdata]# [root@isvx7 bigdata]# rpm -i mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm |
No warning messages this time around.
[root@isvx7 bigdata]# sqoop help usage: sqoop COMMAND [ARGS] Available commands: codegen Generate code to interact with database records create-hive-table Import a table definition into Hive eval Evaluate a SQL statement and display the results export Export an HDFS directory to a database table help List available commands import Import a table from a database to HDFS import-all-tables Import tables from a database to HDFS job Work with saved jobs list-databases List available databases on a server list-tables List available tables in a database merge Merge results of incremental imports metastore Run a standalone Sqoop metastore version Display version information See 'sqoop help COMMAND' for information on a specific command. [root@isvx7 bigdata]# sqoop version Sqoop 1.3.0 git commit id Compiled by sathya@satdev1 on Tue Aug 23 18:03:37 PDT 2011 [root@isvx7 bigdata]# |
No comments:
Post a Comment