Wednesday, March 28, 2012

Increasing the jfs2 file system size on AIX beyond 64GB

In my earlier post I talk about increasin the size of a file system on AIX

http://shettymayur.blogspot.com/2011/01/how-to-increase-file-system-size-on-aix.html

In this post I created a 100GB SAN volume, which I mapped to my AIX 7.1 host.

Using smitty I created a 64GB jfs2 file system on the volume.


/dev/fslv02       64.00     52.61   18%     5459     1% /bigfs
isvp14_ora> lslv fslv02
LOGICAL VOLUME:     fslv02                 VOLUME GROUP:   bigfs
LV IDENTIFIER:      00f62a6b00004c0000000136568e8fcf.2 PERMISSION:     read/write
VG STATE:           active/complete        LV STATE:       opened/syncd
TYPE:               jfs2                   WRITE VERIFY:   off
MAX LPs:            512                    PP SIZE:        128 megabyte(s)
COPIES:             1                      SCHED POLICY:   parallel
LPs:                512                    PPs:            512
STALE PPs:          0                      BB POLICY:      relocatable
INTER-POLICY:       minimum                RELOCATABLE:    yes
INTRA-POLICY:       middle                 UPPER BOUND:    32
MOUNT POINT:        /bigfs                 LABEL:          /bigfs
MIRROR WRITE CONSISTENCY: on/ACTIVE
EACH LP COPY ON A SEPARATE PV ?: yes
Serialize IO ?:     NO
isvp14_ora>

The volume that was mapped to the host was 100GB, but when I tried to increase the file system size beyond 64GB I get the below message.

isvp14_ora> chfs -a size=90G /bigfs
0516-787 extendlv: Maximum allocation for logical volume fslv02 is 512.

We see that it's complaining that the maximum number LP is 512. LV can go up to 512 LPs, each LP is 128 MB , so  512 x 128MB= 64 GB

Below we below see the command to increase the LPs to 1024, this will give us a max file system of 128 GB


isvp14_ora> chlv -x'1024' fslv02
isvp14_ora> lslv fslv02
LOGICAL VOLUME:     fslv02                 VOLUME GROUP:   bigfs
LV IDENTIFIER:      00f62a6b00004c0000000136568e8fcf.2 PERMISSION:     read/write
VG STATE:           active/complete        LV STATE:       opened/syncd
TYPE:               jfs2                   WRITE VERIFY:   off
MAX LPs:            1024                   PP SIZE:        128 megabyte(s)
COPIES:             1                      SCHED POLICY:   parallel
LPs:                512                    PPs:            512
STALE PPs:          0                      BB POLICY:      relocatable
INTER-POLICY:       minimum                RELOCATABLE:    yes
INTRA-POLICY:       middle                 UPPER BOUND:    32
MOUNT POINT:        /bigfs                 LABEL:          /bigfs
MIRROR WRITE CONSISTENCY: on/ACTIVE
EACH LP COPY ON A SEPARATE PV ?: yes
Serialize IO ?:     NO

isvp14_ora> chfs -a size=90G /bigfs
Filesystem size changed to 188743680
isvp14_ora> df -g
/dev/fslv02       90.00     78.60   13%     5459     1% /bigfs

Tuesday, March 6, 2012

Installing Sqoop on Red Hat 4.1.2-50

As I wanted to install sqoop on my Red Hat box, I went to https://ccp.cloudera.com/display/CDHDOC/Sqoop+Installation where I found some install steps. For Red Hat Linux it said to do a "yum install", but that failed on my box.

[root@isvx7 ~]# sudo yum install sqoop
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
No package sqoop available.
Nothing to do


I then ended up installing the mapr packages from http://package.mapr.com/releases/v1.2.2/redhat/

As per the http://www.mapr.com/doc/display/MapR/Local+Packages+-+Red+Hat you required the following packages

RolePackage Dependencies
Sqoopmapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm mapr-core-1.2.2.12455.GA-1.x86_64.rpm
mapr-hbase-internal-1.2.2.12455.GA-1.x86_64.rpm
mapr-sqoop-internal-1.2.2.12455.GA-1.x86_64.rpm


[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-s            qoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm
--2012-03-06 15:52:34--  http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqo            op-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm
Resolving package.mapr.com... 205.251.215.104, 205.251.215.186, 205.251.215.219,             ...
Connecting to package.mapr.com|205.251.215.104|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3425149 (3.3M) [application/x-redhat-package-manager]
Saving to: `mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm'

100%[======================================>] 3,425,149    347K/s   in 8.4s

2012-03-06 15:52:42 (399 KB/s) - `mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x8            6_64.rpm' saved [3425149/3425149]


[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm
--2012-03-06 15:48:30--  http://package.mapr.com/releases/v1.2.2/redhat/mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm
Resolving package.mapr.com... 216.137.43.10, 216.137.43.125, 216.137.43.136, ...
Connecting to package.mapr.com|216.137.43.10|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1973 (1.9K) [application/x-redhat-package-manager]
Saving to: `mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm'

100%[======================================>] 1,973       --.-K/s   in 0s


2012-03-06 15:48:30 (125 MB/s) - `mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm' saved   [1973/1973]




[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-c  ore-1.2.2.12455.GA-1.x86_64.rpm
--2012-03-06 15:48:49--  http://package.mapr.com/releases/v1.2.2/redhat/mapr-cor  e-1.2.2.12455.GA-1.x86_64.rpm
Resolving package.mapr.com... 216.137.43.136, 216.137.43.174, 216.137.43.203, ..  .
Connecting to package.mapr.com|216.137.43.136|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 112941895 (108M) [application/x-redhat-package-manager]
Saving to: `mapr-core-1.2.2.12455.GA-1.x86_64.rpm'

100%[======================================>] 112,941,895  678K/s   in 3m 36s

2012-03-06 15:52:25 (511 KB/s) - `mapr-core-1.2.2.12455.GA-1.x86_64.rpm' saved [  112941895/112941895]


[root@isvx7 bigdata]# ls
mapr-core-1.2.2.12455.GA-1.x86_64.rpm
mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm
mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.rpm



[root@isvx7 bigdata]# rpm -i mapr-core-1.2.2.12455.GA-1.x86_64.rpm
[root@isvx7 bigdata]# rpm -i mapr-sqoop-internal-1.2.2.12455.GA.v1.3.0-1.x86_64.            rpm
[root@isvx7 bigdata]# rpm -i mapr-sqoop-1.2.2.12455.GA-1.x86_64.rpm
[root@isvx7 bigdata]# which sqoop
/usr/bin/sqoop

At this point only the sqoop rpm's were added, the hbase rpm had not yet been added to the linux box that is why we get a warning message when invoking sqoop as shown below.

 [root@isvx7 bigdata]# sqoop -h
Warning: /opt/mapr/hbase/hbase-0.90.4 does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
No such sqoop tool: -h. See 'sqoop help'.

We now get the hbase rpm and then install the hbase rpm on the linux host.

[root@isvx7 bigdata]# wget http://package.mapr.com/releases/v1.2.2/redhat/mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm
--2012-03-06 16:47:39--  http://package.mapr.com/releases/v1.2.2/redhat/mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm
Resolving package.mapr.com... 205.251.215.160, 205.251.215.180, 205.251.215.222, ...
Connecting to package.mapr.com|205.251.215.160|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 29024196 (28M) [application/x-redhat-package-manager]
Saving to: `mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm'

100%[========================================>] 29,024,196  1.56M/s   in 38s

2012-03-06 16:48:17 (755 KB/s) - `mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm' saved [29024196/29024196]

[root@isvx7 bigdata]#

[root@isvx7 bigdata]# rpm -i mapr-hbase-internal-1.2.2.12455.GA.v0.90.4-1.x86_64.rpm


No warning messages this time around.

[root@isvx7 bigdata]# sqoop help
usage: sqoop COMMAND [ARGS]

Available commands:
  codegen            Generate code to interact with database records
  create-hive-table  Import a table definition into Hive
  eval               Evaluate a SQL statement and display the results
  export             Export an HDFS directory to a database table
  help               List available commands
  import             Import a table from a database to HDFS
  import-all-tables  Import tables from a database to HDFS
  job                Work with saved jobs
  list-databases     List available databases on a server
  list-tables        List available tables in a database
  merge              Merge results of incremental imports
  metastore          Run a standalone Sqoop metastore
  version            Display version information

See 'sqoop help COMMAND' for information on a specific command.
[root@isvx7 bigdata]# sqoop version
Sqoop 1.3.0
git commit id
Compiled by sathya@satdev1 on Tue Aug 23 18:03:37 PDT 2011
[root@isvx7 bigdata]#

Thursday, February 23, 2012

Storage options for Oracle RAC and Oracle Clusterware with AIX

Every now and again this question come up, "What are the supported storage options for Oracle RAC and Oracle Clusterware with AIX?"

This table below from the Oracle docs pretty much answers that question in a nutshell.


Monday, January 30, 2012

Upgrade an Oracle database from 10.2.0.1.0 to 11.2.0.1.0 using DBUA

While trying to upgrade the database from 10.2.0.1.0 to 11.2.0.1.0 using DBUA I got the following message:
Could not get database version from the Oracle Server component. The CEP file rdbmsup.sql does not provide the version directive.

Reason:
To upgrade from 10.2.0.1.0 to 11.2.0.1.0 , we need to first upgrade from 10.2.0.1.0 to 10.2.0.4 using Oracle Patchset 10.2.0.4 (6810189).

Here is a link to an excellent blogs that gives all the details on installing the Patchset.

Once I upgraded to Oracle 10.2.0.4, I could upgrade to 11.2.0.1.0 using DBUA.

Also, this blog gives all the details on using DBUA for the upgrade.

Wednesday, January 25, 2012

SP2-1503: Unable to initialize Oracle call interface SP2-0152: ORACLE may not be functioning properly

For a new project I have both a 10g and a 11g database running on the same host.

Both the databases instances were up and running fine, the processes can be seen below

-bash-3.2$ ps -ef | grep test
oracle   13727     1  0 Jan20 ?        00:00:00 ora_pmon_testteng
oracle   13729     1  0 Jan20 ?        00:00:00 ora_psp0_testteng
oracle   13731     1  0 Jan20 ?        00:00:01 ora_mman_testteng
oracle   13733     1  0 Jan20 ?        00:00:00 ora_dbw0_testteng
oracle   13735     1  0 Jan20 ?        00:00:00 ora_dbw1_testteng
oracle   13737     1  0 Jan20 ?        00:00:00 ora_dbw2_testteng
oracle   13739     1  0 Jan20 ?        00:00:00 ora_lgwr_testteng
oracle   13741     1  0 Jan20 ?        00:00:13 ora_ckpt_testteng
oracle   13743     1  0 Jan20 ?        00:00:05 ora_smon_testteng
oracle   13745     1  0 Jan20 ?        00:00:00 ora_reco_testteng
oracle   13747     1  0 Jan20 ?        00:00:03 ora_cjq0_testteng
oracle   13749     1  0 Jan20 ?        00:00:01 ora_mmon_testteng
oracle   13751     1  0 Jan20 ?        00:00:04 ora_mmnl_testteng
oracle   13753     1  0 Jan20 ?        00:00:00 ora_d000_testteng
oracle   13755     1  0 Jan20 ?        00:00:00 ora_s000_testteng
oracle   13761     1  0 Jan20 ?        00:00:00 ora_qmnc_testteng
oracle   13979     1  0 Jan20 ?        00:00:00 ora_q000_testteng
oracle   14007     1  0 Jan20 ?        00:00:03 ora_q001_testteng

oracle   29643     1  0 22:54 ?        00:00:00 ora_pmon_testdb1
oracle   29645     1  0 22:54 ?        00:00:00 ora_vktm_testdb1
oracle   29649     1  0 22:54 ?        00:00:00 ora_gen0_testdb1
oracle   29651     1  0 22:54 ?        00:00:00 ora_diag_testdb1
oracle   29653     1  0 22:54 ?        00:00:00 ora_dbrm_testdb1
oracle   29655     1  0 22:54 ?        00:00:00 ora_psp0_testdb1
oracle   29657     1  0 22:54 ?        00:00:00 ora_dia0_testdb1
oracle   29659     1  0 22:54 ?        00:00:01 ora_mman_testdb1
oracle   29661     1  0 22:54 ?        00:00:00 ora_dbw0_testdb1
oracle   29663     1  0 22:54 ?        00:00:00 ora_dbw1_testdb1
oracle   29665     1  0 22:54 ?        00:00:00 ora_dbw2_testdb1
oracle   29667     1  0 22:54 ?        00:00:00 ora_lgwr_testdb1
oracle   29669     1  0 22:54 ?        00:00:00 ora_ckpt_testdb1
oracle   29671     1  0 22:54 ?        00:00:00 ora_smon_testdb1
oracle   29673     1  0 22:54 ?        00:00:00 ora_reco_testdb1
oracle   29675     1  0 22:54 ?        00:00:00 ora_mmon_testdb1
oracle   29677     1  0 22:54 ?        00:00:00 ora_mmnl_testdb1
oracle   29679     1  0 22:54 ?        00:00:00 ora_d000_testdb1
oracle   29681     1  0 22:54 ?        00:00:00 ora_s000_testdb1
oracle   29704     1  0 22:54 ?        00:00:00 ora_qmnc_testdb1
oracle   29718     1  0 22:54 ?        00:00:00 ora_cjq0_testdb1
oracle   29729     1  0 22:54 ?        00:00:00 ora_q000_testdb1
oracle   29731     1  0 22:54 ?        00:00:00 ora_q001_testdb1
oracle   30227     1  0 23:04 ?        00:00:00 ora_smco_testdb1
oracle   30229     1  0 23:04 ?        00:00:00 ora_w000_testdb1
oracle   31137 27895  0 23:22 pts/3    00:00:00 grep test
-bash-3.2$

Here I execute the .profile for the 10g instance where I set the ORACLE_HOME, ORACLE_SID and PATH. I then tried to connect using
sqlplus. As seen below everything worked fine, and I was able to connect.


-bash-3.2$ . ./.bash_profile_ten
-bash-3.2$ echo $ORACLE_HOME
/u01/app/oracle/product/10.2.0/dbhome_1
-bash-3.2$ echo $ORACLE_SID
testteng
-bash-3.2$ sqlplus / as sysdba

SQL*Plus: Release 10.2.0.1.0 - Production on Tue Jan 24 23:20:02 2012

Copyright (c) 1982, 2005, Oracle.  All rights reserved.


Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options

SQL>

Next I executed the .profile for the 11g instance where I set the ORACLE_HOME, ORACLE_SID and PATH. I then tried to connect using
sqlplus. As seen below I got the SP2-1503 and the SP2-0152 error messages


-bash-3.2$ . ./.bash_profile
-bash-3.2$ echo $ORACLE_HOME
/u01/app/oracle/product/11.2.0/dbhome_1
-bash-3.2$ echo $ORACLE_SID
testdb1
-bash-3.2$ sqlplus / as sysdba
SP2-1503: Unable to initialize Oracle call interface
SP2-0152: ORACLE may not be functioning properly



Reason for the error message:
Find out what sqlplus you are using.
-bash-3.2$ which sqlplus
/u01/app/oracle/product/10.2.0/dbhome_1/bin/sqlplus
-bash-3.2$
-bash-3.2$ echo $PATH
/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/u01/app/oracle/product/10.2.0/dbhome_1/bin:/u01/app/oracle/product/11.2.0/dbhome_1/bin

The above showed that the sqlplus I was using was from the 10g. This was because the PATH to the 10g bin was ahead of 11g bin in the PATH variable.

Fix:
Edit to .profile for the 11g and remove the 10g path from the PATH variable.
After the edit the PATH variable should look like below

-bash-3.2$ echo $PATH
/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin::/u01/app/oracle/product/11.2.0/dbhome_1/bin
-bash-3.2$ echo $ORACLE_HOME
/u01/app/oracle/product/11.2.0/dbhome_1
-bash-3.2$ echo $ORACLE_SID
testdb1
-bash-3.2$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.1.0 Production on Tue Jan 24 23:57:17 2012

Copyright (c) 1982, 2009, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL>

Tuesday, January 24, 2012

Adding a node to an existing Ganglia setup

This is a followup to the earlier posting where I installed and configured Ganglia to monitor 2 nodes. In this posting I try and add another node(isvpx3) to that setup.

[root@isvx3 ~]# rpm -qa | grep ganglia
[root@isvx3 ~]# rpm -qa | grep php
[root@isvx3 ~]#


[root@isvx3 rhn]# yum install ganglia
Loaded plugins: rhnplugin, security
Traceback (most recent call last):
  File "/usr/bin/yum", line 29, in ?
    yummain.user_main(sys.argv[1:], exit_code=True)
  File "/usr/share/yum-cli/yummain.py", line 309, in user_main
    errcode = main(args)
  File "/usr/share/yum-cli/yummain.py", line 157, in main
    base.getOptionsConfig(args)
  File "/usr/share/yum-cli/cli.py", line 187, in getOptionsConfig
    self.conf
  File "/usr/lib/python2.4/site-packages/yum/__init__.py", line 665, in <lambda>
    conf = property(fget=lambda self: self._getConfig(),
  File "/usr/lib/python2.4/site-packages/yum/__init__.py", line 254, in _getConfig
    self.plugins.run('init')
  File "/usr/lib/python2.4/site-packages/yum/plugins.py", line 179, in run
    func(conduitcls(self, self.base, conf, **kwargs))
  File "/usr/lib/yum-plugins/rhnplugin.py", line 121, in init_hook
    login_info = up2dateAuth.getLoginInfo()
  File "/usr/share/rhn/up2date_client/up2dateAuth.py", line 219, in getLoginInfo
    login()
  File "/usr/share/rhn/up2date_client/up2dateAuth.py", line 186, in login
    li = server.up2date.login(systemId)
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 64, in __call__
    raise up2dateErrors.SSLCertificateVerifyFailedError()
up2date_client.up2dateErrors.SSLCertificateVerifyFailedError: The SSL certificate failed verification.
[root@isvx3 rhn]#

Changed https to http in the /etc/sysconfig/rhn/up2date file:

serverURL[comment]=Remote server URL
serverURL=https://rtp.rhn.linux.ibm.com/XMLRPC
to
serverURL[comment]=Remote server URL
serverURL=http://rtp.rhn.linux.ibm.com/XMLRPC

That helped get rid of the "The SSL certificate failed verification." error, but yum install ganglia still did not go through as shown below.


[root@isvx3 ~]# yum install ganglia
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
No package ganglia available.
Nothing to do
[root@isvx3 ~]#

As the above failed, I  went onto to install the Extra Packages for Enterprise Linux (EPEL)  rpm as follows

[root@isvx3 ganglia]# wget http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
--2012-01-24 14:16:58--  http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
Resolving download.fedoraproject.org... 66.35.62.166, 209.132.181.16, 140.211.169.197, ...
Connecting to download.fedoraproject.org|66.35.62.166|:80... connected.
HTTP request sent, awaiting response... 302 FOUND
Location: http://mirrors.rit.edu/epel/5/i386/epel-release-5-4.noarch.rpm [following]
--2012-01-24 14:16:58--  http://mirrors.rit.edu/epel/5/i386/epel-release-5-4.noarch.rpm
Resolving mirrors.rit.edu... 129.21.171.98
Connecting to mirrors.rit.edu|129.21.171.98|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 12232 (12K) [application/x-rpm]
Saving to: `epel-release-5-4.noarch.rpm'

100%[======================================>] 12,232      62.2K/s   in 0.2s

2012-01-24 14:16:59 (62.2 KB/s) - `epel-release-5-4.noarch.rpm' saved [12232/12232]

[root@isvx3 ganglia]#
[root@isvx3 ganglia]# rpm -i epel-release-5-4.noarch.rpm
warning: epel-release-5-4.noarch.rpm: Header V3 DSA signature: NOKEY, key ID 217521f6
[root@isvx3 ganglia]#

Was able to install ganglia using yum install after that:

[root@isvx3 ganglia]# yum install ganglia
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

epel                                                     | 3.7 kB     00:00
epel/primary_db                                          | 3.7 MB     00:12
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package ganglia.i386 0:3.0.7-1.el5 set to be updated
---> Package ganglia.x86_64 0:3.0.7-1.el5 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package           Arch             Version                Repository      Size
================================================================================
Installing:
 ganglia           i386             3.0.7-1.el5            epel            91 k
 ganglia           x86_64           3.0.7-1.el5            epel            91 k

Transaction Summary
================================================================================
Install       2 Package(s)
Upgrade       0 Package(s)

Total download size: 182 k
Is this ok [y/N]: y
Downloading Packages:
(1/2): ganglia-3.0.7-1.el5.i386.rpm                      |  91 kB     00:00
(2/2): ganglia-3.0.7-1.el5.x86_64.rpm                    |  91 kB     00:00
--------------------------------------------------------------------------------
Total                                           155 kB/s | 182 kB     00:01
warning: rpmts_HdrFromFdno: Header V3 DSA signature: NOKEY, key ID 217521f6
epel/gpgkey                                              | 1.7 kB     00:00
Importing GPG key 0x217521F6 "Fedora EPEL <epel@fedoraproject.org>" from /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : ganglia                                                  1/2
  Installing     : ganglia                                                  2/2

Installed:
  ganglia.i386 0:3.0.7-1.el5            ganglia.x86_64 0:3.0.7-1.el5

Complete!
[root@isvx3 ganglia]#

Next I install ganglia-gmond using yum.

[root@isvx3 ganglia]# yum install ganglia-gmond
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package ganglia-gmond.x86_64 0:3.0.7-1.el5 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package               Arch           Version                Repository    Size
================================================================================
Installing:
 ganglia-gmond         x86_64         3.0.7-1.el5            epel         220 k

Transaction Summary
================================================================================
Install       1 Package(s)
Upgrade       0 Package(s)

Total download size: 220 k
Is this ok [y/N]: y
Downloading Packages:
ganglia-gmond-3.0.7-1.el5.x86_64.rpm                     | 220 kB     00:00
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : ganglia-gmond                                            1/1

Installed:
  ganglia-gmond.x86_64 0:3.0.7-1.el5

Complete!
[root@isvx3 ganglia]#

Edit the /etc/gmond.conf file as follows:

cluster {
  name = "unspecified"
  owner = "unspecified"
  latlong = "unspecified"
  url = "unspecified"
}

to

cluster {
  name = "my servers"
  owner = "unspecified"
  latlong = "unspecified"
  url = "unspecified"
}


also, change the following in the /etc/gmond.conf

udp_send_channel {
  mcast_join = 239.2.11.71
  port = 8649
  ttl = 1
}

to

udp_send_channel {
  host = isvx7.storage.tucson.ibm.com
  port = 8649
}

also, change the following in the /etc/gmond.conf

/* You can specify as many udp_recv_channels as you like as well. */
udp_recv_channel {
  mcast_join = 239.2.11.71
  port = 8649
  bind = 239.2.11.71
}

/* You can specify as many tcp_accept_channels as you like to share
   an xml description of the state of the cluster */
tcp_accept_channel {
  port = 8649
}


to

/* udp_recv_channel {
}
tcp_accept_channel {
} */

Start the gmond daemon

[root@isvx3 ganglia]# service gmond start
Starting GANGLIA gmond:                                    [  OK  ]

You can see the Hosts up count has increased by 1. Also you can see the name of the newly added host in the drop down menu for "my servers"

Install and Configure Ganglia on Red Hat 4.1.2-50

I wanted to install and play around with ganglia on my RedHat 4.1.2-50 Linux box. I found the a really good HOW TO:
http://acidborg.wordpress.com/2010/10/08/how-to-install-and-configure-ganglia-on-red-hat-enterprise-linux-5/

When I tried to do "yum install ganglia" I got the below message.

[root@isvx7 ganglia]# yum install ganglia
Loaded plugins: rhnplugin, security
Traceback (most recent call last):
  File "/usr/bin/yum", line 29, in ?
    yummain.user_main(sys.argv[1:], exit_code=True)
  File "/usr/share/yum-cli/yummain.py", line 309, in user_main
    errcode = main(args)
  File "/usr/share/yum-cli/yummain.py", line 157, in main
    base.getOptionsConfig(args)
  File "/usr/share/yum-cli/cli.py", line 187, in getOptionsConfig
    self.conf
  File "/usr/lib/python2.4/site-packages/yum/__init__.py", line 665, in <lambda>
    conf = property(fget=lambda self: self._getConfig(),
  File "/usr/lib/python2.4/site-packages/yum/__init__.py", line 254, in _getConfig
    self.plugins.run('init')
  File "/usr/lib/python2.4/site-packages/yum/plugins.py", line 179, in run
    func(conduitcls(self, self.base, conf, **kwargs))
  File "/usr/lib/yum-plugins/rhnplugin.py", line 121, in init_hook
    login_info = up2dateAuth.getLoginInfo()
  File "/usr/share/rhn/up2date_client/up2dateAuth.py", line 219, in getLoginInfo
    login()
  File "/usr/share/rhn/up2date_client/up2dateAuth.py", line 186, in login
    li = server.up2date.login(systemId)
  File "/usr/share/rhn/up2date_client/rhnserver.py", line 64, in __call__
    raise up2dateErrors.SSLCertificateVerifyFailedError()
up2date_client.up2dateErrors.SSLCertificateVerifyFailedError: The SSL certificate failed verification.
[root@isvx7 ganglia]#

As the above failed, I  went onto to install the Extra Packages for Enterprise Linux (EPEL)  rpm as follows


[root@isvx4 ganglia]# wget http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
--2012-01-23 18:22:37--  http://download.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
Resolving download.fedoraproject.org... 66.35.62.166, 152.19.134.146, 209.132.181.16, ...
Connecting to download.fedoraproject.org|66.35.62.166|:80... connected.
HTTP request sent, awaiting response... 302 FOUND
Location: http://mirror.steadfast.net/epel/5/i386/epel-release-5-4.noarch.rpm [following]
--2012-01-23 18:22:38--  http://mirror.steadfast.net/epel/5/i386/epel-release-5-4.noarch.rpm
Resolving mirror.steadfast.net... 208.100.4.53, 2607:f128:1:3::2
Connecting to mirror.steadfast.net|208.100.4.53|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 12232 (12K) [application/x-redhat-package-manager]
Saving to: `epel-release-5-4.noarch.rpm'

100%[======================================>] 12,232      --.-K/s   in 0.1s

2012-01-23 18:22:38 (80.9 KB/s) - `epel-release-5-4.noarch.rpm' saved [12232/12232]

[root@isvx4 ganglia]# ls
epel-release-5-4.noarch.rpm
[root@isvx4 ganglia]# rpm -i epel-release-5-4.noarch.rpm
warning: epel-release-5-4.noarch.rpm: Header V3 DSA signature: NOKEY, key ID 217521f6
[root@isvx4 ganglia]#

Some blogs say to check the data and time of the host doing a "yum install", and that it could cause the error message "up2date_client.up2dateErrors.SSLCertificateVerifyFailedError: The SSL certificate failed verification."

In my case the date and time were fine, and that was not the cause of the problem.

I found a workaround to the issue which says, to edit /etc/sysconfig/rhn/up2date and change serverURL=http://... instead of https.

It fixed the "up2date_client.up2dateErrors.SSLCertificateVerifyFailedError: The SSL certificate failed verification." issue, and I was able to install ganglia using "yum install".


[root@isvx7 ganglia]# yum install ganglia
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package ganglia.i386 0:3.0.7-1.el5 set to be updated
---> Package ganglia.x86_64 0:3.0.7-1.el5 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package           Arch             Version                Repository      Size
================================================================================
Installing:
 ganglia           i386             3.0.7-1.el5            epel            91 k
 ganglia           x86_64           3.0.7-1.el5            epel            91 k

Transaction Summary
================================================================================
Install       2 Package(s)
Upgrade       0 Package(s)

Total download size: 182 k
Is this ok [y/N]: y
Downloading Packages:
(1/2): ganglia-3.0.7-1.el5.i386.rpm                      |  91 kB     00:00
(2/2): ganglia-3.0.7-1.el5.x86_64.rpm                    |  91 kB     00:00
--------------------------------------------------------------------------------
Total                                            38 kB/s | 182 kB     00:04
warning: rpmts_HdrFromFdno: Header V3 DSA signature: NOKEY, key ID 217521f6
epel/gpgkey                                              | 1.7 kB     00:00
Importing GPG key 0x217521F6 "Fedora EPEL <epel@fedoraproject.org>" from /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : ganglia                                                  1/2
  Installing     : ganglia                                                  2/2

Installed:
  ganglia.i386 0:3.0.7-1.el5            ganglia.x86_64 0:3.0.7-1.el5

Complete!



In addition to that, on the node I wanted to monitor I also installed ganglia-gmond

[root@isvx7 ganglia]# yum install ganglia-gmond
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package ganglia-gmond.x86_64 0:3.0.7-1.el5 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package               Arch           Version                Repository    Size
================================================================================
Installing:
 ganglia-gmond         x86_64         3.0.7-1.el5            epel         220 k

Transaction Summary
================================================================================
Install       1 Package(s)
Upgrade       0 Package(s)

Total download size: 220 k
Is this ok [y/N]: y
Downloading Packages:
ganglia-gmond-3.0.7-1.el5.x86_64.rpm                     | 220 kB     00:00
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : ganglia-gmond                                            1/1

Installed:
  ganglia-gmond.x86_64 0:3.0.7-1.el5

Complete!
[root@isvx4 ganglia]#

Use the Gabglia Status Tool(gstat) and tried to see if the thing were working fine.

[root@isvx7 lib]# gstat -a
CLUSTER INFORMATION
       Name: my servers
      Hosts: 2
Gexec Hosts: 0
 Dead Hosts: 0
  Localtime: Mon Jan 23 20:23:05 2012

CLUSTER HOSTS
Hostname                     LOAD                       CPU              Gexec
 CPUs (Procs/Total) [     1,     5, 15min] [  User,  Nice, System, Idle, Wio]

isvx4.storage.tucson.ibm.com
   24 (    0/  873) [  0.07,  0.03,  0.01] [   0.0,   0.0,   0.1,  99.9,   0.0] OFF
isvx7.storage.tucson.ibm.com
   24 (    0/ 1068) [  2.07,  2.11,  2.27] [   0.0,   0.0,   0.1,  95.1,   4.8] OFF
[root@isvx7 lib]#

http://isvx7.storage.tucson.ibm.com/ganglia still didn't work for me as it did need some more work.

I then downloaded the ganglia-web-3.0.7-1.el5 RPM for i386 rpm
from http://rpmfind.net/linux/RPM/epel/5/i386/ganglia-web-3.0.7-1.el5.i386.html

I also installed php as I did not have php on my Liux host

[root@isvx7 php]# rpm -qa php
[root@isvx7 php]#


[root@isvx7 ganglia]# wget http://rpms.famillecollet.com/enterprise/remi-release-5.rpm
--2012-01-23 23:11:12--  http://rpms.famillecollet.com/enterprise/remi-release-5.rpm
Resolving rpms.famillecollet.com... 88.191.74.232, 2a01:e0b:1:74:2e0:f4ff:fe1b:b827
Connecting to rpms.famillecollet.com|88.191.74.232|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4974 (4.9K) [application/x-rpm]
Saving to: `remi-release-5.rpm'

100%[======================================================================================>] 4,974       26.9K/s   in 0.2s

2012-01-23 23:11:13 (26.9 KB/s) - `remi-release-5.rpm' saved [4974/4974]


[root@isvx7 ganglia]# yum --enablerepo=remi install php
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package php.x86_64 0:5.3.9-1.el5.remi set to be updated
--> Processing Dependency: php-cli = 5.3.9-1.el5.remi for package: php
--> Processing Dependency: php-common = 5.3.9-1.el5.remi for package: php
--> Processing Dependency: libedit.so.0()(64bit) for package: php
--> Running transaction check
---> Package libedit.x86_64 0:2.11-2.20080712cvs.el5 set to be updated
---> Package php-cli.x86_64 0:5.3.9-1.el5.remi set to be updated
---> Package php-common.x86_64 0:5.3.9-1.el5.remi set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================================================================
 Package                      Arch                     Version                                     Repository              Size
================================================================================================================================
Installing:
 php                          x86_64                   5.3.9-1.el5.remi                            remi                   2.8 M
Installing for dependencies:
 libedit                      x86_64                   2.11-2.20080712cvs.el5                      epel                    80 k
 php-cli                      x86_64                   5.3.9-1.el5.remi                            remi                   2.6 M
 php-common                   x86_64                   5.3.9-1.el5.remi                            remi                   997 k

Transaction Summary
================================================================================================================================
Install       4 Package(s)
Upgrade       0 Package(s)

Total download size: 6.4 M
Is this ok [y/N]: y
Downloading Packages:
(1/4): libedit-2.11-2.20080712cvs.el5.x86_64.rpm                                                         |  80 kB     00:00
(2/4): php-common-5.3.9-1.el5.remi.x86_64.rpm                                                            | 997 kB     00:01
(3/4): php-cli-5.3.9-1.el5.remi.x86_64.rpm                                                               | 2.6 MB     00:03
(4/4): php-5.3.9-1.el5.remi.x86_64.rpm                                                                   | 2.8 MB     00:03
--------------------------------------------------------------------------------------------------------------------------------
Total                                                                                           582 kB/s | 6.4 MB     00:11
warning: rpmts_HdrFromFdno: Header V3 DSA signature: NOKEY, key ID 00f97f56
remi/gpgkey                                                                                              | 1.3 kB     00:00
Importing GPG key 0x00F97F56 "Remi Collet <RPMS@FamilleCollet.com>" from /etc/pki/rpm-gpg/RPM-GPG-KEY-remi
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction

WARNING : These php-* RPM are not official Fedora/Redhat build and
overrides the official ones. Don't file bugs on Fedora Project nor Redhat.

Use dedicated forums http://forums.famillecollet.com/

  Installing     : php-common                                                                                               1/4
  Installing     : libedit                                                                                                  2/4
  Installing     : php-cli                                                                                                  3/4
  Installing     : php                                                                                                      4/4

Installed:
  php.x86_64 0:5.3.9-1.el5.remi

Dependency Installed:
  libedit.x86_64 0:2.11-2.20080712cvs.el5      php-cli.x86_64 0:5.3.9-1.el5.remi      php-common.x86_64 0:5.3.9-1.el5.remi

Complete!
[root@isvx7 ganglia]#
[root@isvx7 ganglia]# php -v
PHP 5.3.9 (cli) (built: Jan 10 2012 20:04:35)
Copyright (c) 1997-2012 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2012 Zend Technologies
[root@isvx7 ganglia]#

Then installed php-gd as follows:

[root@isvx7 rhn]# yum --enablerepo=remi install php-gd
Loaded plugins: rhnplugin, security
There was an error communicating with RHN.
RHN Satellite or RHN Classic support will be disabled.
Error communicating with server. The message was:

Error Message:
        Please run rhn_register as root on this client
Error Class Code: 9
Error Class Info: Invalid System Credentials.
Explanation:
     An error has occurred while processing your request. If this problem
     persists please enter a bug report at bugzilla.redhat.com.
     If you choose to submit the bug report, please be sure to include
     details of what you were trying to do when this error occurred and
     details on how to reproduce this problem.

remi                                                     | 2.5 kB     00:00
remi/primary_db                                          | 266 kB     00:01
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package php-gd.x86_64 0:5.3.9-1.el5.remi set to be updated
--> Processing Dependency: libt1.so.5()(64bit) for package: php-gd
--> Running transaction check
---> Package t1lib.x86_64 0:5.1.1-7.el5 set to be updated
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package         Arch            Version                    Repository     Size
================================================================================
Installing:
 php-gd          x86_64          5.3.9-1.el5.remi           remi          209 k
Installing for dependencies:
 t1lib           x86_64          5.1.1-7.el5                epel          208 k

Transaction Summary
================================================================================
Install       2 Package(s)
Upgrade       0 Package(s)

Total download size: 417 k
Is this ok [y/N]: y
Downloading Packages:
(1/2): t1lib-5.1.1-7.el5.x86_64.rpm                      | 208 kB     00:00
(2/2): php-gd-5.3.9-1.el5.remi.x86_64.rpm                | 209 kB     00:01
--------------------------------------------------------------------------------
Total                                           108 kB/s | 417 kB     00:03
Running rpm_check_debug
Running Transaction Test
Finished Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : t1lib                                                    1/2
  Installing     : php-gd                                                   2/2

Installed:
  php-gd.x86_64 0:5.3.9-1.el5.remi

Dependency Installed:
  t1lib.x86_64 0:5.1.1-7.el5

Complete!
[root@isvx7 rhn]#
Installed the ganglia-web rpm, and restarted the httpd.

[root@isvx7 ganglia]# rpm -i ganglia-web-3.0.7-1.el5.x86_64.rpm
[root@isvx7 ganglia]#
[root@isvx7 ganglia]# service httpd restart
Stopping httpd:                                            [  OK  ]
Starting httpd:                                            [  OK  ]
[root@isvx7 ganglia]#

The Cluster report graphs were available using a browser
http://isvx7.storage.tucson.ibm.com/ganglia/


Summary:
  • Ganglia rpm's that were installed on the collector server
[root@isvx7 ganglia]# rpm  -qa | grep ganglia
ganglia-gmond-3.0.7-1.el5
ganglia-3.0.7-1.el5
ganglia-gmetad-3.0.7-1.el5
ganglia-3.0.7-1.el5
ganglia-web-3.0.7-1.el5
[root@isvx7 ganglia]#
  • Ganglia rpm's that were installed on the node that was monitored.
[root@isvx4 ~]# rpm -qa | grep ganglia
ganglia-gmond-3.0.7-1.el5
ganglia-3.0.7-1.el5
ganglia-3.0.7-1.el5
  • On the collector node isvx7.storage.tucson.ibm.com edit /etc/gmetad.conf
data_source "my servers" 10 localhost

Also edit /etc/gmond.conf
cluster {
  name = "my servers"
  owner = "unspecified"
  latlong = "unspecified"
  url = "unspecified"
}


udp_send_channel {
  host = isvx7.storage.tucson.ibm.com
  port = 8649
}


udp_recv_channel {
  port = 8649
}


tcp_accept_channel {
  port = 8649
}
  • Restart the collector daemons:
[root@isvx7 php]# service gmetad restart
Shutting down GANGLIA gmetad:                              [  OK  ]
Starting GANGLIA gmetad:                                   [  OK  ]
[root@isvx7 php]# service gmetad restart
Shutting down GANGLIA gmetad:                              [  OK  ]
Starting GANGLIA gmetad:                                   [  OK  ]
[root@isvx7 php]#
  • On the node that was monitored isvx4.storage.tucson.ibm.com
Edit the file /etc/gmond.conf
cluster {
  name = "my servers"
  owner = "unspecified"
  latlong = "unspecified"
  url = "unspecified"
}


udp_send_channel {
  host = isvx7.storage.tucson.ibm.com
  port = 8649
}


/* udp_recv_channel {
}
tcp_accept_channel {
} */
  • Restart the gmond daemon:
[root@isvx4 ~]# service gmond restart
Shutting down GANGLIA gmond:                               [  OK  ]
Starting GANGLIA gmond:                                    [  OK  ]
  • Monitoring data was available at:
http://isvx7.storage.tucson.ibm.com/ganglia