installing 9.6 bde binaries on hadoop data nodes snapshots captured from cloudera sandbox

21
Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

Upload: conrad-benson

Post on 08-Jan-2018

225 views

Category:

Documents


0 download

DESCRIPTION

1. Run Installer 3 Login as root and run the installer script as shown above. You can also run this script as ‘ sudo ’

TRANSCRIPT

Page 1: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

Installing 9.6 BDE binarieson hadoop data nodes

Snapshots captured from Cloudera sandbox

Page 2: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

2

Installation on Single node

Page 3: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

3

1. Run Installer

Login as root and run the installer script as shown above. You can also run this

script as ‘sudo’

Page 4: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

4

2. Choose Installation type

Login as root and run the installer script as shown above. You can also run this

script as ‘sudo’

Page 5: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

5

3. Install completes

Page 6: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

6

Uninstallation

Page 7: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

7

1. Run Installer

Login as root and run the installer script as shown above. You can also run this

script as ‘sudo’

Page 8: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

8

2. Choose Uninstallation

Page 9: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

9

3. Choose local/remote. Installer completes

Page 10: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

10

Installation on remote nodesIncomplete section

Page 11: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

11

1. Run Installer

Login as root and run the installer script as shown above. You can also run this

script as ‘sudo’

Page 12: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

12

2. Choose installation on remote nodes

Page 13: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

13

3. Invoking from name node ?

Page 14: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

14

4. Provide hadoop installation path

Page 15: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

15

DIS ConfigurationPost installation activity

Page 16: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

16

Configure DIS properties in DIS Processes

Page 17: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

17

Hadoop node setupPost installation activity

Page 18: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

18

Check the map reduce site XML

Page 19: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

19

Check for mapreduce.admin.map.child.java.opts

if this parameter is present, remove the -Djava.library.path Java option from it

Page 20: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

20

Modify it to be the following

infapdo.java.opts=-Xmx512M -XX:GCTimeRatio=34

-XX:+UseConcMarkSweepGC -XX:+UseParNewGC -

XX:ParallelGCThreads=2 -XX:NewRatio=2 -

Djava.library.path=$HADOOP_NODE_INFA_HOME/serv

ices/shared/bin:$HADOOP_NODE_HADOOP_DIST/lib/

*:$HADOOP_NODE_HADOOP_DIST/lib/native/Linux-

amd64-64:/usr/lib/hadoop/lib/native/:/mylib/ -

Djava.security.egd=file:/dev/./urandom

Page 21: Installing 9.6 BDE binaries on hadoop data nodes Snapshots captured from Cloudera sandbox

21

Edit hive-site.xml

Edit the file <BDE directory>/Informatica/services/shared/hadoop/ <Hadoop_distribution_name>/conf/hive-site.xml