← Back to branch summary

~bigdata-dev/charms/trusty/apache-hadoop/trunk

« back to all changes in this revision

Viewing changes to README.md

  • Committer: amir sanjar
  • Date: 2014-12-03 16:49:19 UTC
  • Revision ID: amir.sanjar@canonical.com-20141203164919-uolclmaesccqrapx
adding Separate HDFS and YARN nodes and partial IBM POWER support

Show diffs side-by-side

added added

removed removed

Lines of Context:
README.md
57
57
In this configuration, the YARN ResourceManager is deployed on the same
58
58
service units as HDFS namenode and the HDFS datanodes also run YARN NodeManager::
59
59
    
60
 
    juju deploy hadoop hadoop-master
61
 
    juju deploy hadoop hadoop-slavecluster
62
 
    juju add-unit -n 2 hadoop-slavecluster
63
 
    juju add-relation hadoop-master:namenode hadoop-slavecluster:datanode
64
 
    juju add-relation hadoop-master:resourcemanager hadoop-slavecluster:nodemanager
 
60
    juju deploy local:trusty/hadoop yarn-hdfs-master
 
61
    juju deploy local:trusty/hadoop compute-nodes
 
62
    juju add-relation yarn-hdfs-master:namenode compute-nodes:datanode
 
63
    juju add-relation yarn-hdfs-master:resourcemanager compute-nodes:nodemanager
 
64
    juju add-unit -n 3 compute-nodes
65
65
 
66
66
 
67
67
### Scale Out Usage: Separate HDFS and MapReduce
69
69
In this configuration the HDFS and YARN deployments operate on
70
70
different service units as separate services::
71
71
 
72
 
    juju deploy hadoop hdfs-namenode
73
 
    juju deploy hadoop hdfs-datacluster
74
 
    juju add-unit -n 2 hdfs-datacluster
75
 
    juju add-relation hdfs-namenode:namenode hdfs-datacluster:datanode
76
 
 
77
 
    juju deploy hadoop mapred-resourcemanager
78
 
    juju deploy hadoop mapred-taskcluster
79
 
    juju add-unit -n 2 mapred-taskcluster
80
 
    juju add-relation mapred-resourcemanager:mapred-namenode hdfs-namenode:namenode
81
 
    juju add-relation mapred-taskcluster:mapred-namenode hdfs-namenode:namenode    
82
 
    juju add-relation mapred-resourcemanager:resourcemanager mapred-taskcluster:nodemanager
 
72
    juju deploy local:trusty/hadoop HDFS-NameNode
 
73
    juju deploy local:trusty/hadoop compute-nodes
 
74
    juju deploy local:trusty/hadoop YARN-ResourceManager
 
75
    juju add-unit -n 3 compute-nodes
 
76
    juju add-relation HDFS-NameNode:namenode compute-nodes:datanode
 
77
    juju add-relation YARN-ResourceManager:mapred-namenode HDFS-NameNode:namenode
 
78
    juju add-relation compute-nodes:mapred-namenode HDFS-NameNode:namenode    
 
79
    juju add-relation YARN-ResourceManager:resourcemanager compute-nodes:nodemanager
83
80
 
84
81
In the long term juju should support improved placement of services to
85
82
better support this type of deployment.  This would allow mapreduce services