~bigdata-dev/charms/trusty/apache-hadoop-plugin/unstable

« back to all changes in this revision

Viewing changes to scripts/terasort.sh

  • Committer: Kevin W. Monroe
  • Date: 2015-06-29 14:23:33 UTC
  • mfrom: (95.2.7 apache-hadoop-plugin)
  • Revision ID: kevin.monroe@canonical.com-20150629142333-siljet454twedxhf
bundle resources into charm for ease of install; add extended status messages; use updated java-installer.sh that ensures java is on the path; update to latest jujubigdata library

Show diffs side-by-side

added added

removed removed

Lines of Context:
15
15
TERA_ARGS="-Dmapreduce.map.output.compress=true -Dmapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec -Dmapreduce.output.fileoutputformat.compress=true -Dmapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec -Dmapreduce.job.maps=${NUM_MAPS} -Dmapreduce.job.reduces=${NUM_REDS}"
16
16
 
17
17
# Clean out previous runs
18
 
hadoop fs -rm -r -skipTrash ${IN_DIR} || true
19
 
hadoop fs -rm -r -skipTrash ${OUT_DIR} || true
 
18
hadoop fs -rm -f -R -skipTrash ${IN_DIR} || true
 
19
hadoop fs -rm -f -R -skipTrash ${OUT_DIR} || true
20
20
 
21
21
hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples*.jar teragen ${TERA_ARGS} ${SIZE} ${IN_DIR}
22
22