Running Hadoop Benchmarking TestDFSIO on Cloudera Clusters

Hadoop provides a benchmarking mechanism for the cluster. The steps to benchmark cloudera cluster file system is below. set the HADOOP_HOME. HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop/ Run TestDFSIO as below. #hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.3.0-tests.jar TestDFSIO -write -nrFiles 10 -fileSize 1000 #hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.0.0-cdh4.3.0-tests.jar TestDFSIO -read -nrFiles 10 -fileSize 1000 Once you run the test you will see TestDFSIO_results.logĀ  file in … Continue reading Running Hadoop Benchmarking TestDFSIO on Cloudera Clusters

Advertisements