Big Data Hadoop & Spark

How To Fix Corrupt Blocks in HDFS

The easiest way to determine how to fix corrupt blocks on HDFS is to run an fsck “file system consistency check” on the filesystem. If you have setup your Hadoop environment variables, you should be able to use a path of /, if not, use hdfs://ip.or.hostname:50070/

hdfs fsck /

Or,

hdfs fsck hdfs://ip.or.hostname:50070/

If the end of output looks something like this, then we have healthy blocks on the file system.

If the end of output looks something like this, we may have corrupted blocks on the file system.

So, How to rectify the corrupted blocks in the file?

The output of the fsck above will be very verbose, but it will mention which blocks are corrupt. We can do some grepping of the fsck above so that we aren’t “reading through a firehose”.

hdfs fsck / | egrep -v '^\.+$' | grep -v replica | grep -v Replica
[[email protected] current]$ hdfs fsck / | egrep -v '^\.+$' | grep -v replica | grep -v Replica
16/10/06 13:41:38 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Connecting to namenode via http://localhost:50070
FSCK started by acadgild (auth:SIMPLE) from /127.0.0.1 for path / at Thu Oct 06 13:41:39 IST 2016
/Wc.txt: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741868
/Wc.txt: MISSING 1 blocks of total size 416 B..
/hbasestorage/WALs/localhost,36517,1447077102802/localhost%2C36517%2C1447077102802.1447077107288: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741862
/hbasestorage/WALs/localhost,36517,1447077102802/localhost%2C36517%2C1447077102802.1447077107288: MISSING 1 blocks of total size 83 B..
/hbasestorage/WALs/localhost,36517,1447077102802/localhost%2C36517%2C1447077102802.1447077112388.meta: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741863
/hbasestorage/WALs/localhost,36517,1447077102802/localhost%2C36517%2C1447077102802.1447077112388.meta: MISSING 1 blocks of total size 463 B..
/hbasestorage/WALs/localhost,56746,1446708635226-splitting/localhost%2C56746%2C1446708635226.1446708644854.meta: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741831
/hbasestorage/WALs/localhost,56746,1446708635226-splitting/localhost%2C56746%2C1446708635226.1446708644854.meta: MISSING 1 blocks of total size 648 B..
/hbasestorage/WALs/localhost,56746,1446708635226-splitting/localhost%2C56746%2C1446708635226.1446712245034.meta: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741859
/hbasestorage/WALs/localhost,56746,1446708635226-splitting/localhost%2C56746%2C1446708635226.1446712245034.meta: MISSING 1 blocks of total size 83 B..
/hbasestorage/data/hbase/meta/.tabledesc/.tableinfo.0000000001: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741829
/hbasestorage/data/hbase/meta/.tabledesc/.tableinfo.0000000001: MISSING 1 blocks of total size 372 B..
/hbasestorage/data/hbase/meta/1588230740/.regioninfo: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741827
/hbasestorage/data/hbase/meta/1588230740/.regioninfo: MISSING 1 blocks of total size 30 B..
/hbasestorage/data/hbase/meta/1588230740/info/9f2a1395065641e7be72824d1e8e9a61: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741860
/hbasestorage/data/hbase/meta/1588230740/info/9f2a1395065641e7be72824d1e8e9a61: MISSING 1 blocks of total size 1336 B..
/hbasestorage/data/hbase/meta/1588230740/oldWALs/hlog.1446708638437: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741828
/hbasestorage/data/hbase/meta/1588230740/oldWALs/hlog.1446708638437: MISSING 1 blocks of total size 91 B..
/hbasestorage/data/hbase/namespace/.tabledesc/.tableinfo.0000000001: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741832
/hbasestorage/data/hbase/namespace/.tabledesc/.tableinfo.0000000001: MISSING 1 blocks of total size 286 B..
/hbasestorage/data/hbase/namespace/c8559e782cdc2524c39e3d1d9a05445e/.regioninfo: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741833
/hbasestorage/data/hbase/namespace/c8559e782cdc2524c39e3d1d9a05445e/.regioninfo: MISSING 1 blocks of total size 40 B..
/hbasestorage/data/hbase/namespace/c8559e782cdc2524c39e3d1d9a05445e/info/9ac0ac611f3b401189750acf44543c31: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741861
/hbasestorage/data/hbase/namespace/c8559e782cdc2524c39e3d1d9a05445e/info/9ac0ac611f3b401189750acf44543c31: MISSING 1 blocks of total size 1045 B..
/hbasestorage/hbase.id: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741826
/hbasestorage/hbase.id: MISSING 1 blocks of total size 42 B..
/hbasestorage/hbase.version: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741825
/hbasestorage/hbase.version: MISSING 1 blocks of total size 7 B..
/hbasestorage/oldWALs/localhost%2C56746%2C1446708635226.1446708639577: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741830
/hbasestorage/oldWALs/localhost%2C56746%2C1446708635226.1446708639577: MISSING 1 blocks of total size 303 B..
/hbasestorage/oldWALs/localhost%2C56746%2C1446708635226.1446712239817: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741858
/hbasestorage/oldWALs/localhost%2C56746%2C1446708635226.1446712239817: MISSING 1 blocks of total size 83 B..
/inp: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741934
/inp: MISSING 1 blocks of total size 28 B...
/out23/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742088
/out23/part-r-00000: MISSING 1 blocks of total size 20 B..
/sample-mr/inp: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741929
/sample-mr/inp: MISSING 1 blocks of total size 28 B..
/sample-mr/job.properties: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741930
/sample-mr/job.properties: MISSING 1 blocks of total size 214 B..
/sample-mr/lib/WordCount.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741931
/sample-mr/lib/WordCount.jar: MISSING 1 blocks of total size 2250 B..
/sample-mr/workflow.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741932
/sample-mr/workflow.xml: MISSING 1 blocks of total size 3526 B..
/sample-mr/workflow.xml~: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741933
/sample-mr/workflow.xml~: MISSING 1 blocks of total size 3462 B...
/sqoopout/part-m-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741853
/sqoopout/part-m-00000: MISSING 1 blocks of total size 38 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0004-1447697645830-acadgild-wc-1447697758543-1-1-SUCCEEDED-default-1447697667507.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741877
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0004-1447697645830-acadgild-wc-1447697758543-1-1-SUCCEEDED-default-1447697667507.jhist: MISSING 1 blocks of total size 33336 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0004_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741878
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0004_conf.xml: MISSING 1 blocks of total size 104161 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0005-1447698399913-acadgild-wc-1447698455009-1-1-SUCCEEDED-default-1447698414840.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741887
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0005-1447698399913-acadgild-wc-1447698455009-1-1-SUCCEEDED-default-1447698414840.jhist: MISSING 1 blocks of total size 33300 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0005_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741888
/tmp/hadoop-yarn/staging/history/done/2015/11/16/000000/job_1447685373256_0005_conf.xml: MISSING 1 blocks of total size 104160 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0006-1447698681121-acadgild-wc-1447698706909-1-0-SUCCEEDED-default-1447698695036.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741897
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0006-1447698681121-acadgild-wc-1447698706909-1-0-SUCCEEDED-default-1447698695036.jhist: MISSING 1 blocks of total size 21064 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0006_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741898
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0006_conf.xml: MISSING 1 blocks of total size 104026 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0007-1447698859409-acadgild-wc-1447698885391-1-0-SUCCEEDED-default-1447698873344.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741907
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0007-1447698859409-acadgild-wc-1447698885391-1-0-SUCCEEDED-default-1447698873344.jhist: MISSING 1 blocks of total size 21076 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0007_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741908
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0007_conf.xml: MISSING 1 blocks of total size 104026 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0008-1447698993575-acadgild-wc-1447699036622-1-1-SUCCEEDED-default-1447699007165.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741917
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0008-1447698993575-acadgild-wc-1447699036622-1-1-SUCCEEDED-default-1447699007165.jhist: MISSING 1 blocks of total size 33343 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0008_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741918
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0008_conf.xml: MISSING 1 blocks of total size 104161 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0009-1447699274592-acadgild-wc-1447699315210-1-1-SUCCEEDED-default-1447699288376.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741927
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0009-1447699274592-acadgild-wc-1447699315210-1-1-SUCCEEDED-default-1447699288376.jhist: MISSING 1 blocks of total size 33355 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0009_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741928
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447685373256_0009_conf.xml: MISSING 1 blocks of total size 104161 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0001-1447705868365-acadgild-oozie%3Alauncher%3AT%3Dmap%2Dreduce%3AW%3DWorkFlowJavaMapReduc-1447705958418-1-0-SUCCEEDED-default-1447705921440.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742084
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0001-1447705868365-acadgild-oozie%3Alauncher%3AT%3Dmap%2Dreduce%3AW%3DWorkFlowJavaMapReduc-1447705958418-1-0-SUCCEEDED-default-1447705921440.jhist: MISSING 1 blocks of total size 21228 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0001_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742085
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0001_conf.xml: MISSING 1 blocks of total size 106468 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0002-1447705956180-acadgild-oozie%3Aaction%3AT%3Dmap%2Dreduce%3AW%3DWorkFlowJavaMapReduceA-1447706019542-1-1-SUCCEEDED-default-1447705987223.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742090
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0002-1447705956180-acadgild-oozie%3Aaction%3AT%3Dmap%2Dreduce%3AW%3DWorkFlowJavaMapReduceA-1447706019542-1-1-SUCCEEDED-default-1447705987223.jhist: MISSING 1 blocks of total size 33419 B..
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0002_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742091
/tmp/hadoop-yarn/staging/history/done/2015/11/17/000000/job_1447705543292_0002_conf.xml: MISSING 1 blocks of total size 107825 B..
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001-1447926402521-acadgild-wc-1447926443443-1-1-SUCCEEDED-default-1447926420056.jhist: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742100
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001-1447926402521-acadgild-wc-1447926443443-1-1-SUCCEEDED-default-1447926420056.jhist: MISSING 1 blocks of total size 33350 B..
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001.summary: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742099
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001.summary: MISSING 1 blocks of total size 343 B..
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001_conf.xml: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742101
/tmp/hadoop-yarn/staging/history/done_intermediate/acadgild/job_1447926339564_0001_conf.xml: MISSING 1 blocks of total size 104434 B..
/user/acadgild/share/lib/lib_20151117020012/distcp/hadoop-distcp-2.3.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741936
/user/acadgild/share/lib/lib_20151117020012/distcp/hadoop-distcp-2.3.0.jar: MISSING 1 blocks of total size 80628 B..
/user/acadgild/share/lib/lib_20151117020012/distcp/oozie-sharelib-distcp-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741935
/user/acadgild/share/lib/lib_20151117020012/distcp/oozie-sharelib-distcp-4.1.0.jar: MISSING 1 blocks of total size 2798 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ST4-4.0.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741980
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ST4-4.0.4.jar: MISSING 1 blocks of total size 236660 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ant-1.9.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741976
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ant-1.9.1.jar: MISSING 1 blocks of total size 1997485 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ant-launcher-1.9.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741987
/user/acadgild/share/lib/lib_20151117020012/hcatalog/ant-launcher-1.9.1.jar: MISSING 1 blocks of total size 18336 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/avro-1.7.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741982
/user/acadgild/share/lib/lib_20151117020012/hcatalog/avro-1.7.5.jar: MISSING 1 blocks of total size 400680 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/bonecp-0.8.0.RELEASE.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741972
/user/acadgild/share/lib/lib_20151117020012/hcatalog/bonecp-0.8.0.RELEASE.jar: MISSING 1 blocks of total size 110600 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-compress-1.4.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741990
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-compress-1.4.1.jar: MISSING 1 blocks of total size 241367 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-httpclient-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741983
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-httpclient-3.1.jar: MISSING 1 blocks of total size 305001 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-io-2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741994
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-io-2.1.jar: MISSING 1 blocks of total size 163151 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-lang3-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741986
/user/acadgild/share/lib/lib_20151117020012/hcatalog/commons-lang3-3.1.jar: MISSING 1 blocks of total size 315805 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/datanucleus-api-jdo-3.2.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741989
/user/acadgild/share/lib/lib_20151117020012/hcatalog/datanucleus-api-jdo-3.2.6.jar: MISSING 1 blocks of total size 339666 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/groovy-all-2.1.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741998
/user/acadgild/share/lib/lib_20151117020012/hcatalog/groovy-all-2.1.6.jar: MISSING 1 blocks of total size 6377448 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-ant-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741971
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-ant-0.13.1.jar: MISSING 1 blocks of total size 37246 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-common-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741970
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-common-0.13.1.jar: MISSING 1 blocks of total size 169834 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-exec-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741997
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-exec-0.13.1.jar: MISSING 1 blocks of total size 15141449 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-hcatalog-core-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741978
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-hcatalog-core-0.13.1.jar: MISSING 1 blocks of total size 467819 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-hcatalog-server-extensions-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741996
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-hcatalog-server-extensions-0.13.1.jar: MISSING 1 blocks of total size 67410 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-metastore-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741992
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-metastore-0.13.1.jar: MISSING 1 blocks of total size 4683135 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-serde-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741995
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-serde-0.13.1.jar: MISSING 1 blocks of total size 730750 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-webhcat-java-client-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741974
/user/acadgild/share/lib/lib_20151117020012/hcatalog/hive-webhcat-java-client-0.13.1.jar: MISSING 1 blocks of total size 78415 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/jdo-api-3.0.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741984
/user/acadgild/share/lib/lib_20151117020012/hcatalog/jdo-api-3.0.1.jar: MISSING 1 blocks of total size 201124 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/libfb303-0.7.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741981
/user/acadgild/share/lib/lib_20151117020012/hcatalog/libfb303-0.7.0.jar: MISSING 1 blocks of total size 175982 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oozie-hcatalog-0.13.1.oozie-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741991
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oozie-hcatalog-0.13.1.oozie-4.1.0.jar: MISSING 1 blocks of total size 2688 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oozie-sharelib-hcatalog-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741988
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oozie-sharelib-hcatalog-4.1.0.jar: MISSING 1 blocks of total size 10299 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oro-2.0.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741977
/user/acadgild/share/lib/lib_20151117020012/hcatalog/oro-2.0.8.jar: MISSING 1 blocks of total size 65261 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/paranamer-2.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741973
/user/acadgild/share/lib/lib_20151117020012/hcatalog/paranamer-2.3.jar: MISSING 1 blocks of total size 29555 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/snappy-java-1.0.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741975
/user/acadgild/share/lib/lib_20151117020012/hcatalog/snappy-java-1.0.5.jar: MISSING 1 blocks of total size 1251514 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/stax-api-1.0.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741985
/user/acadgild/share/lib/lib_20151117020012/hcatalog/stax-api-1.0.1.jar: MISSING 1 blocks of total size 26514 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/velocity-1.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741993
/user/acadgild/share/lib/lib_20151117020012/hcatalog/velocity-1.5.jar: MISSING 1 blocks of total size 392124 B..
/user/acadgild/share/lib/lib_20151117020012/hcatalog/xz-1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741979
/user/acadgild/share/lib/lib_20151117020012/hcatalog/xz-1.0.jar: MISSING 1 blocks of total size 94672 B..
/user/acadgild/share/lib/lib_20151117020012/hive/ST4-4.0.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742025
/user/acadgild/share/lib/lib_20151117020012/hive/ST4-4.0.4.jar: MISSING 1 blocks of total size 236660 B..
/user/acadgild/share/lib/lib_20151117020012/hive/activation-1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742057
/user/acadgild/share/lib/lib_20151117020012/hive/activation-1.1.jar: MISSING 1 blocks of total size 62983 B..
/user/acadgild/share/lib/lib_20151117020012/hive/ant-1.9.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742017
/user/acadgild/share/lib/lib_20151117020012/hive/ant-1.9.1.jar: MISSING 1 blocks of total size 1997485 B..
/user/acadgild/share/lib/lib_20151117020012/hive/ant-launcher-1.9.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742040
/user/acadgild/share/lib/lib_20151117020012/hive/ant-launcher-1.9.1.jar: MISSING 1 blocks of total size 18336 B..
/user/acadgild/share/lib/lib_20151117020012/hive/antlr-2.7.7.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742065
/user/acadgild/share/lib/lib_20151117020012/hive/antlr-2.7.7.jar: MISSING 1 blocks of total size 445288 B..
/user/acadgild/share/lib/lib_20151117020012/hive/antlr-runtime-3.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742030
/user/acadgild/share/lib/lib_20151117020012/hive/antlr-runtime-3.4.jar: MISSING 1 blocks of total size 164368 B..
/user/acadgild/share/lib/lib_20151117020012/hive/asm-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742071
/user/acadgild/share/lib/lib_20151117020012/hive/asm-3.1.jar: MISSING 1 blocks of total size 43033 B..
/user/acadgild/share/lib/lib_20151117020012/hive/asm-commons-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742001
/user/acadgild/share/lib/lib_20151117020012/hive/asm-commons-3.1.jar: MISSING 1 blocks of total size 32693 B..
/user/acadgild/share/lib/lib_20151117020012/hive/asm-tree-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742052
/user/acadgild/share/lib/lib_20151117020012/hive/asm-tree-3.1.jar: MISSING 1 blocks of total size 21879 B..
/user/acadgild/share/lib/lib_20151117020012/hive/avro-1.7.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742029
/user/acadgild/share/lib/lib_20151117020012/hive/avro-1.7.5.jar: MISSING 1 blocks of total size 400680 B..
/user/acadgild/share/lib/lib_20151117020012/hive/bonecp-0.8.0.RELEASE.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742006
/user/acadgild/share/lib/lib_20151117020012/hive/bonecp-0.8.0.RELEASE.jar: MISSING 1 blocks of total size 110600 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-cli-1.2.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742066
/user/acadgild/share/lib/lib_20151117020012/hive/commons-cli-1.2.jar: MISSING 1 blocks of total size 41123 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-codec-1.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742043
/user/acadgild/share/lib/lib_20151117020012/hive/commons-codec-1.4.jar: MISSING 1 blocks of total size 58160 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-collections-3.2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742050
/user/acadgild/share/lib/lib_20151117020012/hive/commons-collections-3.2.1.jar: MISSING 1 blocks of total size 575389 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-compress-1.4.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742049
/user/acadgild/share/lib/lib_20151117020012/hive/commons-compress-1.4.1.jar: MISSING 1 blocks of total size 241367 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-httpclient-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742031
/user/acadgild/share/lib/lib_20151117020012/hive/commons-httpclient-3.1.jar: MISSING 1 blocks of total size 305001 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-io-2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742059
/user/acadgild/share/lib/lib_20151117020012/hive/commons-io-2.1.jar: MISSING 1 blocks of total size 163151 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-lang-2.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742010
/user/acadgild/share/lib/lib_20151117020012/hive/commons-lang-2.4.jar: MISSING 1 blocks of total size 261809 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-lang3-3.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742039
/user/acadgild/share/lib/lib_20151117020012/hive/commons-lang3-3.1.jar: MISSING 1 blocks of total size 315805 B..
/user/acadgild/share/lib/lib_20151117020012/hive/commons-logging-1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742026
/user/acadgild/share/lib/lib_20151117020012/hive/commons-logging-1.1.jar: MISSING 1 blocks of total size 52915 B..
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-api-jdo-3.2.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742047
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-api-jdo-3.2.6.jar: MISSING 1 blocks of total size 339666 B..
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-core-3.2.10.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742070
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-core-3.2.10.jar: MISSING 1 blocks of total size 1890075 B..
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-rdbms-3.2.9.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742053
/user/acadgild/share/lib/lib_20151117020012/hive/datanucleus-rdbms-3.2.9.jar: MISSING 1 blocks of total size 1809447 B..
/user/acadgild/share/lib/lib_20151117020012/hive/derby-10.10.1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742009
/user/acadgild/share/lib/lib_20151117020012/hive/derby-10.10.1.1.jar: MISSING 1 blocks of total size 2831358 B..
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-annotation_1.0_spec-1.1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742044
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-annotation_1.0_spec-1.1.1.jar: MISSING 1 blocks of total size 12452 B..
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-jaspic_1.0_spec-1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742045
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-jaspic_1.0_spec-1.0.jar: MISSING 1 blocks of total size 30548 B..
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-jta_1.1_spec-1.1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742022
/user/acadgild/share/lib/lib_20151117020012/hive/geronimo-jta_1.1_spec-1.1.1.jar: MISSING 1 blocks of total size 16030 B..
/user/acadgild/share/lib/lib_20151117020012/hive/groovy-all-2.1.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742069
/user/acadgild/share/lib/lib_20151117020012/hive/groovy-all-2.1.6.jar: MISSING 1 blocks of total size 6377448 B..
/user/acadgild/share/lib/lib_20151117020012/hive/guava-11.0.2.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742013
/user/acadgild/share/lib/lib_20151117020012/hive/guava-11.0.2.jar: MISSING 1 blocks of total size 1648200 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-ant-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742005
/user/acadgild/share/lib/lib_20151117020012/hive/hive-ant-0.13.1.jar: MISSING 1 blocks of total size 37246 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-cli-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742035
/user/acadgild/share/lib/lib_20151117020012/hive/hive-cli-0.13.1.jar: MISSING 1 blocks of total size 36662 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-common-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742002
/user/acadgild/share/lib/lib_20151117020012/hive/hive-common-0.13.1.jar: MISSING 1 blocks of total size 169834 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-contrib-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742019
/user/acadgild/share/lib/lib_20151117020012/hive/hive-contrib-0.13.1.jar: MISSING 1 blocks of total size 114878 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-exec-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742067
/user/acadgild/share/lib/lib_20151117020012/hive/hive-exec-0.13.1.jar: MISSING 1 blocks of total size 15141449 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-metastore-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742051
/user/acadgild/share/lib/lib_20151117020012/hive/hive-metastore-0.13.1.jar: MISSING 1 blocks of total size 4683135 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-serde-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742060
/user/acadgild/share/lib/lib_20151117020012/hive/hive-serde-0.13.1.jar: MISSING 1 blocks of total size 730750 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-service-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742063
/user/acadgild/share/lib/lib_20151117020012/hive/hive-service-0.13.1.jar: MISSING 1 blocks of total size 1834865 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742042
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.13.1.jar: MISSING 1 blocks of total size 7585 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.20-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742046
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.20-0.13.1.jar: MISSING 1 blocks of total size 29790 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.20S-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742037
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.20S-0.13.1.jar: MISSING 1 blocks of total size 24998 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.23-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742011
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-0.23-0.13.1.jar: MISSING 1 blocks of total size 37733 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-common-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742058
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-common-0.13.1.jar: MISSING 1 blocks of total size 38800 B..
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-common-secure-0.13.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742048
/user/acadgild/share/lib/lib_20151117020012/hive/hive-shims-common-secure-0.13.1.jar: MISSING 1 blocks of total size 74742 B..
/user/acadgild/share/lib/lib_20151117020012/hive/httpclient-4.1.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742054
/user/acadgild/share/lib/lib_20151117020012/hive/httpclient-4.1.3.jar: MISSING 1 blocks of total size 352585 B..
/user/acadgild/share/lib/lib_20151117020012/hive/httpcore-4.1.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742004
/user/acadgild/share/lib/lib_20151117020012/hive/httpcore-4.1.3.jar: MISSING 1 blocks of total size 181201 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jackson-core-asl-1.8.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742041
/user/acadgild/share/lib/lib_20151117020012/hive/jackson-core-asl-1.8.8.jar: MISSING 1 blocks of total size 227500 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jackson-mapper-asl-1.8.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742068
/user/acadgild/share/lib/lib_20151117020012/hive/jackson-mapper-asl-1.8.8.jar: MISSING 1 blocks of total size 668564 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jdo-api-3.0.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742032
/user/acadgild/share/lib/lib_20151117020012/hive/jdo-api-3.0.1.jar: MISSING 1 blocks of total size 201124 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-6.1.14.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742015
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-6.1.14.jar: MISSING 1 blocks of total size 516429 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-all-7.6.0.v20120127.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742023
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-all-7.6.0.v20120127.jar: MISSING 1 blocks of total size 1681148 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-util-6.1.26.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742064
/user/acadgild/share/lib/lib_20151117020012/hive/jetty-util-6.1.26.jar: MISSING 1 blocks of total size 177131 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jline-0.9.94.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742038
/user/acadgild/share/lib/lib_20151117020012/hive/jline-0.9.94.jar: MISSING 1 blocks of total size 87325 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jpam-1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742020
/user/acadgild/share/lib/lib_20151117020012/hive/jpam-1.1.jar: MISSING 1 blocks of total size 12131 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jsr305-1.3.9.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742007
/user/acadgild/share/lib/lib_20151117020012/hive/jsr305-1.3.9.jar: MISSING 1 blocks of total size 33015 B..
/user/acadgild/share/lib/lib_20151117020012/hive/jta-1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742062
/user/acadgild/share/lib/lib_20151117020012/hive/jta-1.1.jar: MISSING 1 blocks of total size 15071 B..
/user/acadgild/share/lib/lib_20151117020012/hive/libfb303-0.7.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742027
/user/acadgild/share/lib/lib_20151117020012/hive/libfb303-0.7.0.jar: MISSING 1 blocks of total size 175982 B..
/user/acadgild/share/lib/lib_20151117020012/hive/libthrift-0.9.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742012
/user/acadgild/share/lib/lib_20151117020012/hive/libthrift-0.9.0.jar: MISSING 1 blocks of total size 347531 B..
/user/acadgild/share/lib/lib_20151117020012/hive/log4j-1.2.16.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742021
/user/acadgild/share/lib/lib_20151117020012/hive/log4j-1.2.16.jar: MISSING 1 blocks of total size 481535 B..
/user/acadgild/share/lib/lib_20151117020012/hive/mail-1.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742003
/user/acadgild/share/lib/lib_20151117020012/hive/mail-1.4.jar: MISSING 1 blocks of total size 388864 B..
/user/acadgild/share/lib/lib_20151117020012/hive/oozie-sharelib-hive-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742028
/user/acadgild/share/lib/lib_20151117020012/hive/oozie-sharelib-hive-4.1.0.jar: MISSING 1 blocks of total size 9997 B..
/user/acadgild/share/lib/lib_20151117020012/hive/oro-2.0.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742018
/user/acadgild/share/lib/lib_20151117020012/hive/oro-2.0.8.jar: MISSING 1 blocks of total size 65261 B..
/user/acadgild/share/lib/lib_20151117020012/hive/paranamer-2.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742008
/user/acadgild/share/lib/lib_20151117020012/hive/paranamer-2.3.jar: MISSING 1 blocks of total size 29555 B..
/user/acadgild/share/lib/lib_20151117020012/hive/servlet-api-2.5-6.1.14.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742061
/user/acadgild/share/lib/lib_20151117020012/hive/servlet-api-2.5-6.1.14.jar: MISSING 1 blocks of total size 132368 B..
/user/acadgild/share/lib/lib_20151117020012/hive/slf4j-api-1.6.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742036
/user/acadgild/share/lib/lib_20151117020012/hive/slf4j-api-1.6.6.jar: MISSING 1 blocks of total size 26176 B..
/user/acadgild/share/lib/lib_20151117020012/hive/slf4j-log4j12-1.6.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742034
/user/acadgild/share/lib/lib_20151117020012/hive/slf4j-log4j12-1.6.6.jar: MISSING 1 blocks of total size 9711 B..
/user/acadgild/share/lib/lib_20151117020012/hive/snappy-java-1.0.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742016
/user/acadgild/share/lib/lib_20151117020012/hive/snappy-java-1.0.5.jar: MISSING 1 blocks of total size 1251514 B..
/user/acadgild/share/lib/lib_20151117020012/hive/stax-api-1.0.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742033
/user/acadgild/share/lib/lib_20151117020012/hive/stax-api-1.0.1.jar: MISSING 1 blocks of total size 26514 B..
/user/acadgild/share/lib/lib_20151117020012/hive/stringtemplate-3.2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742014
/user/acadgild/share/lib/lib_20151117020012/hive/stringtemplate-3.2.1.jar: MISSING 1 blocks of total size 148627 B..
/user/acadgild/share/lib/lib_20151117020012/hive/velocity-1.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742056
/user/acadgild/share/lib/lib_20151117020012/hive/velocity-1.5.jar: MISSING 1 blocks of total size 392124 B..
/user/acadgild/share/lib/lib_20151117020012/hive/xz-1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742024
/user/acadgild/share/lib/lib_20151117020012/hive/xz-1.0.jar: MISSING 1 blocks of total size 94672 B..
/user/acadgild/share/lib/lib_20151117020012/hive/zookeeper-3.4.5.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742055
/user/acadgild/share/lib/lib_20151117020012/hive/zookeeper-3.4.5.jar: MISSING 1 blocks of total size 779974 B..
/user/acadgild/share/lib/lib_20151117020012/mapreduce-streaming/hadoop-streaming-2.3.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741999
/user/acadgild/share/lib/lib_20151117020012/mapreduce-streaming/hadoop-streaming-2.3.0.jar: MISSING 1 blocks of total size 104923 B..
/user/acadgild/share/lib/lib_20151117020012/mapreduce-streaming/oozie-sharelib-streaming-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742000
/user/acadgild/share/lib/lib_20151117020012/mapreduce-streaming/oozie-sharelib-streaming-4.1.0.jar: MISSING 1 blocks of total size 5629 B..
/user/acadgild/share/lib/lib_20151117020012/oozie/json-simple-1.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741939
/user/acadgild/share/lib/lib_20151117020012/oozie/json-simple-1.1.jar: MISSING 1 blocks of total size 16046 B..
/user/acadgild/share/lib/lib_20151117020012/oozie/oozie-hadoop-utils-2.3.0.oozie-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741938
/user/acadgild/share/lib/lib_20151117020012/oozie/oozie-hadoop-utils-2.3.0.oozie-4.1.0.jar: MISSING 1 blocks of total size 3221 B..
/user/acadgild/share/lib/lib_20151117020012/oozie/oozie-sharelib-oozie-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741937
/user/acadgild/share/lib/lib_20151117020012/oozie/oozie-sharelib-oozie-4.1.0.jar: MISSING 1 blocks of total size 41608 B..
/user/acadgild/share/lib/lib_20151117020012/pig/ST4-4.0.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741949
/user/acadgild/share/lib/lib_20151117020012/pig/ST4-4.0.4.jar: MISSING 1 blocks of total size 236660 B..
/user/acadgild/share/lib/lib_20151117020012/pig/antlr-2.7.7.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741961
/user/acadgild/share/lib/lib_20151117020012/pig/antlr-2.7.7.jar: MISSING 1 blocks of total size 445288 B..
/user/acadgild/share/lib/lib_20151117020012/pig/antlr-runtime-3.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741951
/user/acadgild/share/lib/lib_20151117020012/pig/antlr-runtime-3.4.jar: MISSING 1 blocks of total size 164368 B..
/user/acadgild/share/lib/lib_20151117020012/pig/automaton-1.11-8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741946
/user/acadgild/share/lib/lib_20151117020012/pig/automaton-1.11-8.jar: MISSING 1 blocks of total size 176285 B..
/user/acadgild/share/lib/lib_20151117020012/pig/avro-1.7.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741944
/user/acadgild/share/lib/lib_20151117020012/pig/avro-1.7.4.jar: MISSING 1 blocks of total size 303139 B..
/user/acadgild/share/lib/lib_20151117020012/pig/commons-cli-1.2.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741963
/user/acadgild/share/lib/lib_20151117020012/pig/commons-cli-1.2.jar: MISSING 1 blocks of total size 41123 B..
/user/acadgild/share/lib/lib_20151117020012/pig/commons-codec-1.4.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741956
/user/acadgild/share/lib/lib_20151117020012/pig/commons-codec-1.4.jar: MISSING 1 blocks of total size 58160 B..
/user/acadgild/share/lib/lib_20151117020012/pig/commons-compress-1.4.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741957
/user/acadgild/share/lib/lib_20151117020012/pig/commons-compress-1.4.1.jar: MISSING 1 blocks of total size 241367 B..
/user/acadgild/share/lib/lib_20151117020012/pig/commons-net-1.4.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741947
/user/acadgild/share/lib/lib_20151117020012/pig/commons-net-1.4.1.jar: MISSING 1 blocks of total size 180792 B..
/user/acadgild/share/lib/lib_20151117020012/pig/guava-11.0.2.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741942
/user/acadgild/share/lib/lib_20151117020012/pig/guava-11.0.2.jar: MISSING 1 blocks of total size 1648200 B..
/user/acadgild/share/lib/lib_20151117020012/pig/hsqldb-1.8.0.10.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741950
/user/acadgild/share/lib/lib_20151117020012/pig/hsqldb-1.8.0.10.jar: MISSING 1 blocks of total size 706710 B..
/user/acadgild/share/lib/lib_20151117020012/pig/jackson-core-asl-1.8.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741955
/user/acadgild/share/lib/lib_20151117020012/pig/jackson-core-asl-1.8.8.jar: MISSING 1 blocks of total size 227500 B..
/user/acadgild/share/lib/lib_20151117020012/pig/jackson-mapper-asl-1.8.8.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741964
/user/acadgild/share/lib/lib_20151117020012/pig/jackson-mapper-asl-1.8.8.jar: MISSING 1 blocks of total size 668564 B..
/user/acadgild/share/lib/lib_20151117020012/pig/jline-0.9.94.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741954
/user/acadgild/share/lib/lib_20151117020012/pig/jline-0.9.94.jar: MISSING 1 blocks of total size 87325 B..
/user/acadgild/share/lib/lib_20151117020012/pig/joda-time-2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741958
/user/acadgild/share/lib/lib_20151117020012/pig/joda-time-2.1.jar: MISSING 1 blocks of total size 570478 B..
/user/acadgild/share/lib/lib_20151117020012/pig/jsr305-1.3.9.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741940
/user/acadgild/share/lib/lib_20151117020012/pig/jsr305-1.3.9.jar: MISSING 1 blocks of total size 33015 B..
/user/acadgild/share/lib/lib_20151117020012/pig/jython-2.5.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741952
/user/acadgild/share/lib/lib_20151117020012/pig/jython-2.5.3.jar: MISSING 1 blocks of total size 8302357 B..
/user/acadgild/share/lib/lib_20151117020012/pig/oozie-sharelib-pig-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741959
/user/acadgild/share/lib/lib_20151117020012/pig/oozie-sharelib-pig-4.1.0.jar: MISSING 1 blocks of total size 19282 B..
/user/acadgild/share/lib/lib_20151117020012/pig/paranamer-2.3.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741941
/user/acadgild/share/lib/lib_20151117020012/pig/paranamer-2.3.jar: MISSING 1 blocks of total size 29555 B..
/user/acadgild/share/lib/lib_20151117020012/pig/pig-0.12.1-h2.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741962
/user/acadgild/share/lib/lib_20151117020012/pig/pig-0.12.1-h2.jar: MISSING 1 blocks of total size 3656505 B..
/user/acadgild/share/lib/lib_20151117020012/pig/slf4j-api-1.6.6.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741953
/user/acadgild/share/lib/lib_20151117020012/pig/slf4j-api-1.6.6.jar: MISSING 1 blocks of total size 26176 B..
/user/acadgild/share/lib/lib_20151117020012/pig/snappy-java-1.0.4.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741945
/user/acadgild/share/lib/lib_20151117020012/pig/snappy-java-1.0.4.1.jar: MISSING 1 blocks of total size 995968 B..
/user/acadgild/share/lib/lib_20151117020012/pig/stringtemplate-3.2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741943
/user/acadgild/share/lib/lib_20151117020012/pig/stringtemplate-3.2.1.jar: MISSING 1 blocks of total size 148627 B..
/user/acadgild/share/lib/lib_20151117020012/pig/xmlenc-0.52.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741960
/user/acadgild/share/lib/lib_20151117020012/pig/xmlenc-0.52.jar: MISSING 1 blocks of total size 15010 B..
/user/acadgild/share/lib/lib_20151117020012/pig/xz-1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741948
/user/acadgild/share/lib/lib_20151117020012/pig/xz-1.0.jar: MISSING 1 blocks of total size 94672 B..
/user/acadgild/share/lib/lib_20151117020012/sharelib.properties: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741969
/user/acadgild/share/lib/lib_20151117020012/sharelib.properties: MISSING 1 blocks of total size 1348 B..
/user/acadgild/share/lib/lib_20151117020012/sqoop/commons-io-2.1.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741967
/user/acadgild/share/lib/lib_20151117020012/sqoop/commons-io-2.1.jar: MISSING 1 blocks of total size 163151 B..
/user/acadgild/share/lib/lib_20151117020012/sqoop/hsqldb-1.8.0.10.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741966
/user/acadgild/share/lib/lib_20151117020012/sqoop/hsqldb-1.8.0.10.jar: MISSING 1 blocks of total size 706710 B..
/user/acadgild/share/lib/lib_20151117020012/sqoop/oozie-sharelib-sqoop-4.1.0.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741965
/user/acadgild/share/lib/lib_20151117020012/sqoop/oozie-sharelib-sqoop-4.1.0.jar: MISSING 1 blocks of total size 7895 B..
/user/acadgild/share/lib/lib_20151117020012/sqoop/sqoop-1.4.3-hadoop200.jar: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741968
/user/acadgild/share/lib/lib_20151117020012/sqoop/sqoop-1.4.3-hadoop200.jar: MISSING 1 blocks of total size 658429 B...
/wc_out/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741885
/wc_out/part-r-00000: MISSING 1 blocks of total size 40 B...
/wc_out1/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741875
/wc_out1/part-r-00000: MISSING 1 blocks of total size 40 B...
/wc_out2/part-m-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741894
/wc_out2/part-m-00000: MISSING 1 blocks of total size 40 B...
/wc_out3/part-m-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741904
/wc_out3/part-m-00000: MISSING 1 blocks of total size 570 B...
/wc_out4/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741915
/wc_out4/part-r-00000: MISSING 1 blocks of total size 424 B...
/wc_out5/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073741925
/wc_out5/part-r-00000: MISSING 1 blocks of total size 424 B...
/wc_out6/part-r-00000: CORRUPT blockpool BP-695350366-127.0.0.1-1446620353823 block blk_1073742098
/wc_out6/part-r-00000: MISSING 1 blocks of total size 424 B.Status: CORRUPT
Total size:    108205639 B
Total dirs:    73
Total files:   196
Total symlinks:                0
Total blocks (validated):      187 (avg. block size 578639 B)
 ********************************
 CORRUPT FILES:        187
 MISSING BLOCKS:       187
 MISSING SIZE:         108205639 B
 CORRUPT BLOCKS:       187
 ********************************
Corrupt blocks:                187
Number of data-nodes:          1
Number of racks:               1
FSCK ended at Thu Oct 06 13:41:39 IST 2016 in 97 milliseconds
The filesystem under path '/' is CORRUPT

 
is there sensitive data that needs to be regenerated?

If it is not possible to replace! How to fix corrupt blocks in HDFS file.

Repairing might or might not be possible, but the first step would be to gather information of the file’s location, and blocks.

hdfs fsck /path/to/filename/fileextension -locations -blocks -files

From this data, you can track down the node where the corruption is present. On those nodes, you can look through logs and determine what the issue is. If a disk was replaced, i/o errors on the server, etc. If possible to recover on that machine and get the partition with the blocks online that would report back to Hadoop and the file would be healthy again. If that isn’t possible, you will unfortunately, have to find another way to regenerate.
We can also delete the corrupted file from Hadoop cluster:

How to remove the corrupted file from Hadoop cluster?

Use this command to move corrupted files to the trash directory:

hdfs dfs -rm /path/to/filename.fileextension

Use this command to delete corrupted file permanently:

hdfs dfs -rm -skipTrash /path/to/filename.fileextension

We hope this blog helped you in understanding the troubleshooting of Hive metadata. Keep visiting our site www.acadgild.com for more details on Big Data and other technologies.
Spark

Tags

One Comment

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles

Close