Juju Charms Collection
hadoop package

  1. Bug #1336309
  2. Comment #5

Comment 5 for bug 1336309

Revision history for this message
amir sanjar (asanjar) wrote :

Graceful datanode shutdown, as it was implemented above, is an appropriate method of shutting down the datanode and nodemanager to reduce HDFS and YARN metadata corruption. However, after lengthy discussion with HDFS community, it will not solve the scale-down issue reported by this bug. As of now, there are only two ways that namenode gets modified of a data shutdown:
1) Shutdown the datanode directly from namenode (mark the node as discarded)
2) Heartbeat timeout for datanode. The current default value is 10 minutes.
workaround will be to make value of "dfs.heartbeat.recheck.interval" configurable by Juju.