Invalid directory configuration in CDH

Bug #1690635 reported by The Coon
18
This bug affects 4 people
Affects Status Importance Assigned to Milestone
Sahara
New
Undecided
Unassigned

Bug Description

CDH 5.9 clusters (tested for 5.9, may affect more versions) start with 4 configuration errors:
Missing required value: DataNode Data Directory
Missing required value: HDFS Checkpoint Directories
Missing required value: NameNode Data Directories
Missing required value: NodeManager Local Directories
HDFS commands do work, but Cloudera Manager still shows errors, and those values can't be changed when creating the cluster.
Some default value is given to those properties, and is scoped for the specific nodes containing those roles. For example, for Datanode data directory the value is /mnt/fs/dn. Cloudera Manager doesn't accept those, probably because the scope is of individual nodes and not the role default group. Adding the same directory in the role scope fixed the problem.
I tried manually configuring those values in the Sahara GUI, but they don't get updated, and always get those default values. I searched the code and didn't find any place where those properties are set.

Revision history for this message
Shu Yingya (felixshu) wrote :

this do reproduce on my env, and need deep investigation.

The Coon (thec00n)
Changed in sahara:
status: New → Incomplete
status: Incomplete → New
Revision history for this message
masreis (ma-g) wrote :

I'm facing the same problem with plugin 5.11.0

HDFS is working:
[root@cdh-c-cdh-m-0 ~]# hdfs dfs -ls /
Found 2 items
drwxrwxrwt - hdfs supergroup 0 2018-02-16 13:42 /tmp
drwxr-xr-x - hdfs supergroup 0 2018-02-16 13:43 /user

But the messages are still present, for example;
Missing required value: DataNode Data Directory

Even when the directory is configured:
/mnt/fs/dn

The same occurs in Centos7 e Ubuntu.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.