ZooKeeper configuration error

[Samuel Cozannet]

When deploying with

juju deploy hdp-zookeeper

the configuration on the zookeeper node that is created looks like:

ubuntu@scozannet-local-machine-2:~$ cat /etc/zookeeper/conf/zoo.cfg
#
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#
#
#

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
dataDir=/grid/hadoop/zookeeper/data
# the port at which the clients will connect
clientPort=2181
server.1=TODO-ZKSERVER-HOSTNAME:2888:3888
# server.2=TODO-ZKSERVER-HOSTNAME:2888:3888
# server.3=TODO-ZKSERVER-HOSTNAME:2888:3888
server.0=10.0.3.54:2888:3888

As you can see there is a line with "server.1 = " that is configured with real data. This blocks ZooKeeper and it doesn't start at all. It is impossible to integrate other apps with it.

[amir sanjar (asanjar)]

I just ran a test on hdp-zookeeper quorum ( 3 nodes as required by hortonworks)
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
dataDir=/grid/hadoop/zookeeper/data
# the port at which the clients will connect
clientPort=2181
server.1=10.0.3.217:2888:3888
# server.2=TODO-ZKSERVER-HOSTNAME:2888:3888
# server.3=TODO-ZKSERVER-HOSTNAME:2888:3888
server.0=10.0.3.26:2888:3888
server.2=10.0.3.107:2888:3888

It looks like you are using a standalone zookeeper node and not quorum, a practice that is not used
in production environment. This charm was design based on hortonworks quorum requirement based
on real production scenarios (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_installing_manually_book/content/rpm-zookeeper-3.html).
However, modification for a single node quorum should not be difficult. Again, do strongly recommend to not use a single node
zookeeper in any production scenario.

[Samuel Cozannet (samuel-cozannet)]

Hi Amir,

I get the quorum idea for 3 nodes. However for simple testing using 3
servers is a bit costly, I'd rather have a system were I can deploy a
single instance, then move it to production in a second step. I think that
is what people do and expect.

Is there a way to fix even if it's not production ready to have a single
server?

Best,
Samuel

--
Samuel Cozannet
Cloud, Big Data and IoT Strategy Team
Strategic Program Manager
Changing the Future of Cloud
Ubuntu <http://ubuntu.com> / Canonical <http://canonical.com> UK LTD
<email address hidden>
[phone]

On Wed, Nov 26, 2014 at 4:08 PM, amir sanjar <email address hidden>
wrote:

> I just ran a test on hdp-zookeeper quorum ( 3 nodes as required by
> hortonworks)
> tickTime=2000
> # The number of ticks that the initial
> # synchronization phase can take
> initLimit=10
> # The number of ticks that can pass between
> # sending a request and getting an acknowledgement
> syncLimit=5
> # the directory where the snapshot is stored.
> dataDir=/grid/hadoop/zookeeper/data
> # the port at which the clients will connect
> clientPort=2181
> server.1=10.0.3.217:2888:3888
> # server.2=TODO-ZKSERVER-HOSTNAME:2888:3888
> # server.3=TODO-ZKSERVER-HOSTNAME:2888:3888
> server.0=10.0.3.26:2888:3888
> server.2=10.0.3.107:2888:3888
>
> It looks like you are using a standalone zookeeper node and not quorum, a
> practice that is not used
> in production environment. This charm was design based on hortonworks
> quorum requirement based
> on real production scenarios (
> http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_installing_manually_book/content/rpm-zookeeper-3.html
> ).
> However, modification for a single node quorum should not be difficult.
> Again, do strongly recommend to not use a single node
> zookeeper in any production scenario.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1396525
>
> Title:
> ZooKeeper configuration error
>
> Status in “hdp-zookeeper” package in Juju Charms Collection:
> New
>
> Bug description:
> When deploying with
>
> juju deploy hdp-zookeeper
>
> the configuration on the zookeeper node that is created looks like:
>
> ubuntu@scozannet-local-machine-2:~$ cat /etc/zookeeper/conf/zoo.cfg
> #
> #
> # Licensed to the Apache Software Foundation (ASF) under one
> # or more contributor license agreements. See the NOTICE file
> # distributed with this work for additional information
> # regarding copyright ownership. The ASF licenses this file
> # to you under the Apache License, Version 2.0 (the
> # "License"); you may not use this file except in compliance
> # with the License. You may obtain a copy of the License at
> #
> # http://www.apache.org/licenses/LICENSE-2.0
> #
> # Unless required by applicable law or agreed to in writing,
> # software distributed under the License is distributed on an
> # "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
> # KIND, either express or implied. See the License for the
> # specific language governing permissions and limitations
> # under the License.
> #
> #
> #
>
> #...