Need to make cassandra not use 35357 (to be used for keystone)

[Vedamurthy Joshi]

build 3.0 2487 Centos 6.4 Multinode setup

http://anamika.englab.juniper.net:8080/job/centos64_os_icehouse_Multi_Node_Sanity/70/

Keystone and cassandra are installed on the same node.

From the sanity prov logs, looks like cassandra is already listening on 35357 causing keystone not to start.

[root@nodei1 keystone]# netstat -anp |grep 35357
tcp 0 0 0.0.0.0:35357 0.0.0.0:* LISTEN 9638/java
[root@nodei1 keystone]# ps aux |grep 9638
root 9638 0.8 0.3 25913320 622212 ? Sl 12:34 0:14 java -ea -javaagent:/usr/share/cassandra/lib/jamm-0.2.5.jar -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -Xms8192M -Xmx8192M -Xmn2048M -XX:+HeapDumpOnOutOfMemoryError -Xss512k -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+UseTLAB -XX:+UseCondCardMark -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:PrintFLSStatistics=1 -Xloggc:/var/log/cassandra/gc-1417244665.log -Djava.net.preferIPv4Stack=true -Dcom.sun.management.jmxremote.port=7199 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dlog4j.configuration=log4j-server.properties -Dlog4j.defaultInitOverride=true -Dcassandra-foreground=yes -cp /etc/cassandra/conf:/usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/apache-cassandra-1.2.11.jar:/usr/share/cassandra/lib/apache-cassandra-clientutil-1.2.11.jar:/usr/share/cassandra/lib/apache-cassandra-thrift-1.2.11.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.6.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.3.jar:/usr/share/cassandra/lib/guava-13.0.1.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.9.2.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.9.2.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jbcrypt-0.3m.jar:/usr/share/cassandra/lib/jline-1.0.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.7.0.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/lz4-1.1.0.jar:/usr/share/cassandra/lib/metrics-core-2.2.0.jar:/usr/share/cassandra/lib/netty-3.6.6.Final.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.7.2.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.7.2.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.5.jar:/usr/share/cassandra/lib/snaptree-0.1.jar:/usr/share/cassandra/lib/stress.jar org.apache.cassandra.service.CassandraDaemon
root 13789 0.0 0.0 103240 884 pts/0 S+ 13:05 0:00 grep 9638
[root@nodei1 keystone]# tail keystone.log
2014-11-29 12:35:26.049 11208 TRACE root server.start()
2014-11-29 12:35:26.049 11208 TRACE root File "/usr/lib/python2.6/site-packages/keystone/common/environment/eventlet_server.py", line 66, in start
2014-11-29 12:35:26.049 11208 TRACE root backlog=backlog)
2014-11-29 12:35:26.049 11208 TRACE root File "/usr/lib/python2.6/site-packages/eventlet/convenience.py", line 38, in listen
2014-11-29 12:35:26.049 11208 TRACE root sock.bind(addr)
2014-11-29 12:35:26.049 11208 TRACE root File "<string>", line 1, in bind
2014-11-29 12:35:26.049 11208 TRACE root error: [Errno 98] Address already in use
2014-11-29 12:35:26.049 11208 TRACE root
2014-11-29 12:35:26.050 11208 CRITICAL keystone [-] error: [Errno 98] Address already in use

[root@nodei1 keystone]# service keystone status
keystone FATAL Exited too quickly (process log may have details)
[root@nodei1 keystone]#

[root@nodei1 log]# lsof -p 9638 |grep LIST
java 9638 root 42u IPv4 93063 0t0 TCP *:35357 (LISTEN)
java 9638 root 43u IPv4 93064 0t0 TCP *:7199 (LISTEN)
java 9638 root 44u IPv4 93065 0t0 TCP *:33215 (LISTEN)
java 9638 root 50u IPv4 93156 0t0 TCP nodei1:afs3-fileserver (LISTEN)
java 9638 root 249u IPv4 93237 0t0 TCP nodei1:9042 (LISTEN)
java 9638 root 250u IPv4 93238 0t0 TCP nodei1:apani1 (LISTEN)
[root@nodei1 log]#

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/9277
Submitter: Ignatious Johnson Christopher (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Review in progress for https://review.opencontrail.org/9278
Submitter: Ignatious Johnson Christopher (<email address hidden>)

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/9277
Committed: http://github.org/Juniper/contrail-fabric-utils/commit/5bc1a5b0a042ab7aeadb2f85c43112f636df5859
Submitter: Zuul
Branch: R2.20

commit 5bc1a5b0a042ab7aeadb2f85c43112f636df5859
Author: Ignatious Johnson Christopher <email address hidden>
Date: Sun Apr 19 14:32:27 2015 -0700

Reserving ports before starting any provisioning.

Change-Id: I0da94a56dcd989c9857a6b6cfe6cf0bbea3decbf
Closes-Bug: 1397499

[OpenContrail Admin (ci-admin-f)]

Reviewed: https://review.opencontrail.org/9278
Committed: http://github.org/Juniper/contrail-fabric-utils/commit/e2ae551d1412a9b9c7bcc1ad44366793c2f53720
Submitter: Zuul
Branch: master

commit e2ae551d1412a9b9c7bcc1ad44366793c2f53720
Author: Ignatious Johnson Christopher <email address hidden>
Date: Sun Apr 19 14:36:25 2015 -0700

Reserving ports before starting any provisioning.

Change-Id: I21b2e20141d41eb4574a70c0bc351d8a40f30b36
Closes-Bug: 1397499