core file from shell during shutdown
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Trafodion |
New
|
Low
|
Gonzalo Correa |
Bug Description
Change 332 had a failure in core-regress-
http://
Shutting down (normal) the SQ environment!
Fri Sep 5 18:52:26 UTC 2014
Processing cluster.conf on local host slave01
[$Z000BBN] Shell/shell Version 1.0.1 Release 0.8.4 (Build release [0.8.3rc1-
ps
[$Z000BBN] %ps
[$Z000BBN] NID,PID(os) PRI TYPE STATES NAME PARENT PROGRAM
[$Z000BBN] ------------ --- ---- ------- ----------- ----------- ---------------
[$Z000BBN] 000,00031016 000 WDG ES--A-- $WDT000 NONE sqwatchdog
[$Z000BBN] 000,00031017 000 PSD ES--A-- $PSD000 NONE pstartd
[$Z000BBN] 000,00031061 001 DTM ES--A-- $TM0 NONE tm
[$Z000BBN] 000,00013883 001 GEN ES--A-- $Z000BBN NONE shell
[$Z000BBN] 001,00031018 000 PSD ES--A-- $PSD001 NONE pstartd
[$Z000BBN] 001,00031015 000 WDG ES--A-- $WDT001 NONE sqwatchdog
[$Z000BBN] 001,00031139 001 DTM ES--A-- $TM1 NONE tm
shutdown
[$Z000BBN] %shutdown
/home/jenkins/
Issued a 'shutdown normal' request
Shutdown in progress
# of SQ processes: 0
SQ Shutdown (normal) from /home/jenkins/
Fri Sep 5 18:52:34 UTC 2014
+ ret=0
+ [[ 0 == 124 ]]
+ echo 'Return code 0'
Return code 0
+ sudo /usr/local/
Stopping hbase-master
Stopping HBase master daemon (hbase-master):[ OK ]
stopping master.....
Return code 0
+ echo 'Return code 0'
Return code 0
+ cd ../../sqf/rundir
+ set +x
========= seabase
09/05/14 18:21:07 (RELEASE build)
09/05/14 18:23:51 TEST010 ### PASS ###
09/05/14 18:25:38 TEST011 ### PASS ###
09/05/14 18:27:46 TEST012 ### PASS ###
09/05/14 18:29:36 TEST013 ### PASS ###
09/05/14 18:29:50 TEST014 ### PASS ###
09/05/14 18:32:05 TEST016 ### PASS ###
09/05/14 18:32:35 TEST018 ### PASS ###
09/05/14 18:50:28 TEST020 ### PASS ###
09/05/14 18:50:44 TEST022 ### PASS ###
09/05/14 18:52:26 TEST024 ### PASS ###
09/05/14 18:21:07 - 18:52:26 (RELEASE build)
WARNING: Core files found in /home/jenkins/
-rw-------. 1 jenkins jenkins 44552192 Sep 5 18:52 sql/regress/
=======
Total Passed: 10
Total Failures: 0
Failure : Found 1 core files
Build step 'Execute shell' marked build as failure
The core file's back trace is:
-bash-4.1$ core_bt -d sql/regress
core file : -rw-------. 1 jenkins jenkins 44552192 Sep 5 18:52 sql/regress/
gdb command: gdb shell sql/regress/
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo=
[New Thread 13884]
[New Thread 13883]
[Thread debugging using libthread_db enabled]
Core was generated by `shell -a'.
Program terminated with signal 6, Aborted.
#0 0x00000030ada32635 in raise () from /lib64/libc.so.6
#0 0x00000030ada32635 in raise () from /lib64/libc.so.6
#1 0x00000030ada33e15 in abort () from /lib64/libc.so.6
#2 0x0000000000411982 in LIOTM_assert_fun (pp_exp=0x4d4f40 "0", pp_file=0x4d175e "clio.cxx", pv_line=1022, pp_fun=0x4d2d60 "int Local_IO_
#3 0x0000000000413b26 in Local_IO_
#4 0x0000000000413e03 in Local_IO_
#5 0x0000000000414075 in local_monitor_
#6 0x00000030ae2079d1 in start_thread () from /lib64/
#7 0x00000030adae886d in clone () from /lib64/libc.so.6
tags: | added: foundation |
Changed in trafodion: | |
importance: | Undecided → Low |
milestone: | r1.0 → r1.2 |
Change 371 encountered a similar stack trace.
http:// logs.trafodion. org/71/ 371/1/gate/ core-regress- seabase- cdh4.4/ f25a75e/ console. html has
[$Z000FM5] %shutdown workspace/ core-regress- seabase- cdh4.4/ trafodion/ core/sqf/ sql/scripts/ sqshell: line 7: 19150 Aborted (core dumped) shell $1 $2 $3 $4 $5 $6 $7 $8 $9
[$Z000FM5] Shutdown notice, level=0 received
/home/jenkins/
Issued a 'shutdown normal' request
Shutdown in progress
# of SQ processes: 0 workspace/ core-regress- seabase- cdh4.4/ trafodion/ core/sql/ regress Successful bin/hbase- sudo.sh stop
SQ Shutdown (normal) from /home/jenkins/
Tue Sep 9 19:08:39 UTC 2014
+ ret=0
+ [[ 0 == 124 ]]
+ echo 'Return code 0'
Return code 0
+ sudo /usr/local/
Stopping hbase-master
Stopping HBase master daemon (hbase-master):[ OK ]
stopping master........
Return code 0
+ echo 'Return code 0'
Return code 0
+ cd ../../sqf/rundir
+ set +x
========= seabase
09/09/14 18:36:24 (RELEASE build)
09/09/14 18:39:10 TEST010 ### PASS ###
09/09/14 18:40:49 TEST011 ### PASS ###
09/09/14 18:43:03 TEST012 ### PASS ###
09/09/14 18:44:57 TEST013 ### PASS ###
09/09/14 18:45:11 TEST014 ### PASS ###
09/09/14 18:47:31 TEST016 ### PASS ###
09/09/14 18:48:00 TEST018 ### PASS ###
09/09/14 19:06:28 TEST020 ### PASS ###
09/09/14 19:06:45 TEST022 ### PASS ###
09/09/14 19:08:32 TEST024 ### PASS ###
09/09/14 18:36:24 - 19:08:32 (RELEASE build)
WARNING: Core files found in /home/jenkins/ workspace/ core-regress- seabase- cdh4.4/ trafodion/ core : core.slave08. 19150.shell
-rw-------. 1 jenkins jenkins 44552192 Sep 9 19:08 sql/regress/
======= ======= ======= ===
Total Passed: 10
Total Failures: 0
Failure : Found 1 core files
On slave08 the stack trace is:
-bash-4.1$ cd /home/jenkins/ workspace/ core-regress- seabase- cdh4.4/ trafodion/ core/sqf core.slave08. 19150.shell core.slave08. 19150.shell --batch -n -x /tmp/tmp.KubaBX3k7s 2>&1 '*-debug* ' install /usr/lib/ debug/. build-id/ 1e/0a7d58f45492 6e2afb4797865d8 5801ed65ece To_Monitor: :process_ notice( message_ def*)") at clio.cxx:99 To_Monitor: :process_ notice (this=0x7c6e80, pp_msg=<value optimized out>) at clio.cxx:1022 To_Monitor: :get_io (this=0x7c6e80, pv_sig=<value optimized out>, pp_siginfo=<value optimized out>) at clio.cxx:637 reader (pp_arg=0x6582) at clio.cxx:154 libpthread. so.0
-bash-4.1$ . ./sqenvr.sh
-bash-4.1$ cd ..
-bash-4.1$ core_bt
core file : -rw-------. 1 jenkins jenkins 44552192 Sep 9 19:08 ./sql/regress/
gdb command: gdb shell ./sql/regress/
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo=
[New Thread 19151]
[New Thread 19150]
[Thread debugging using libthread_db enabled]
Core was generated by `shell -a'.
Program terminated with signal 6, Aborted.
#0 0x0000003d61a32635 in raise () from /lib64/libc.so.6
#0 0x0000003d61a32635 in raise () from /lib64/libc.so.6
#1 0x0000003d61a33e15 in abort () from /lib64/libc.so.6
#2 0x0000000000411982 in LIOTM_assert_fun (pp_exp=0x4d4f40 "0", pp_file=0x4d175e "clio.cxx", pv_line=1022, pp_fun=0x4d2d60 "int Local_IO_
#3 0x0000000000413b26 in Local_IO_
#4 0x0000000000413e03 in Local_IO_
#5 0x0000000000414075 in local_monitor_
#6 0x0000003d622079d1 in start_thread () from /lib64/
#7 0x0000003d61ae886d i...