xtrabackup sst fails if tmpdir is specified more than once in my.cnf

[markus_albe]

wsrep_sst_xtrabackup will fail with "innobackupex: Too many command line arguments" error if the tmpdir option is specified more than once in my.cnf

A possible solution would be to add "|tail -n1" to this

TMPDIR=$(grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g' )

So would be

TMPDIR=$(grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g' |tail -n1)

Still could be that the last tmpdir is not the right one (could be under a different options group other than [mysqld]). I think the following line should work always:

grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g'

[Raghavendra D Prabhu (raghavendra-prabhu)]

I think this entire segment

        TMPDIR=${TMPDIR:-""}
        if [ -z "${TMPDIR}" ]; then
            # try to get it from my.cnf
            TMPDIR=$(grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | \
                     awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g' )
            # if failed default to /tmp
            [ -z "${TMPDIR}" ] && TMPDIR="/tmp"
        fi

is not required. If a separate tmpdir for xtrabackup is required
(by default it will use mysql's), then it can be passed through
tmpdir variable under [xtrabackup] in my.cnf

[markus_albe (markus-albe)]

Ooooooops :-\ Seems I pasted the wrong line "that works". Here's the good one:

 mysqld --print-defaults | grep -P -o "\-\-tmpdir=[^\s]+" |awk -F"=" '{ print $2}' | sed 's/^\s//g' | sed 's/\s.*//g'

I agree with tmpdir under [xtrabackup] section idea too.

[Joseph McHenry (joseph-i)]

The solution offered does not distinguish between separate section headings.

We have a tmpdir setting under section headings, [mysql.server] and [mysqld]. Which one should be applied?

[markus_albe (markus-albe)]

Well, this won't parse the my.cnf, it will let mysqld parse the my.cnf
and then use whatever mysqld decided it was good to use.

On 04/03/2013 02:24 PM, Joseph McHenry wrote:
> The solution offered does not distinguish between separate section
> headings.
>
> We have a tmpdir setting under section headings, [mysql.server] and
> [mysqld]. Which one should be applied?
>

[Raghavendra D Prabhu (raghavendra-prabhu)]

@Joseph,

You need to provide tmpdir under [xtrabackup] heading for
xtrabackup to use a different one.

[Raghavendra D Prabhu (raghavendra-prabhu)]

On a closer examination, it may be that xtrabackup may not be
using tmpdir under [xtrabackup] for xtrabackup_target_dir when it
is streaming.

[Raghavendra D Prabhu (raghavendra-prabhu)]

Filed https://bugs.launchpad.net/percona-xtrabackup/+bug/1165981 for xtrabackup.

[Raghavendra D Prabhu (raghavendra-prabhu)]

Because of that bug, TMPDIR may be still required for the other parts of that script.

So,

=== modified file 'Percona-Server/scripts/wsrep_sst_xtrabackup.sh'
--- Percona-Server/scripts/wsrep_sst_xtrabackup.sh 2012-12-06 13:26:02 +0000
+++ Percona-Server/scripts/wsrep_sst_xtrabackup.sh 2013-04-08 04:26:06 +0000
@@ -101,13 +101,13 @@
         TMPDIR=${TMPDIR:-""}
         if [ -z "${TMPDIR}" ]; then
             # try to get it from my.cnf
- TMPDIR=$(grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | \
- awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g' )
+ TMPDIR=$(xtrabackup --print-param \
+ | awk -F"=" '/tmpdir/ { print $2 }' | tr -d '"')
             # if failed default to /tmp
             [ -z "${TMPDIR}" ] && TMPDIR="/tmp"
         fi

- INNOBACKUPEX_ARGS="--galera-info --tmpdir=${TMPDIR} --stream=tar
+ INNOBACKUPEX_ARGS="--galera-info --stream=tar
                            --defaults-file=${WSREP_SST_OPT_CONF}
                            --socket=${WSREP_SST_OPT_SOCKET}"

looks good.

Also, note that, to pass a tmpdir to xtrabackup, pass tmpdir under [xtrabackup] and place it AFTER the [mysqld] section. This will ensure that it is passed to both the target as well as tmpdir options of xtrabackup.

[Raghavendra D Prabhu (raghavendra-prabhu)]

Looks like tmpdir is passed even from my.cnf.

So, I will keep

=== modified file 'Percona-Server/scripts/wsrep_sst_xtrabackup.sh'
--- Percona-Server/scripts/wsrep_sst_xtrabackup.sh 2012-12-06 13:26:02 +0000
+++ Percona-Server/scripts/wsrep_sst_xtrabackup.sh 2013-04-08 09:21:20 +0000
@@ -97,17 +97,9 @@

     if [ $WSREP_SST_OPT_BYPASS -eq 0 ]
     then
-
- TMPDIR=${TMPDIR:-""}
- if [ -z "${TMPDIR}" ]; then
- # try to get it from my.cnf
- TMPDIR=$(grep -E '^\s*tmpdir' $WSREP_SST_OPT_CONF | \
- awk -F = '{ print $2 }' | sed 's/^\s//g' | sed 's/\s.*//g' )
- # if failed default to /tmp
- [ -z "${TMPDIR}" ] && TMPDIR="/tmp"
- fi
-
- INNOBACKUPEX_ARGS="--galera-info --tmpdir=${TMPDIR} --stream=tar
+ TMPDIR="/tmp"
+
+ INNOBACKUPEX_ARGS="--galera-info --stream=tar
                            --defaults-file=${WSREP_SST_OPT_CONF}
                            --socket=${WSREP_SST_OPT_SOCKET}"

[Alex Yurchenko (ayurchen)]

Hm, Raghavendra,

tmpdir value in my.cnf can now be different from one in TMPDIR variable. Note that later TMPDIR value is passed as an argument to innobackupex and later is used to locate xtrabckup PID file.

Is it acceptable that those two values be different?

[Raghavendra D Prabhu (raghavendra-prabhu)]

@Alex,

The TMPDIR (hardcoded here to /tmp) will mostly be used for
book-keeping files like pid files and others, nothing related to
mysqld (and no issues with O_DIRECT here )

[Alex Yurchenko (ayurchen)]

So doesn't the actual fix boil down to:

- INNOBACKUPEX_ARGS="--galera-info --tmpdir=${TMPDIR} --stream=tar
+ INNOBACKUPEX_ARGS="--galera-info --stream=tar

? I.e. specifying --tmpdir was an error?

As for TMPDIR value, can it be an arbitrary value or does it have to be exactly "/tmp"? If it can be anything, would it be preferable to be something else? E.g. the same as tmpdir from my.cnf?

[Raghavendra D Prabhu (raghavendra-prabhu)]

Specifying tmpdir in innobackupex command line can override the ones in my.cnf, so to specify tmpdir and target-dir for xtrabackup - for its log files - the one specified under [xtrabackup] is used.

Now, as far as TMPDIR above is concerned, yes, it was hardcoded to /tmp; yes, it can be anything since it mainly used for pid files etc. and /tmp is present on all systems, it was hardcoded as such.

[Alex Yurchenko (ayurchen)]

fix committed in lp:codership-mysql, r3865

[Shahriyar Rzayev (rzayev-sehriyar)]

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PXC-1319