DirichletBC unittest fails on osx-10.7

[Johannes Ring]

The test test/unit/fem/python/Dirichlet.py fails when run in parallel on the osx-10.7 buildbot. It works fine when using Epetra instead of PETSc as the la backend. The error message is like this:

buildbot@opeth:python$ mpirun -np 3 python DirichletBC.py

Testing Dirichlet boundary conditions
------------------------------------------------

Testing Dirichlet boundary conditions
------------------------------------------------

Testing Dirichlet boundary conditions
------------------------------------------------
Process 0: Number of global vertices: 81
Process 0: Number of global cells: 128
...Process 0: Number of global vertices: 81
Process 0: Number of global cells: 128
...Process 0: Number of global vertices: 729
Process 0: Number of global cells: 3072
...Process 0: Solving linear variational problem.
Process 1: Solving linear variational problem.
Process 2: Solving linear variational problem.
[0]PETSC ERROR: --------------------- Error Message ------------------------------------
[0]PETSC ERROR: Error in external library!
[0]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFO(1)=-9, INFO(2)=35007
!
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Petsc Release Version 3.3.0, Patch 3, Wed Aug 29 11:26:24 CDT 2012
[0]PETSC ERROR: See docs/changes/index.html for recent updates.
[0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[0]PETSC ERROR: See docs/index.html for manual pages.
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Unknown Name on a darwin11. named opeth.local by buildbot Mon Nov 26 16:25:02 2012
[0]PETSC ERROR: Libraries linked from /Users/buildbot/local/lib
[0]PETSC ERROR: Configure run at Mon Nov 26 14:39:18 2012
[0]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0 --with-shared-libraries=1 --with-clanguage=cxx --with-c-support=1 --download-umfpack=1 --download-hypre=1 --download-mumps=1 --download-scalapack=1 --download-blacs=1 --with-ml=1 --with-ml-lib=/Users/buildbot/local/lib/libml.so --with-ml-include=/Users/buildbot/local/include/trilinos --with-metis=1 --with-metis-dir=/Users/buildbot/local --with-parmetis=1 --with-parmetis-dir=/Users/buildbot/local --with-ptscotch=1 --with-ptscotch-dir=/Users/buildbot/local --prefix=/Users/buildbot/local
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: MatFactorNumeric_MUMPS() line 670 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/impls/aij/mpi/mumps/mumps.c
[0]PETSC ERROR: MatLUFactorNumeric() line 2803 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/interface/matrix.c
[0]PETSC ERROR: PCSetUp_LU() line 160 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/impls/factor/lu/lu.c
[0]PETSC ERROR: PCSetUp() line 832 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/interface/precon.c
[1]PETSC ERROR: --------------------- Error Message ------------------------------------
[1]PETSC ERROR: Error in external library!
[1]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFO(1)=-1, INFO(2)=0
!
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: Petsc Release Version 3.3.0, Patch 3, Wed Aug 29 11:26:24 CDT 2012
[1]PETSC ERROR: See docs/changes/index.html for recent updates.
[1]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[1]PETSC ERROR: See docs/index.html for manual pages.
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: Unknown Name on a darwin11. named opeth.local by buildbot Mon Nov 26 16:25:03 2012
[1]PETSC ERROR: Libraries linked from /Users/buildbot/local/lib
[1]PETSC ERROR: Configure run at Mon Nov 26 14:39:18 2012
[1]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0 --with-shared-libraries=1 --with-clanguage=cxx --with-c-support=1 --download-umfpack=1 --download-hypre=1 --download-mumps=1 --download-scalapack=1 --download-blacs=1 --with-ml=1 --with-ml-lib=/Users/buildbot/local/lib/libml.so --with-ml-include=/Users/buildbot/local/include/trilinos --with-metis=1 --with-metis-dir=/Users/buildbot/local --with-parmetis=1 --with-parmetis-dir=/Users/buildbot/local --with-ptscotch=1 --with-ptscotch-dir=/Users/buildbot/local --prefix=/Users/buildbot/local
[1]PETSC ERROR: ------------------------------------------------------------------------
[1]PETSC ERROR: MatFactorNumeric_MUMPS() line 670 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/impls/aij/mpi/mumps/mumps.c
[1]PETSC ERROR: MatLUFactorNumeric() line 2803 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/interface/matrix.c
[1]PETSC ERROR: PCSetUp_LU() line 160 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/impls/factor/lu/lu.c
[1]PETSC ERROR: PCSetUp() line 832 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/interface/precon.c
[1]PETSC ERROR: KSPSetUp() line 278 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
[1]PETSC ERROR: KSPSolve() line 402 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
[2]PETSC ERROR: --------------------- Error Message ------------------------------------
[2]PETSC ERROR: Error in external library!
[2]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFO(1)=-1, INFO(2)=0
!
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: Petsc Release Version 3.3.0, Patch 3, Wed Aug 29 11:26:24 CDT 2012
[2]PETSC ERROR: See docs/changes/index.html for recent updates.
[2]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[2]PETSC ERROR: See docs/index.html for manual pages.
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: Unknown Name on a darwin11. named opeth.local by buildbot Mon Nov 26 16:25:02 2012
[2]PETSC ERROR: Libraries linked from /Users/buildbot/local/lib
[2]PETSC ERROR: Configure run at Mon Nov 26 14:39:18 2012
[2]PETSC ERROR: Configure options COPTFLAGS=-O2 --with-debugging=0 --with-shared-libraries=1 --with-clanguage=cxx --with-c-support=1 --download-umfpack=1 --download-hypre=1 --download-mumps=1 --download-scalapack=1 --download-blacs=1 --with-ml=1 --with-ml-lib=/Users/buildbot/local/lib/libml.so --with-ml-include=/Users/buildbot/local/include/trilinos --with-metis=1 --with-metis-dir=/Users/buildbot/local --with-parmetis=1 --with-parmetis-dir=/Users/buildbot/local --with-ptscotch=1 --with-ptscotch-dir=/Users/buildbot/local --prefix=/Users/buildbot/local
[2]PETSC ERROR: ------------------------------------------------------------------------
[2]PETSC ERROR: MatFactorNumeric_MUMPS() line 670 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/impls/aij/mpi/mumps/mumps.c
[2]PETSC ERROR: MatLUFactorNumeric() line 2803 in /Users/buildbot/local/src/petsc-3.3-p3/src/mat/interface/matrix.c
[2]PETSC ERROR: PCSetUp_LU() line 160 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/impls/factor/lu/lu.c
[2]PETSC ERROR: PCSetUp() line 832 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/pc/interface/precon.c
[2]PETSC ERROR: KSPSetUp() line 278 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
[2]PETSC ERROR: KSPSolve() line 402 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
[0]PETSC ERROR: KSPSetUp() line 278 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
[0]PETSC ERROR: KSPSolve() line 402 in /Users/buildbot/local/src/petsc-3.3-p3/src/ksp/ksp/interface/itfunc.c
FF
F======================================================================

FAIL: test_meshdomain_bcs (__main__.DirichletBCTest)
Test application of Dirichlet boundary conditions stored as
----------------------------------------------------------------------======================================================================

Traceback (most recent call last):
  File "DirichletBC.py", line 102, in test_meshdomain_bcs
    self.assertAlmostEqual(u.vector().norm("l2"), 171.3032089576118)
AssertionError: 0.0 != 171.3032089576118 within 7 places

FAIL: test_meshdomain_bcs (__main__.DirichletBCTest)
Test application of Dirichlet boundary conditions stored as
--------------------------------------------------------------------------------------------------------------------------------------------

Traceback (most recent call last):
  File "DirichletBC.py", line 102, in test_meshdomain_bcs
    self.assertAlmostEqual(u.vector().norm("l2"), 171.3032089576118)
AssertionError: 0.0 != 171.3032089576118 within 7 places

Ran 4 tests in 1.652s

----------------------------------------------------------------------
FAILEDRan 4 tests in 1.652s

FAILED (failures=1)
 (failures=1)

======================================================================
FAIL: test_meshdomain_bcs (__main__.DirichletBCTest)
Test application of Dirichlet boundary conditions stored as
----------------------------------------------------------------------
Traceback (most recent call last):
  File "DirichletBC.py", line 102, in test_meshdomain_bcs
    self.assertAlmostEqual(u.vector().norm("l2"), 171.3032089576118)
AssertionError: 0.0 != 171.3032089576118 within 7 places

----------------------------------------------------------------------
Ran 4 tests in 1.652s

FAILED (failures=1)
--------------------------------------------------------------------------
mpirun noticed that the job aborted, but has no info as to the process
that caused that situation.
--------------------------------------------------------------------------

[Johannes Ring (johannr)]

This also happens sometimes (but not always) on the osx-10.6 buildbot:

  http://fenicsproject.org:8010/builders/dolfin-trunk-full-osx-10.6/builds/270

[Johannes Ring (johannr)]

A workaround was to rebuild PETSc with SPOOLES instead of MUMPS. I did that on the osx-10.7 buildbot and it is now green.

Is this a satisfactory "solution"?

[Johannes Ring (johannr)]

This was fixed in revision 7166.

I have rebuilt PETSc with MUMPS instead of SPOOLS on the osx-10.7 buildbot.