RuntimeError : Info file not found for PDF set 'NNPDF23_lo_as_0130_qed'

[Emilio Royo]

Hello,

A few days ago, MadGraph5 updated itself and, ever since, every time I generate/launch a process I get an error in the Systematics computation. Something has broken but I'm unable to figure out what. Any help would be massively appreciated.

--------------------------------------------------------------------------

INFO: Running Systematics computation
INFO: Idle: 2, Running: 2, Completed: 0 [ current time: 01h56 ]
WARNING: program /Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/Python -O /Users/emrocar/MG5_Tests/test/bin/internal/systematics.py unweighted_events.lhe.gz ./tmp_3_unweighted_events.lhe.gz --mur=0.5,1,2 --muf=0.5,1,2 --pdf=errorset --start_event=7500 --stop_event=10000 --result=./log_sys_3.txt --lhapdf_config=/Users/emrocar/Documents/MG5_aMC_v2_7_2/HEPTools/lhapdf6/bin/lhapdf-config launch ends with non zero status: 1. Stop all computation
INFO: Running Systematics computation
Command "generate_events run_01" interrupted with error:
RuntimeError : Info file not found for PDF set 'NNPDF23_lo_as_0130_qed'
Please report this bug on https://bugs.launchpad.net/mg5amcnlo
More information is found in '/Users/emrocar/MG5_Tests/test/run_01_tag_1_debug.log'.
Please attach this file to your report.

--------------------------------------------------------------------------
--------------------------------------------------------------------------

I have re-installed the lhapdf6 package from MG5_AMC and made no difference. I have checked Question #675492, which asked something very similar, but it doesn't seem to solve my problem.
Some details about my OS and compilers versions:

--------------------------------------------------------------------------

macOS Catalina, version 10.15.5

emrocar@MacBook-Pro ~ % gcc --version
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/4.2.1
Apple clang version 11.0.3 (clang-1103.0.32.62)
Target: x86_64-apple-darwin19.5.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

emrocar@MacBook-Pro ~ % make --version
GNU Make 3.81
Copyright (C) 2006 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
This program built for i386-apple-darwin11.3.0

emrocar@MacBook-Pro ~ % gfortran --version
GNU Fortran (Homebrew GCC 10.1.0) 10.1.0
Copyright (C) 2020 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

emrocar@MacBook-Pro mg5_tests % root --version
ROOT Version: 6.20/04
Built for macosx64 on Apr 01 2020, 08:28:48
From tags/v6-20-04@v6-20-04

--------------------------------------------------------------------------
--------------------------------------------------------------------------

The associated 'run_01_tag_1_debug.log' file is:

--------------------------------------------------------------------------

#************************************************************
#* MadGraph5_aMC@NLO/MadEvent *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 2.7.3 2020-06-21 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadEvent *
#* *
#* run as ./bin/madevent.py filename *
#* *
#************************************************************
generate_events run_01
Traceback (most recent call last):
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/extended_cmd.py", line 1515, in onecmd
    return self.onecmd_orig(line, **opt)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/extended_cmd.py", line 1464, in onecmd_orig
    return func(arg, **opt)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/madevent_interface.py", line 2468, in do_generate_events
    self.run_generate_events(switch_mode, args)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/common_run_interface.py", line 7011, in new_fct
    original_fct(obj, *args, **opts)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/madevent_interface.py", line 2552, in run_generate_events
    postcmd=False, printcmd=False)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/extended_cmd.py", line 1544, in exec_cmd
    stop = Cmd.onecmd_orig(current_interface, line, **opt)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/extended_cmd.py", line 1464, in onecmd_orig
    return func(arg, **opt)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/common_run_interface.py", line 1850, in do_systematics
    out = self.do_systematics(line)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/interface/common_run_interface.py", line 1797, in do_systematics
    result=result_file
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/various/systematics.py", line 1089, in call_systematics
    obj = Systematics(input, output, log=log, **opts)
  File "/Users/emrocar/Documents/MG5_aMC_v2_7_2/madgraph/various/systematics.py", line 200, in __init__
    pdfset = lhapdf.mkPDF(int(data)).set()
  File "lhapdf.pyx", line 611, in lhapdf.mkPDF
  File "lhapdf.pyx", line 571, in lhapdf.mkPDF_lhaid
RuntimeError: Info file not found for PDF set 'NNPDF23_lo_as_0130_qed'
                              Run Options
                              -----------
               stdout_level : 20 (user set)

                         MadEvent Options
                         ----------------
     automatic_html_opening : False (user set)
        notification_center : True
          cluster_temp_path : None
             cluster_memory : None (user set)
               cluster_size : 100
              cluster_queue : None (user set)
                    nb_core : 8 (user set)
               cluster_time : 8 (user set)
                   run_mode : 2

                      Configuration Options
                      ---------------------
                text_editor : None
         cluster_local_path : None
      cluster_status_update : (600, 30)
               pythia8_path : /Users/emrocar/Documents/MG5_aMC_v2_7_2/HEPTools/pythia8 (user set)
                  hwpp_path : None (user set)
            pythia-pgs_path : None (user set)
                    td_path : None (user set)
               delphes_path : /Users/emrocar/Documents/MG5_aMC_v2_7_2/Delphes (user set)
                thepeg_path : None (user set)
               cluster_type : condor
          madanalysis5_path : /Users/emrocar/Documents/MG5_aMC_v2_7_2/HEPTools/madanalysis5/madanalysis5 (user set)
           cluster_nb_retry : 1
                 eps_viewer : None
                web_browser : None
               syscalc_path : /Users/emrocar/Documents/MG5_aMC_v2_7_2/SysCalc (user set)
           madanalysis_path : None (user set)
                     lhapdf : /Users/emrocar/Documents/MG5_aMC_v2_7_2/HEPTools/lhapdf6/bin/lhapdf-config (user set)
              f2py_compiler : None
                 hepmc_path : None (user set)
         cluster_retry_wait : 300
           fortran_compiler : None
                auto_update : 7 (user set)
        exrootanalysis_path : /Users/emrocar/Documents/MG5_aMC_v2_7_2/ExRootAnalysis (user set)
                    timeout : 60
               cpp_compiler : None
#************************************************************
#* MadGraph5_aMC@NLO *
#* *
#* * * *
#* * * * * *
#* * * * * 5 * * * * *
#* * * * * *
#* * * *
#* *
#* *
#* VERSION 2.7.3 2020-06-21 *
#* *
#* The MadGraph5_aMC@NLO Development Team - Find us at *
#* https://server06.fynu.ucl.ac.be/projects/madgraph *
#* *
#************************************************************
#* *
#* Command File for MadGraph5_aMC@NLO *
#* *
#* run as ./bin/mg5_aMC filename *
#* *
#************************************************************
set default_unset_couplings 99
set group_subprocesses Auto
set ignore_six_quark_processes False
set loop_optimized_output True
set low_mem_multicore_nlo_generation False
set loop_color_flows False
set gauge unitary
set complex_mass_scheme False
set max_npoint_for_channel 0
import model sm
define p = g u c d s u~ c~ d~ s~
define j = g u c d s u~ c~ d~ s~
define l+ = e+ mu+
define l- = e- mu-
define vl = ve vm vt
define vl~ = ve~ vm~ vt~
generate u u~ > t t~
output test
######################################################################
## PARAM_CARD AUTOMATICALY GENERATED BY MG5 FOLLOWING UFO MODEL ####
######################################################################
## ##
## Width set on Auto will be computed following the information ##
## present in the decay.py files of the model. ##
## See arXiv:1402.1178 for more details. ##
## ##
######################################################################

###################################
## INFORMATION FOR MASS
###################################
Block mass
    5 4.700000e+00 # MB
    6 1.730000e+02 # MT
   15 1.777000e+00 # MTA
   23 9.118800e+01 # MZ
   25 1.250000e+02 # MH
## Dependent parameters, given by model restrictions.
## Those values should be edited following the
## analytical expression. MG5 ignores those values
## but they are important for interfacing the output of MG5
## to external program such as Pythia.
  1 0.000000e+00 # d : 0.0
  2 0.000000e+00 # u : 0.0
  3 0.000000e+00 # s : 0.0
  4 0.000000e+00 # c : 0.0
  11 0.000000e+00 # e- : 0.0
  12 0.000000e+00 # ve : 0.0
  13 0.000000e+00 # mu- : 0.0
  14 0.000000e+00 # vm : 0.0
  16 0.000000e+00 # vt : 0.0
  21 0.000000e+00 # g : 0.0
  22 0.000000e+00 # a : 0.0
  24 8.041900e+01 # w+ : cmath.sqrt(MZ__exp__2/2. + cmath.sqrt(MZ__exp__4/4. - (aEW*cmath.pi*MZ__exp__2)/(Gf*sqrt__2)))

###################################
## INFORMATION FOR SMINPUTS
###################################
Block sminputs
    1 1.325070e+02 # aEWM1
    2 1.166390e-05 # Gf
    3 1.180000e-01 # aS

###################################
## INFORMATION FOR YUKAWA
###################################
Block yukawa
    5 4.700000e+00 # ymb
    6 1.730000e+02 # ymt
   15 1.777000e+00 # ymtau

###################################
## INFORMATION FOR DECAY
###################################
DECAY 6 1.491500e+00 # WT
DECAY 23 2.441404e+00 # WZ
DECAY 24 2.047600e+00 # WW
DECAY 25 6.382339e-03 # WH
## Dependent parameters, given by model restrictions.
## Those values should be edited following the
## analytical expression. MG5 ignores those values
## but they are important for interfacing the output of MG5
## to external program such as Pythia.
DECAY 1 0.000000e+00 # d : 0.0
DECAY 2 0.000000e+00 # u : 0.0
DECAY 3 0.000000e+00 # s : 0.0
DECAY 4 0.000000e+00 # c : 0.0
DECAY 5 0.000000e+00 # b : 0.0
DECAY 11 0.000000e+00 # e- : 0.0
DECAY 12 0.000000e+00 # ve : 0.0
DECAY 13 0.000000e+00 # mu- : 0.0
DECAY 14 0.000000e+00 # vm : 0.0
DECAY 15 0.000000e+00 # ta- : 0.0
DECAY 16 0.000000e+00 # vt : 0.0
DECAY 21 0.000000e+00 # g : 0.0
DECAY 22 0.000000e+00 # a : 0.0
#*********************************************************************
# MadGraph5_aMC@NLO *
# *
# run_card.dat MadEvent *
# *
# This file is used to set the parameters of the run. *
# *
# Some notation/conventions: *
# *
# Lines starting with a '# ' are info or comments *
# *
# mind the format: value = variable ! comment *
# *
# To display more options, you can type the command: *
# update full_run_card *
#*********************************************************************
#
#*********************************************************************
# Tag name for the run (one word) *
#*********************************************************************
  tag_1 = run_tag ! name of the run
#*********************************************************************
# Number of events and rnd seed *
# Warning: Do not generate more than 1M events in a single run *
#*********************************************************************
  10000 = nevents ! Number of unweighted events requested
  0 = iseed ! rnd seed (0=assigned automatically=default))
#*********************************************************************
# Collider type and energy *
# lpp: 0=No PDF, 1=proton, -1=antiproton, 2=photon from proton, *
# 3=photon from electron *
#*********************************************************************
     1 = lpp1 ! beam 1 type
     1 = lpp2 ! beam 2 type
     6500.0 = ebeam1 ! beam 1 total energy in GeV
     6500.0 = ebeam2 ! beam 2 total energy in GeV
# To see polarised beam options: type "update beam_pol"

#*********************************************************************
# PDF CHOICE: this automatically fixes also alpha_s and its evol. *
#*********************************************************************
     nn23lo1 = pdlabel ! PDF set
     230000 = lhaid ! if pdlabel=lhapdf, this is the lhapdf number
# To see heavy ion options: type "update ion_pdf"
#*********************************************************************
# Renormalization and factorization scales *
#*********************************************************************
 False = fixed_ren_scale ! if .true. use fixed ren scale
 False = fixed_fac_scale ! if .true. use fixed fac scale
 91.188 = scale ! fixed ren scale
 91.188 = dsqrt_q2fact1 ! fixed fact scale for pdf1
 91.188 = dsqrt_q2fact2 ! fixed fact scale for pdf2
 -1 = dynamical_scale_choice ! Choose one of the preselected dynamical choices
 1.0 = scalefact ! scale factor for event-by-event scales
#*********************************************************************
# Type and output format
#*********************************************************************
  False = gridpack !True = setting up the grid pack
  -1.0 = time_of_flight ! threshold (in mm) below which the invariant livetime is not written (-1 means not written)
  average = event_norm ! average/sum. Normalization of the weight in the LHEF
# To see MLM/CKKW merging options: type "update MLM" or "update CKKW"

#*********************************************************************
#
#*********************************************************************
# handling of the helicities:
# 0: sum over all helicities
# 1: importance sampling over helicities
#*********************************************************************
   0 = nhel ! using helicities importance sampling or not.
#*********************************************************************
# Generation bias, check the wiki page below for more information: *
# 'cp3.irmp.ucl.ac.be/projects/madgraph/wiki/LOEventGenerationBias' *
#*********************************************************************
 None = bias_module ! Bias type of bias, [None, ptj_bias, -custom_folder-]
 {} = bias_parameters ! Specifies the parameters of the module.
#
#*******************************
# Parton level cuts definition *
#*******************************
#
#
#*********************************************************************
# BW cutoff (M+/-bwcutoff*Gamma) ! Define on/off-shell for "$" and decay
#*********************************************************************
  15.0 = bwcutoff ! (M+/-bwcutoff*Gamma)
#*********************************************************************
# Standard Cuts *
#*********************************************************************
# Minimum and maximum pt's (for max, -1 means no cut) *
#*********************************************************************
 {} = pt_min_pdg ! pt cut for other particles (use pdg code). Applied on particle and anti-particle
 {} = pt_max_pdg ! pt cut for other particles (syntax e.g. {6: 100, 25: 50})
#
# For display option for energy cut in the partonic center of mass frame type 'update ecut'
#
#*********************************************************************
# Maximum and minimum absolute rapidity (for max, -1 means no cut) *
#*********************************************************************
 {} = eta_min_pdg ! rap cut for other particles (use pdg code). Applied on particle and anti-particle
 {} = eta_max_pdg ! rap cut for other particles (syntax e.g. {6: 2.5, 23: 5})
#*********************************************************************
# Minimum and maximum DeltaR distance *
#*********************************************************************
#*********************************************************************
# Minimum and maximum invariant mass for pairs *
#*********************************************************************
 {} = mxx_min_pdg ! min invariant mass of a pair of particles X/X~ (e.g. {6:250})
 {'default': False} = mxx_only_part_antipart ! if True the invariant mass is applied only
                       ! to pairs of particle/antiparticle and not to pairs of the same pdg codes.
#*********************************************************************
# Inclusive cuts *
#*********************************************************************
 0.0 = ptheavy ! minimum pt for at least one heavy final state
#*********************************************************************
# maximal pdg code for quark to be considered as a light jet *
# (otherwise b cuts are applied) *
#*********************************************************************
 4 = maxjetflavor ! Maximum jet pdg code
#*********************************************************************
#
#*********************************************************************
# Store info for systematics studies *
# WARNING: Do not use for interference type of computation *
#*********************************************************************
   True = use_syst ! Enable systematics studies
#
systematics = systematics_program ! none, systematics [python], SysCalc [depreceted, C++]
['--mur=0.5,1,2', '--muf=0.5,1,2', '--pdf=errorset'] = systematics_arguments ! see: https://cp3.irmp.ucl.ac.be/projects/madgraph/wiki/Systematics#Systematicspythonmodule
# Syscalc is deprecated but to see the associate options type'update syscalc'

--------------------------------------------------------------------------
--------------------------------------------------------------------------

It seems as though the link to LHAPDF has broken.
Setting use_syst = False, obviously, silences the issue but doesn't fix it, so this will be last resort.

Could you please help address or fix the issue? What am I missing? What am I doing wrong?

Many thanks in advance,
Emilio.

[Olivier Mattelaer (olivier-mattelaer)]

Did you set any environment variable for LHAPDF on your system?

Did you try to re-install lhapdf? Did you have that pdf sets install in your system?
(MG5aMC tries to auto-download pdf set, but lhapdf is against that policy and makes that difficult)

Cheers,

Olivier

[Emilio Royo (emrocar)]

Hi Olivier,
Thank you very much for your reply. First of all, I just want to let you know that I'm just a beginner with MG5aMC and I'd like to apologise in advance for my ignorance and, also, in case I'm just doing something silly.
As I said in the OP, MG5aMC was working perfectly fine until it got updated. I reinstalled lhapdf6 via the MG5aMC command 'install' when I first got the issue to see if that fixed it but made no difference. I then tried a new fresh MG5_aMC installation followed by installing the usual packages (i.e. MadAnalysis5, ExRootAnalysis, Delphes, lhapdf6, etc.) but this didn't sort out the problem either.
I haven't set any environmental variables for LHAPDF, just for ROOT as suggested in one of the MG5aMC installation guides I found in the internet. (FYI, I didn't set any environmental variables for LHAPDF either the first time I installed MG5AMC when it was working fine, before it was updated and got broken.) May you please indicate what environmental variables for LHAPDF I would need to set up to see if that helps?
Not sure if this is important or not but when I set in the run_card 'pdlabel = LHAPDF', then it downloads the lhaid number that I indicate, and the Systematics computation works fine. However, when pdlabel is different to LHAPDF, e.g. pdlabel = nn23lo (or nn23lo1, nn23nlo, cteq6_m, etc.), then the Systematics computation fails.
In case I need to download and install manually the nn23lo, nn23nlo, etc. sets, would you be able to indicate how to do it?
Many thanks in advance for your patience.
Cheers,
Emilio.

[Emilio Royo (emrocar)]

Hello Olivier,
I apologise for asking again but I haven't been able to sort this out on my own. Would it be possible to get some help please?
Many thanks,
Emilio.

[Olivier Mattelaer (olivier-mattelaer)]

Hi,

Sorry I was in holiday (followed by an intense GPU hackathon).
I have fixed the issue in the installer, so if you redo install lhapdf6, it should at the same time download that pdf set by default to avoid that error.

Cheers,

Olivier

[Emilio Royo (emrocar)]

Hi Olivier,
Thanks for coming back to me.
I have reinstalled lhapdf6 as you advised (i.e. MG5_aMC>install lhapdf6) but the problem unfortunately persists.
---------
Command "generate_events run_01" interrupted with error:
RuntimeError : Info file not found for PDF set 'NNPDF23_lo_as_0130_qed'
---------
Do I need to reinstall anything else? Any suggestions?
Thanks,
Emilio.

[Olivier Mattelaer (olivier-mattelaer)]

Just to be sure did you retry in the last 24h?
If so could you put the print on screen for the installation of lhapdf6?
(such that I know which server was not correctly updated)
and maybe the log of the installation it should be in
HEPTools/lhapdf6/lhapdf6_install.log

and then check also the content of
HEPTools/lhapdf6/share/LHAPDF
to see if you have that PDF set installed or not.
(in principle another work around is to add that pdf set in that directory:
you can get it from
https://lhapdfsets.web.cern.ch/lhapdfsets/current/NNPDF23_lo_as_0130_qed.tar.gz

Cheers,

Olivier

[Emilio Royo (emrocar)]

Hi Olivier,
Yes, I tried it again today and did not work. This is the print on the screen for the installation of lhapdf6:
-------------------
MG5_aMC>install lhapdf6 --force
   You are installing 'lhapdf6', please cite ref(s): arXiv:1412.7420.
Downloading the HEPToolInstaller at:
   http://madgraph.physics.illinois.edu/Downloads/HEPToolsInstaller/HEPToolsInstaller_V131.tar.gz
Now installing lhapdf6. Be patient...
Removing existing installation of tool 'lhapdf6' in '/Users/emrocar/Documents/MG5_aMC_v2_7_3/HEPTools'.
Fetching data with command:
  curl -OL https://lhapdf.hepforge.org/downloads/LHAPDF-6.2.3.tar.gz
  % Total % Received % Xferd Average Speed Time Time Time Current
                                 Dload Upload Total Spent Left Speed
100 107 100 107 0 0 359 0 --:--:-- --:--:-- --:--:-- 359
100 107 100 107 0 0 275 0 --:--:-- --:--:-- --:--:-- 275
100 733k 0 733k 0 0 1223k 0 --:--:-- --:--:-- --:--:-- 1223k
Installing tool 'lhapdf6'...
    > Follow the installation progress by running the command below in a separate terminal)
    > tail -f /Users/emrocar/Documents/MG5_aMC_v2_7_3/HEPTools/lhapdf6/lhapdf6_install.log
Successful installation of 'lhapdf6' in '/Users/emrocar/Documents/MG5_aMC_v2_7_3/HEPTools'.
lhapdf6 successfully installed in /Users/emrocar/Documents/MG5_aMC_v2_7_3/HEPTools.
save options lhapdf
save configuration file to /Users/emrocar/Documents/MG5_aMC_v2_7_3/input/mg5_configuration.txt
MG5_aMC>
-------------------

I have also attached the 'lhapdf6_install.log' file for your review. Interestingly, it says at the bottom:
-------------------
/Users/emrocar/Documents/MG5_aMC_v2_7_3/HEPTools/HEPToolsInstallers/installLHAPDF6.sh: line 58: wget: command not found
tar: Error opening archive: Failed to open 'NNPDF23_lo_as_0130_qed.tar.gz'
 Finished LHAPDF6 installation
-------------------

The folder HEPTools/lhapdf6/share/LHAPDF contained only two files, i.e. 'lhapdf.conf' and 'pdfsets.index', so I copied manually the download that you indicated in your message into that folder. This appears to have solved the issue; now the systematics computation runs ok. Unfortunately, this seems to have generated other issues with my existing UFO but this is most likely to be another topic altogether, so, I will ask elsewhere.

Many thanks,
Emilio.