problem when launching multi-runs by bash script

Bug #1811218 reported by USTCChenNing on 2019-01-10
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MadGraph5_aMC@NLO
Undecided
Unassigned

Bug Description

I tried to run the events multiple times by a bash script as follows:

#! /bin/bash

for ((i=1;i<=5;i++))
do
  ./bin/madevent launch xx$i
  #cd ./Events/xx$i/
  cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
  cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
  rm -rf ./Events/xx$i
  mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
  mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/

done

This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.

Do you have a log file in the following directory:
/hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/

If yes could you attach it?
Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
So do you submit this via your scheduller and ask to run on a given machine?
In that case, you need to check that you do not have any issue with the filesystem/...

Cheers,

Olivier

  • log.txt Edit (14.9 KiB, text/plain; charset="US-ASCII"; name="log.txt")

Hi, Olivier,

The log file is attached here.

I either run the bash script by the screen in the cluster, or submit
the bash script via condor. Neither can work for the multiple runs for
the event generation.

best,
Ning

On Thu, Jan 10, 2019 at 7:10 PM Olivier Mattelaer
<email address hidden> wrote:
>
> Do you have a log file in the following directory:
> /hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/
>
> If yes could you attach it?
> Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
> So do you submit this via your scheduller and ask to run on a given machine?
> In that case, you need to check that you do not have any issue with the filesystem/...
>
>
> Cheers,
>
> Olivier
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1811218
>
> Title:
> problem when launching multi-runs by bash script
>
> Status in MadGraph5_aMC@NLO:
> New
>
> Bug description:
> I tried to run the events multiple times by a bash script as follows:
>
> #! /bin/bash
>
> for ((i=1;i<=5;i++))
> do
> ./bin/madevent launch xx$i
> #cd ./Events/xx$i/
> cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
> cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
> rm -rf ./Events/xx$i
> mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
> mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/
>
> done
>
>
> This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mg5amcnlo/+bug/1811218/+subscriptions

--

Dr. CHEN, Ning
Associate Professor
School of Physics, Nankai University,
Tianjin, 300071, China

Download full text (3.8 KiB)

Hi,

Well this does not make sense.
in the log file, I do not see anything wrong (no crash/...)
Additionally, the log file endswith a "ls" command
which shows that the file results.dat exists.

While madgraph crashes because this log file does not exists...
So this is likely a filesystem syncronization issue (or transfer of file).

Not sure what I can do here to help you without knowing how your cluster is setup.

Cheers,

Olivier

> On 11 Jan 2019, at 11:20, USTCChenNing <email address hidden> wrote:
>
> Hi, Olivier,
>
> The log file is attached here.
>
> I either run the bash script by the screen in the cluster, or submit
> the bash script via condor. Neither can work for the multiple runs for
> the event generation.
>
> best,
> Ning
>
>
> On Thu, Jan 10, 2019 at 7:10 PM Olivier Mattelaer
> <email address hidden> wrote:
>>
>> Do you have a log file in the following directory:
>> /hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/
>>
>> If yes could you attach it?
>> Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
>> So do you submit this via your scheduller and ask to run on a given machine?
>> In that case, you need to check that you do not have any issue with the filesystem/...
>>
>>
>> Cheers,
>>
>> Olivier
>>
>> --
>> You received this bug notification because you are subscribed to the bug
>> report.
>> https://bugs.launchpad.net/bugs/1811218
>>
>> Title:
>> problem when launching multi-runs by bash script
>>
>> Status in MadGraph5_aMC@NLO:
>> New
>>
>> Bug description:
>> I tried to run the events multiple times by a bash script as follows:
>>
>> #! /bin/bash
>>
>> for ((i=1;i<=5;i++))
>> do
>> ./bin/madevent launch xx$i
>> #cd ./Events/xx$i/
>> cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
>> cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
>> rm -rf ./Events/xx$i
>> mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
>> mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/
>>
>> done
>>
>>
>> This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/mg5amcnlo/+bug/1811218/+subscriptions
>
>
> --
>
> Dr. CHEN, Ning
> Associate Professor
> School of Physics, Nankai University,
> Tianjin, 300071, China
>
>
> ** Attachment added: "log.txt"
> https://bugs.launchpad.net/bugs/1811218/+attachment/5228447/+files/log.txt
>
> --
> You received this bug notification because you are subscribed to
> MadGraph5_aMC@NLO.
> https://bugs.launchpad.net/bugs/1811218
>
> Title:
> problem when launching multi-runs by bash script
>
> Status in MadGraph5_aMC@NLO:
> New
>
> Bug description:
> I tried to run the events multiple times by a bash script as follows:
>
> #! /bin/bash
>
> for ((i=1;i<=5;i++))
> do
> ./bin/madevent launch xx$i
> #cd ./Events/xx$i/
> cp ./Events/xx$i/...

Read more...

To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers