problem when launching multi-runs by bash script

[USTCChenNing]

I tried to run the events multiple times by a bash script as follows:

#! /bin/bash

for ((i=1;i<=5;i++))
do
  ./bin/madevent launch xx$i
  #cd ./Events/xx$i/
  cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
  cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
  rm -rf ./Events/xx$i
  mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
  mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/

done

This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.

[Olivier Mattelaer (olivier-mattelaer)]

Do you have a log file in the following directory:
/hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/

If yes could you attach it?
Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
So do you submit this via your scheduller and ask to run on a given machine?
In that case, you need to check that you do not have any issue with the filesystem/...

Cheers,

Olivier

[USTCChenNing (ustc0204-chenning)]

Hi, Olivier,

The log file is attached here.

I either run the bash script by the screen in the cluster, or submit
the bash script via condor. Neither can work for the multiple runs for
the event generation.

best,
Ning

On Thu, Jan 10, 2019 at 7:10 PM Olivier Mattelaer
<email address hidden> wrote:
>
> Do you have a log file in the following directory:
> /hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/
>
> If yes could you attach it?
> Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
> So do you submit this via your scheduller and ask to run on a given machine?
> In that case, you need to check that you do not have any issue with the filesystem/...
>
>
> Cheers,
>
> Olivier
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1811218
>
> Title:
> problem when launching multi-runs by bash script
>
> Status in MadGraph5_aMC@NLO:
> New
>
> Bug description:
> I tried to run the events multiple times by a bash script as follows:
>
> #! /bin/bash
>
> for ((i=1;i<=5;i++))
> do
> ./bin/madevent launch xx$i
> #cd ./Events/xx$i/
> cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
> cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
> rm -rf ./Events/xx$i
> mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
> mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/
>
> done
>
>
> This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mg5amcnlo/+bug/1811218/+subscriptions

--

Dr. CHEN, Ning
Associate Professor
School of Physics, Nankai University,
Tianjin, 300071, China

[Olivier Mattelaer (olivier-mattelaer)]

Hi,

Well this does not make sense.
in the log file, I do not see anything wrong (no crash/...)
Additionally, the log file endswith a "ls" command
which shows that the file results.dat exists.

While madgraph crashes because this log file does not exists...
So this is likely a filesystem syncronization issue (or transfer of file).

Not sure what I can do here to help you without knowing how your cluster is setup.

Cheers,

Olivier

> On 11 Jan 2019, at 11:20, USTCChenNing <email address hidden> wrote:
>
> Hi, Olivier,
>
> The log file is attached here.
>
> I either run the bash script by the screen in the cluster, or submit
> the bash script via condor. Neither can work for the multiple runs for
> the event generation.
>
> best,
> Ning
>
>
> On Thu, Jan 10, 2019 at 7:10 PM Olivier Mattelaer
> <email address hidden> wrote:
>>
>> Do you have a log file in the following directory:
>> /hepustc/home/chenning/MG5_aMC_v2_6_4/LHC14_SM/ppto2t/SubProcesses/P2_gg_ttxgg/G1/
>>
>> If yes could you attach it?
>> Otherwise, I see that you are still running in multi-core mode (and not on cluster mode).
>> So do you submit this via your scheduller and ask to run on a given machine?
>> In that case, you need to check that you do not have any issue with the filesystem/...
>>
>>
>> Cheers,
>>
>> Olivier
>>
>> --
>> You received this bug notification because you are subscribed to the bug
>> report.
>> https://bugs.launchpad.net/bugs/1811218
>>
>> Title:
>> problem when launching multi-runs by bash script
>>
>> Status in MadGraph5_aMC@NLO:
>> New
>>
>> Bug description:
>> I tried to run the events multiple times by a bash script as follows:
>>
>> #! /bin/bash
>>
>> for ((i=1;i<=5;i++))
>> do
>> ./bin/madevent launch xx$i
>> #cd ./Events/xx$i/
>> cp ./Events/xx$i/tag_1_pythia8_events.hepmc.gz pythia8_events$i.hepmc.gz
>> cp ./Events/xx$i/tag_1_delphes_events.root delphes_events$i.root
>> rm -rf ./Events/xx$i
>> mv pythia8_events$i.hepmc.gz /lustre/AtlUser/chenning/LHC14_SM/tt/
>> mv delphes_events$i.root /lustre/AtlUser/chenning/LHC14_SM/tt/
>>
>> done
>>
>>
>> This script works on my laptop with mac OS. However, the cluster that I used failed to perform the multiple runs. Would you please help to take a look what should I do with that? The log file for the bug is attached. Thanks a lot.
>>
>> To manage notifications about this bug go to:
>> https://bugs.launchpad.net/mg5amcnlo/+bug/1811218/+subscriptions
>
>
> --
>
> Dr. CHEN, Ning
> Associate Professor
> School of Physics, Nankai University,
> Tianjin, 300071, China
>
>
> ** Attachment added: "log.txt"
> https://bugs.launchpad.net/bugs/1811218/+attachment/5228447/+files/log.txt
>
> --
> You received this bug notification because you are subscribed to
> MadGraph5_aMC@NLO.
> https://bugs.launchpad.net/bugs/1811218
>
> Title:
> problem when launching multi-runs by bash script
>
> Status in MadGraph5_aMC@NLO:
> New
>
> Bug description:
> I tried to run the events multiple times by a bash script as follows:
>
> #! /bin/bash
>
> for ((i=1;i<=5;i++))
> do
> ./bin/madevent launch xx$i
> #cd ./Events/xx$i/
> cp ./Events/xx$i/...