Mailing List picongpu-users@hzdr.de Message #190
From: Khikhlukha Danila <Danila.Khikhlukha@eli-beams.eu>
Subject: RE: [PIConGPU-Users] Restart with TBG
Date: Mon, 23 Jan 2017 14:57:37 +0000
To: picongpu-users@hzdr.de <picongpu-users@hzdr.de>
It all clear now, thank you for your clarification!

D.
________________________________________
From: picongpu-users@hzdr.de [picongpu-users@hzdr.de] on behalf of Axel Huebl [a.huebl@hzdr.de]
Sent: Monday, January 23, 2017 3:49 PM
To: picongpu-users@hzdr.de
Subject: Re:  [PIConGPU-Users] Restart with TBG

Dear Danila,

> Could you please confirm that using tbg one needs to create a separate
> directory for the restart?

yes, with tbg, we usually restart in a separate folder, to avoid
accidentally overwriting things in the old one.

Otherwise, just apply those options in the tbg/submit.start file (or
copy and modify it) and then submit/execute it manually, so you stay in
the same dir.


Also, you might want to change the maximum time step (-s) for the restart.

Above information can be found in
  doc/TBG_macros.cfg [1]
and our wiki [2].


Cheers,
Axel

[1]
https://github.com/ComputationalRadiationPhysics/picongpu/blob/0.2.2/doc/TBG_macros.cfg
[2]
https://github.com/ComputationalRadiationPhysics/picongpu/wiki/Restarting-a-simulation

On 23.01.2017 14:23, Khikhlukha Danila wrote:
> Dear all,
> Am I correct that to run a restart using tgb one needs to specify a new
> output directory?
> Indeed, after the first simulation finished I have just added following
> lines to the submit submit file:
> TBG_restart="--restart"
> ...
> TBG_programParams="!TBG_devices
> \
>
>                    !TBG_gridSize
> \
>
>                    !TBG_steps
> \
>
>                    !TBG_movingWindow
> \
>
>                    *!TBG_restart *
> \
>
>                    !TBG_plugins"
> After that I have launched the simulation with the command:
> tbg -s bash -c $SUBMIT_DIR/0001gpus.cfg -t
> $SUBMIT_DIR/bash/bash_mpirun.tpl $RUN_DIR
> where SUBMIT_DIR and RUN_DIR are kept exactly the same. The job failed
> with the message:
> "job name already in use, can't create new folder"
>
> However if for the restart I specify a different RUN_DIR (like
> $RUN_DIR_restart) and modify the restart option like
> TBG_restart="--restart --restart-directory
> <old_run_dir>/simOutput/checkpoints" then everything works just fine.
>
> Could you please confirm that using tbg one needs to create a separate
> directory for the restart?
>
> Best regards,
> Danila.

--

Axel Huebl
Phone +49 351 260 3582
https://www.hzdr.de/crp
Computational Radiation Physics
Laser Particle Acceleration Division
Helmholtz-Zentrum Dresden - Rossendorf e.V.

Bautzner Landstrasse 400, 01328 Dresden
POB 510119, D-01314 Dresden
Vorstand: Prof. Dr.Dr.h.c. R. Sauerbrey
          Prof. Dr.Dr.h.c. P. Joehnk
VR 1693 beim Amtsgericht Dresden

#############################################################
This message is sent to you because you are subscribed to
  the mailing list <picongpu-users@hzdr.de>.
To unsubscribe, E-mail to: <picongpu-users-off@hzdr.de>
To switch to the DIGEST mode, E-mail to <picongpu-users-digest@hzdr.de>
To switch to the INDEX mode, E-mail to <picongpu-users-index@hzdr.de>
Send administrative queries to  <picongpu-users-request@hzdr.de>

Subscribe (FEED) Subscribe (DIGEST) Subscribe (INDEX) Unsubscribe Mail to Listmaster