Return-Path: Received: from mx2.fz-rossendorf.de ([149.220.142.12] verified) by hzdr.de (CommuniGate Pro SMTP 6.1.12) with ESMTP id 16248006 for picongpu-users@cg.hzdr.de; Mon, 23 Jan 2017 15:58:07 +0100 Received: from localhost (localhost [127.0.0.1]) by mx2.fz-rossendorf.de (Postfix) with ESMTP id EA856422C4 for ; Mon, 23 Jan 2017 15:58:07 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mx2.fz-rossendorf.de Received: from mx2.fz-rossendorf.de ([127.0.0.1]) by localhost (mx2.fz-rossendorf.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id VynJxYQMnYBf for ; Mon, 23 Jan 2017 15:58:04 +0100 (CET) Received-SPF: Pass (sender SPF authorized) identity=mailfrom; client-ip=147.231.234.10; helo=mailgw.eli-beams.eu; envelope-from=prvs=119614220e=danila.khikhlukha@eli-beams.eu; receiver=picongpu-users@hzdr.de Received: from mailgw.eli-beams.eu (mailgw.eli-beams.eu [147.231.234.10]) by mx2.fz-rossendorf.de (Postfix) with ESMTPS id C1AAA422AE for ; Mon, 23 Jan 2017 15:57:50 +0100 (CET) Received: from mail.eli-beams.eu ([10.1.5.17]) by mailgw.eli-beams.eu with ESMTP id v0NEvb6E026619-v0NEvb6G026619 (version=TLSv1.0 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=CAFAIL) for ; Mon, 23 Jan 2017 15:57:37 +0100 Received: from BRAUN.eli-beams.eu ([::1]) by braun.eli-beams.eu ([::1]) with mapi id 14.03.0319.002; Mon, 23 Jan 2017 15:57:37 +0100 From: Khikhlukha Danila To: "picongpu-users@hzdr.de" Subject: RE: [PIConGPU-Users] Restart with TBG Thread-Topic: [PIConGPU-Users] Restart with TBG Thread-Index: AQHSdYgD6udBchT+oU21y8iaTAlrFaFGJbx4 Date: Mon, 23 Jan 2017 14:57:37 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US, cs-CZ Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.36.30.5] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 It all clear now, thank you for your clarification!=0A= =0A= D.=0A= ________________________________________=0A= From: picongpu-users@hzdr.de [picongpu-users@hzdr.de] on behalf of Axel Hue= bl [a.huebl@hzdr.de]=0A= Sent: Monday, January 23, 2017 3:49 PM=0A= To: picongpu-users@hzdr.de=0A= Subject: Re: [PIConGPU-Users] Restart with TBG=0A= =0A= Dear Danila,=0A= =0A= > Could you please confirm that using tbg one needs to create a separate=0A= > directory for the restart?=0A= =0A= yes, with tbg, we usually restart in a separate folder, to avoid=0A= accidentally overwriting things in the old one.=0A= =0A= Otherwise, just apply those options in the tbg/submit.start file (or=0A= copy and modify it) and then submit/execute it manually, so you stay in=0A= the same dir.=0A= =0A= =0A= Also, you might want to change the maximum time step (-s) for the restart.= =0A= =0A= Above information can be found in=0A= doc/TBG_macros.cfg [1]=0A= and our wiki [2].=0A= =0A= =0A= Cheers,=0A= Axel=0A= =0A= [1]=0A= https://github.com/ComputationalRadiationPhysics/picongpu/blob/0.2.2/doc/TB= G_macros.cfg=0A= [2]=0A= https://github.com/ComputationalRadiationPhysics/picongpu/wiki/Restarting-a= -simulation=0A= =0A= On 23.01.2017 14:23, Khikhlukha Danila wrote:=0A= > Dear all,=0A= > Am I correct that to run a restart using tgb one needs to specify a new= =0A= > output directory?=0A= > Indeed, after the first simulation finished I have just added following= =0A= > lines to the submit submit file:=0A= > TBG_restart=3D"--restart"=0A= > ...=0A= > TBG_programParams=3D"!TBG_devices=0A= > \=0A= >=0A= > !TBG_gridSize=0A= > \=0A= >=0A= > !TBG_steps=0A= > \=0A= >=0A= > !TBG_movingWindow=0A= > \=0A= >=0A= > *!TBG_restart *=0A= > \=0A= >=0A= > !TBG_plugins"=0A= > After that I have launched the simulation with the command:=0A= > tbg -s bash -c $SUBMIT_DIR/0001gpus.cfg -t=0A= > $SUBMIT_DIR/bash/bash_mpirun.tpl $RUN_DIR=0A= > where SUBMIT_DIR and RUN_DIR are kept exactly the same. The job failed=0A= > with the message:=0A= > "job name already in use, can't create new folder"=0A= >=0A= > However if for the restart I specify a different RUN_DIR (like=0A= > $RUN_DIR_restart) and modify the restart option like=0A= > TBG_restart=3D"--restart --restart-directory=0A= > /simOutput/checkpoints" then everything works just fine.=0A= >=0A= > Could you please confirm that using tbg one needs to create a separate=0A= > directory for the restart?=0A= >=0A= > Best regards,=0A= > Danila.=0A= =0A= --=0A= =0A= Axel Huebl=0A= Phone +49 351 260 3582=0A= https://www.hzdr.de/crp=0A= Computational Radiation Physics=0A= Laser Particle Acceleration Division=0A= Helmholtz-Zentrum Dresden - Rossendorf e.V.=0A= =0A= Bautzner Landstrasse 400, 01328 Dresden=0A= POB 510119, D-01314 Dresden=0A= Vorstand: Prof. Dr.Dr.h.c. R. Sauerbrey=0A= Prof. Dr.Dr.h.c. P. Joehnk=0A= VR 1693 beim Amtsgericht Dresden=0A= =0A= #############################################################=0A= This message is sent to you because you are subscribed to=0A= the mailing list .=0A= To unsubscribe, E-mail to: =0A= To switch to the DIGEST mode, E-mail to =0A= To switch to the INDEX mode, E-mail to =0A= Send administrative queries to =0A= =0A=