Return-Path: Received: from mx2.fz-rossendorf.de ([149.220.142.12] verified) by hzdr.de (CommuniGate Pro SMTP 6.1.12) with ESMTP id 15525963 for picongpu-users@cg.hzdr.de; Mon, 23 Jan 2017 14:23:45 +0100 Received: from localhost (localhost [127.0.0.1]) by mx2.fz-rossendorf.de (Postfix) with ESMTP id 3D71D422AA for ; Mon, 23 Jan 2017 14:23:45 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mx2.fz-rossendorf.de Received: from mx2.fz-rossendorf.de ([127.0.0.1]) by localhost (mx2.fz-rossendorf.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id m5E_ssL0pLyT for ; Mon, 23 Jan 2017 14:23:40 +0100 (CET) Received-SPF: Pass (sender SPF authorized) identity=mailfrom; client-ip=147.231.234.10; helo=mailgw.eli-beams.eu; envelope-from=prvs=119614220e=danila.khikhlukha@eli-beams.eu; receiver=picongpu-users@hzdr.de Received: from mailgw.eli-beams.eu (mailgw.eli-beams.eu [147.231.234.10]) by mx2.fz-rossendorf.de (Postfix) with ESMTPS id 5F3614229E for ; Mon, 23 Jan 2017 14:23:40 +0100 (CET) Received: from mail.eli-beams.eu ([10.1.5.17]) by mailgw.eli-beams.eu with ESMTP id v0NDNab5023957-v0NDNab7023957 (version=TLSv1.0 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=CAFAIL) for ; Mon, 23 Jan 2017 14:23:36 +0100 Received: from BRAUN.eli-beams.eu ([::1]) by braun.eli-beams.eu ([::1]) with mapi id 14.03.0319.002; Mon, 23 Jan 2017 14:23:36 +0100 From: Khikhlukha Danila To: "picongpu-users@hzdr.de" Subject: Restart with TBG Thread-Topic: Restart with TBG Thread-Index: AdJ1eI51kKl9Gk4oT+OhBOGXUkmTdg== Date: Mon, 23 Jan 2017 13:23:35 +0000 Message-ID: Accept-Language: en-US, cs-CZ Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.36.30.5] Content-Type: multipart/alternative; boundary="_000_BA7C853FEE430847B9C35FFCC6E5B2A52A31D8B6braunelibeamseu_" MIME-Version: 1.0 --_000_BA7C853FEE430847B9C35FFCC6E5B2A52A31D8B6braunelibeamseu_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Dear all, Am I correct that to run a restart using tgb one needs to specify a new out= put directory? Indeed, after the first simulation finished I have just added following lin= es to the submit submit file: TBG_restart=3D"--restart" ... TBG_programParams=3D"!TBG_devices \ !TBG_gridSize \ !TBG_steps \ !TBG_movingWindow \ !TBG_restart \ !TBG_plugins" After that I have launched the simulation with the command: tbg -s bash -c $SUBMIT_DIR/0001gpus.cfg -t $SUBMIT_DIR/bash/bash_mpirun.tpl= $RUN_DIR where SUBMIT_DIR and RUN_DIR are kept exactly the same. The job failed with= the message: "job name already in use, can't create new folder" However if for the restart I specify a different RUN_DIR (like $RUN_DIR_res= tart) and modify the restart option like TBG_restart=3D"--restart --restart= -directory /simOutput/checkpoints" then everything works just = fine. Could you please confirm that using tbg one needs to create a separate dire= ctory for the restart? Best regards, Danila. --_000_BA7C853FEE430847B9C35FFCC6E5B2A52A31D8B6braunelibeamseu_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Dear all,
Am I correct that to run a restart using tgb one needs to specify a new out= put directory?
Indeed, after the first simulation finished I have just added following lin= es to the submit submit file:
TBG_restart=3D"--restart"
...
TBG_programParams=3D"!TBG_devices      \ = ;            &n= bsp;            = ;            &n= bsp;            = ;            &n= bsp;            = ;     
            &nb= sp;      !TBG_gridSize     \&n= bsp;            = ;            &n= bsp;            = ;            &n= bsp;            = ;            &n= bsp;     
            &nb= sp;      !TBG_steps     &= nbsp;  \          &n= bsp;            = ;            &n= bsp;            = ;            &n= bsp;            = ;        
            &nb= sp;      !TBG_movingWindow \   &nbs= p;            &= nbsp;           &nbs= p;            &= nbsp;           &nbs= p;            &= nbsp;           &nbs= p;  
            &nb= sp;      !TBG_restart   &nbs= p;  \           = ;            &n= bsp;            = ;            &n= bsp;            = ;            &n= bsp;       
            &nb= sp;      !TBG_plugins"    = ;
After that I have launched the simulation with the command:
tbg -s bash -c $SUBMIT_DIR/0001gpus.cfg -t $SUBMIT_DIR/bash/bash_mpirun.tpl= $RUN_DIR
where SUBMIT_DIR and RUN_DIR are kept exactly the same. The job failed with= the message:
"job name already in use, can't create new folder"

However if for the restart I specify a different RUN_DIR (like $RUN_DIR_res= tart) and modify the restart option like TBG_restart=3D"--restart --re= start-directory <old_run_dir>/simOutput/checkpoints" then everyt= hing works just fine.

Could you please confirm that using tbg one needs to create a separate dire= ctory for the restart?

Best regards,
Danila.
--_000_BA7C853FEE430847B9C35FFCC6E5B2A52A31D8B6braunelibeamseu_--