Return-Path: Received: from [95.90.215.139] (account widera@hzdr.de HELO [192.168.0.10]) by hzdr.de (CommuniGate Pro SMTP 6.1.12) with ESMTPSA id 14796933; Wed, 19 Oct 2016 16:59:33 +0200 User-Agent: K-9 Mail for Android In-Reply-To: References: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----WV2GCSU54GL57S7EYBR8LXD2BFR3E8" Content-Transfer-Encoding: 8bit Subject: Re: [PIConGPU-Users] Supercell concept From: =?ISO-8859-1?Q?Ren=E9_Widera?= Date: Wed, 19 Oct 2016 16:59:31 +0200 To: picongpu-users@hzdr.de,Khikhlukha Danila Message-ID: ------WV2GCSU54GL57S7EYBR8LXD2BFR3E8 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 Dear Danila, the volume per gpu needs to be a multiple of the superCell size. In your case 4176/8gpus=522. 522 is not dividable bei 8. 4160 cells in y direction should solve your problem. Please keep in mind if you change the superCell size to a value smaller than 128cells the most simulation run slower. The default size with 8x8x4 shows the best result for the most cases. best, René Am 19. Oktober 2016 16:46:28 MESZ, schrieb Khikhlukha Danila : >Dear all, >I have some troubles trying to specify a computational grid with moving >windows using picongpu v0.2.0. We were discussing this topic >previously, however I have the same problem again, so likely I >misunderstand something from the last time. > >So I'm trying to launch the simulation using 4 K80 cards: 8 GPU devices >overall. In the memory.param file I have specified the SuperCell layout >as (2,8,2). I want to have one GPU in transversal direction and 8 in >longitudinal. So in cfg file I specified: >TBG_gpu_x=1 >TBG_gpu_y=8 >TBG_gpu_z=1 > >Then I would like my real computational domain to have 256 x 3712 x 256 >cell. Since the moving window reduces the real domain by 1 GPU in y >direction, I specified my grid as 256 x 4176 x 256. (4176 = 9/8*3712) >TBG_gridSize="-g 256 4176 256" > >However, trying to submit such a cfg file I'm receiving an assertion >fail: > >void >picongpu::MySimulation::checkGridConfiguration(PMacc::DataSpace,PMacc::GridLayout) >[with unsigned int DIM = 3u]: Assertion`gridSizeLocal[i] % >MappingDesc::SuperCellSize::toRT()[i] == 0' failed. > >However 4176 % 8 == 0 and 256 % 2 == 0. > >Could you please guide me how to solve this issue? Looks like I >misunderstand the concept of the SuperCell. > >Thank you in advance, >Danila. -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet. ------WV2GCSU54GL57S7EYBR8LXD2BFR3E8 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit Dear Danila,

the volume per gpu needs to be a multiple of the superCell size.

In your case 4176/8gpus=522. 522 is not dividable bei 8.
4160 cells in y direction should solve your problem.

Please keep in mind if you change the superCell size to a value smaller than 128cells the most simulation run slower.
The default size with 8x8x4 shows the best result for the most cases.

best,

René

Am 19. Oktober 2016 16:46:28 MESZ, schrieb Khikhlukha Danila <Danila.Khikhlukha@eli-beams.eu>:
Dear all,
I have some troubles trying to specify a computational grid with moving windows using picongpu v0.2.0. We were discussing this topic previously, however I have the same problem again, so likely I misunderstand something from the last time.

So I'm trying to launch the simulation using 4 K80 cards: 8 GPU devices overall. In the memory.param file I have specified the SuperCell layout as (2,8,2). I want to have one GPU in transversal direction and 8 in longitudinal. So in cfg file I specified:
TBG_gpu_x=1
TBG_gpu_y=8
TBG_gpu_z=1

Then I would like my real computational domain to have 256 x 3712 x 256 cell. Since the moving window reduces the real domain by 1 GPU in y direction, I specified my grid as 256 x 4176 x 256. (4176 = 9/8*3712)
TBG_gridSize="-g 256 4176 256"

However, trying to submit such a cfg file I'm receiving an assertion fail:

void picongpu::MySimulation::checkGridConfiguration(PMacc::DataSpace<DIM>,PMacc::GridLayout<DIM>) [with unsigned int DIM = 3u]: Assertion`gridSizeLocal[i] % MappingDesc::SuperCellSize::toRT()[i] == 0' failed.

However 4176 % 8 == 0 and 256 % 2 == 0. 

Could you please guide me how to solve this issue? Looks like I misunderstand the concept of the SuperCell.

Thank you in advance,
Danila.


--
Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet. ------WV2GCSU54GL57S7EYBR8LXD2BFR3E8--