1、ENES and PRISM:ENES and PRISM:A European approach to A European approach to Earth System modellingEarth System modellingComputing in Atmospheric Sciences Workshop 2003and the PRISM team across EuropeComputing in Atmospheric Sciences Workshop 2003Slide 2OutlineENESThe PRISM project:partnersgoalsmodel
2、 componentsstandard physical interfacesarchitecture and GUIPRISM first coupler:Oasis3(08/2019):configuration communicationinterpolations/transformationsPRISM final coupler(12/2019)configuration,communication,interpolations/transformationsComputing in Atmospheric Sciences Workshop 2003Slide 3ENESClim
3、ate research in Europe:Societal/political needs in Europe high(IPCC,mitigation,)Recognised excellence;scientific diversity(models,approaches,)How to organise Earth System modelling in Europe?The one-big-centre-does-it-all not suitable:-expertise lies within national centres-diversity is key to resea
4、rch Need for shared infrastructures:-software(PRISM)-hardwareComputing in Atmospheric Sciences Workshop 2003Slide 4ENESENES:European Network for Earth System modelling Think tank to organize,plan and seek funding for efficient distributed Earth System modelling in Europe Follows a EuroClivar recomme
5、ndation Open to any institute/industry(MoU)Coordinated by Guy Brasseur(MPI,Hamburg)50 members so far(enes.org)Computing in Atmospheric Sciences Workshop 2003Slide 5A long term strategy:Jointly develop shared software infrastructure for Earth System modellingProvide European integrated service to acc
6、ess and use this infrastructureProvide and manage hyper-computing access by 2019PRISMENESComputing in Atmospheric Sciences Workshop 2003Slide 6The PRISM project PRISM:PRogram for Integrated Earth System Modelling A European project,started December 2019,fundedfor 3 years by the European Commission(4
7、.8 M)Coordinators:Guy Brasseur(MPI,Hamburg)Gerbrand Komen (KNMI,Amsterdam)PRISM Director:Reinhard Budich(MPI)Computing in Atmospheric Sciences Workshop 2003Slide 7=22 partners:leading climate research institutes and computer vendors MPG-IMET,Germany KNMI,Netherlands MPI-MAD,Germany Met-Office,UK URE
8、ADMY,UK IPSL,France Mto-France,France CERFACS,France DMI,Denmark SHMI,Sweden NERSC,Norway ETH Zurich,Switzerland ING,Italy MPI-BGC,Germany PIK,Germany ECMWF,Europe UCL-ASTR,Belgium NEC Europe FECIT/Fujitsu SGI Europe SUN EuropePRISM partnersComputing in Atmospheric Sciences Workshop 2003Slide 8Provi
9、de software infrastructure to easily assemble Earth system coupled models based on existing state-of-art European component models launch/monitor complex/ensemble Earth system simulationsPRISM goalsHelp climate modellers spend more time on science:Computing in Atmospheric Sciences Workshop 2003Slide
10、 9 Define and promote technical and scientific standards for ESM:Scientific standards:Physical interfaces between model components Global Earth System parameters Technical standards:Compiling,running,post-processing environment Architecture and Graphical User Interface Coupler and I/O software Data
11、and grid format Coding and qualityInteraction with other groups(ESMF,ESG/NOMADS,CF,RPN?,.)PRISM goalsComputing in Atmospheric Sciences Workshop 2003Slide 10Atmosphere:Mto-France(ARPEGE),MPG-IMET(ECHAM),IPSL(LMDZ),MetOffice(Unified Model),UREADMY,INGVAtmospheric Chemistry:MPG-IMET,UREADMY,IPSL,MetOff
12、ice,Mto-France,KNMILand Surface:IPSL(Orchide),MetOffice,MPG-IMET,UREADMY,Mto-France(ISBA)Sea Ice:NERSC,UCL-ASTR,MetOffice,IPSL,MPG-IMETOcean Biogeochemistry:MPI-BGC,IPSL,MPG-IMET,MetOfficeOcean:UREADMY,MetOffice(FOAM),MPI-M(HOPE),IPSL(OPA/ORCA)Regional Climate:SHMI,DMI,MetOfficeCoupler:CERFACS,NEC,C
13、CRLE,FECIT,SGI,MPI-MAD PRISM model componentsComputing in Atmospheric Sciences Workshop 2003Slide 11Ocean model1-Rainfall+int.energy2-Snowfall+int.energy3-Incoming solar radiat.4-Solar zenith angle5-Fraction of diffuse solar radiation6-Downward infrared radiation7-Sensitivity of atmos temp.&humidity
14、 to surf.fluxes1*-Sensible heat flux2*-Surf.emissivity 3*-Albedo,direct4*-Albedo,diffuse5*-Surf.radiative temp.6*-Evaporation+int.energy+Qlat7*-Wind stress8-Subgrid fractions1-Surface pressure2-4 Air temperature,humidity and wind5-Wind module6-Height of these 4 variables1*-rCd2*-rCe3*-rCh1x-Non sola
15、r heat flux2x-Solar radiation3x-Fresh water flux4x-Salt flux5x-Wind stress6x-U37x-Mass of snow and ice8-Subgrid fractions1*-Surf.Temp2*-Surf.Roughness3*-Displacement height4x-Surface velocity1-Continental runoff +internal Energy1-2 Temp./Salinity at sea-ice base3-Sea surface temperature4-Surf.radiat
16、ive temp.5-Surface ocean current6-Sea surface salinity7-Surface height8-Absorbed solar radiation (in first oceanic layer)Iceberg parameters12345678 Ocean surface moduleSurface layer turbulenceSea ice modelwave model+3412Atmosphere model Land surface modelNote on subgrid fractiondependance:x-Sea Ice
17、categories (incl.open ocean)*-Sea Ice or Land Surf.categoriesA proposal for PRISM standard O-A-SI physical interfaces:Computing in Atmospheric Sciences Workshop 2003Slide 12PRISM central server+PRISM local sitesGUI:adaptation of ECMWF prepIFS and SMS scheduler User/developerPrism centralserverPrism
18、localsiteWebWebPRISM architecture and GUI:Computing in Atmospheric Sciences Workshop 2003Slide 13Based on Oasis developed since 1991 in CERFACS to couple existing GCMs developed independently at the time:Models at relatively low resolution(10000-20000 pts)Small number of 2D coupling fields(10)Low co
19、upling frequency(once/day)flexibility was very important,efficiency not so much!performs:synchronisation of the component models coupling fields exchange and interpolation I/O actionstested on VPP5000,NEC SX5,SGI Octane and O3000,Compaq Alpha cluster,Linux PC cluster(MPI-Globus)PRISM first coupler:O
20、asis3 Computing in Atmospheric Sciences Workshop 2003Slide 14Oasis regular users:CERFACS METEO-FRANCE(France)IPSL-LODYC,LMD,LSCE(France)ECMWF(UK)UCL(Belgium)MPI-M&D(Germany)SMHI(Sweden)BMRC(Australia)IRI(USA)and:AWI(Germany)PIK(Germany)Met Office(UK)UGAMP(UK)KNMI(Netherlands)CSIRO(Australia)FSU/COAP
21、S(USA)LASG(China)JAMSTEC(Japan)?PRISM project first coupler:Oasis3Computing in Atmospheric Sciences Workshop 2003Slide 15PRISM project first coupler:Oasis3Oasis3 configuration:In text file namcouple read by Oasis3 at the beginning of the run,e.g.total run timenumber and names of component modelsnumb
22、er and names of coupling fields;for each field:source and target symbolic namecoupling and/or I/O status,coupling or I/O periodtransformations/interpolations Component model grid(longitudes,latitudes,masks,mesh surfaces,mesh corner locations)must be available in binary or NetCDF files.Computing in A
23、tmospheric Sciences Workshop 2003Slide 16PRISM project first coupler:Oasis3Oasis3 communication:New PRISM System model interface(PSMILe)based on MPI1 or MPI2 message passingParallel communication between parallel models and Oasis3 interpolation process A A A B B B A A Afile A A A O O O OOasis3Direct
24、 communication between models with same grid and partitioningI/O functionality(automatic switch between coupled and forced mode)Modularity:at each model time step,exchange is performed or not depending on users specifications in namcouple.Automatic time integration depending on users specificationCo
25、mputing in Atmospheric Sciences Workshop 2003Slide 17Oasis3 interpolations/transformationsPRISM project first coupler:Oasis3 A A A O O O OOasis3Oasis3=performed by separate sequential process=on 2D scalar fields only Interfacing with RPN Fast Scalar INTerpolator package nearest-neighbour,bilinear,bi
26、cubic for regular Lat-Lon grids Interfacing with SCRIP1.4 library(Los Alamos Software Release LACC 98-45):nearest-neighbour,1st and 2nd order conservative remapping for all grids bilinear and bicubic interpolation for logically-rectangular grids Bilinear and bicubic interpolation for reduced atmosph
27、eric grids Other spatial transformations:flux correction,merging,etc.General algebraic operations Computing in Atmospheric Sciences Workshop 2003Slide 18PRISM project final couplerHigher resolution,parallel and scalable modelsHigher coupling frequencies desirable Higher number of models and(3D)coupl
28、ing fieldsNeed to optimise and parallelise the couplerThe final PRISM coupler will be composed of:a Driver a Transformer a new PRISM System Model Interface LibraryComputing in Atmospheric Sciences Workshop 2003Slide 19PRISM project final couplerFinal coupler configuration(XML files):The user chooses
29、 the models through the GUI.Each component model comes with:an Application Description(AD)a Potential Model Input and Output Description(PMIOD).The user configures his particular coupled run through the GUI:total run time,etc.for each field described in the PMIOD:source or targetcoupling or I/O stat
30、us,coupling or I/O periodtransformations/interpolations,etc.Based on the users choice,the GUI produces the XML configuration files.At run-time the Driver reads and distributes configuration information.The PSMILes and Transformer act accordingly to the users specifications.Computing in Atmospheric S
31、ciences Workshop 2003Slide 20PRISM project final couplerFinal coupler communication:More elaborate PSMILe based on MPI1 or MPI2(grid definition transferred through the PSMILe API)Modularity as for Oasis3:at each model time step,exchange is performed or not depending on users specifications.As for Oa
32、sis3,automatic time integrationAs for Oasis3,I/O functionality(automatic switch between coupled and forced mode)Parallel communication:as for Oasis3+repartitioning.OB OB OBCCC O1 O1CCParallel calculation of interpolation weights and addresses in the source PSMILeExtraction of useful part of source f
33、ield only.Computing in Atmospheric Sciences Workshop 2003Slide 21Final coupler interpolations/transformations =as for Oasis3+Support of vector fieldsSupport of 3D fieldsMore flexibility for field combination/merging,etc.The PRISM project final couplerComputing in Atmospheric Sciences Workshop 2003Sl
34、ide 22ConclusionsENES and PRISMPRISM first coupler:Oasis3,now available PRISM final coupler prototype due 11/2019PRISM final coupler due 12/2019 and after PRISM?Follow-on project re-submitted at next EU-call in 2019(CAPRI rejected)International interaction and collaboration essential in all cases!en
35、es.org;http/cerfacs.fr/PRISM/prism.htmlvalckecerfacs.fr Computing in Atmospheric Sciences Workshop 2003Slide 23PRISM project first coupler:Oasis3Oasis3 communication;PSMILe API:Initialization:call prism_init_comp()Retrieval of component model local communicatorcall prism_get_localcomm()Coupling or I
36、/O field declarations(name,type,shape,local partition,)call prism_def_var(field_idx,)End of definitioncall prism_enddef()In model time stepping loop,coupling or I/O field exchangecall prism_put(field_id1,time,field_array1,ierror),call prism_get(field_id2,time,field_array2,ierror)=Automatic averaging
37、/accumulation,coupling exchange,and/or I/O depending on time argument and users specifications in namcoupleTermination:call prism_terminate()Computing in Atmospheric Sciences Workshop 2003Slide 24PRISM project final couplerFinal coupler communication;PSMILe API:As for Oasis3 PSMILe+Definition of gri
38、d(1D,2D,3D)call prism_def_grid()call prism_set_corners()call prism_set_mask()Definition of grid for vector and bundle fieldscall prism_set_vector()Call prism_set_subgrid()Coupling or I/O field declarations support vector,bundles,1D,2D and 3D fieldsExtraction of SCC and SMIOC information:call prism_g
39、et_persist()ATM SMIOC V1:from OCE,T1V2:to OCE,T2V3:to LANDuserLAND SMIOC V3:from ATMV4:from fileV4userOCE SMIOCV1:to ATM,T1V2:from ATM,T2userDriverTOCEATMLANDfileV4Definition PhaseOCE PMIODV1:out,metadata V1V2:in,metadata V2ATM PMIODV1:in,metadata V1V2:out,metadata V2V3:out,metadata V3LAND PMIODV3:i
40、n,metadata V3V4:in,metadata V4LAND ADATM ADOCE ADV2V1V1V3V4Deployment PhaseV2userComposition PhaseuserSCC ATM:.OCE:.LAND:.userDeployment PhaseV3V6V2V2V1V1V4V5V5V7V7Mj SMIOC V1:cf SCCV4:cf SCCuserMk SMIOC V4:cf SCCV5:in,fileV5,TnlV5kuserMi SMIOCV1:cf SCCV2:cf SCCV3:in,fileV3,TliuserComposition PhaseS
41、MIOC:Specific Model Input and Output Config.userSCC V1:Mi-Mj,Tli,TnlijV2:Mi-Mj,Tij(+V6)V4:Mj-MkuseruserSCC:Specific Coupling ConfigurationDriverTMiMjMkDefinition PhaseMi PMIODV1:out,metadata V1V2:out,metadata V2V3:in,metadata V3Mj PMIODV1:in,metadata V1V4:out,metadata V4Mk PMIODV4:in,metadata V4V5:i
42、n,metadata V5fileV6fileV3fileV5PMIOD:Potential Model Input and Output DescriptionMi:Model i T:TransformerComputing in Atmospheric Sciences Workshop 2003Slide 27Coupling infrastructureSupporting softwareScientificcodeRunning environmentSoftware structure of an Earth System ModelShareComputing in Atmospheric Sciences Workshop 2003Slide 28On going PRISM/ESMF collaborationCoupling infrastructureSupporting softwareUser codeRunning environmentPRISMESMFEarth System Model谢谢你的阅读v知识就是财富v丰富你的人生 Thank you