NorduGrid 2017

27 Jun 2017, 09:00 → 30 Jun 2017, 13:00 Europe/Oslo

Teknologibygget (Tromsø, Norway)

Farid Ould-Saada (University of Oslo)

From Data Factories to Insight as a Service

The Annual NorduGrid Conference 2017 will be held in Tromsø, Norway, on June 28-30. As usual, the plenary conference days will be preceeded by the Technical Workshop starting already on Tuesday morning, June 27. 

The Annual Nordugrid Conference is a long running tradition and the major annual gathering of the scientific community around the ARC middleware and thus brings together people from data intensive science and distributed computing including resource providers, technology developers and scientists both from academia and industry.

The conference theme this year is "From Data Factories to Insight as a Service" and will include presentations along the following three main topics, in addition to ARC reports:

• Data factories (sensor data from Internet of Things, large databases and datasets from both HPC simulations and data producing experimental instruments)
• Future computing (exascale directions, quantum computing, services and components for data intensive applications)
• Knowledge building (scientific insight gained from data analytics, unconventional workflows)

 

Participants are kindly asked to register and indicate whether they will attend both the plenary conference (Wednesday 14:00 - Friday 12:00)  and the technical workshop (Tuesday 8:00 - Wednesday 12:00), or either of the events.

Tuesday, 27 June

09:00 → 18:00 Technical workshop

Preliminary list of topics. The actual agenda will be fixed on Tuesday morning.

1) The next generation Information Index Service for ARC: ARCHERY, the ARC Hierarchical Endpoints Registry.
--Intro presentation by Andrii Salnikov
--Discussion on deployment, operation, migration & retirement of the old EGIS framework.

2) Managing VO-based access control in ARC (authgroups and other VO related concepts) versus VO's in ATLAS/WLCG.
--Initial presentation by Andrej Filipcic and Oxana,
--Discussion

3) Elasticsearch and ARC
-- presentation by Dmytro
-- discussion

4) ACT-ARC
-- presentation by Maiken

5) Evolution of ATLAS Distributed Data Management and its possible impact on ARC future,
-- presentation by Vincent Garonne
-- discussion

6) Living in a world of no Globus: the effects of the Globus support discontinuation news.
-- presentation by Mattias
-- discussion

7) Post mortem analysis and report on recent ARC instability troubles: the problem(s), the fixes and the lesson learnt.
-- Intro by Oxana and Aleksander
-- Discussion

8) Misuse of mutexes and broken state of locking in ARC. Problems with sqlite3 delegation db.
-- Presentation by Ulf

9) Infosys I/O performance tests in the control-directory.
-- Presentation by Florido
-- discussion afterwards

10) Feedback from KIT/German cloud (to be confirmed)

11) Status Report from the ARC release manager: release plans, release procedures, svn status. Content of the next major release.
-- presentation by Maiken followed by discussions

12) Client-side development: API status, support status and plans for python, java, etc.. and the bad practice of coding against the CLI.
-- Initial presentation by Martin
-- discussion

13) The new ARC config (server-side).
-- presentation by Balazs,
-- discussion

slides

• act-ARC-LOCAL-Maiken.pptx
• arc_conf_tromso.pptx
• ARC-release-procedures-Maiken.pptx
• ARC-SDK-overview-2017-Tromsø.odp
• ATLAS_DDM__Evolution_&_Impact_on_ARC.pptx
• bugs.odp
• Globus-ARC.pdf
• The next generation Information Index Service for ARC: ARCHERY, the ARC Hierarchical Endpoints Registry
• Tromso-tech-meeting-agenda-and-notes.txt
• Ulf_Tigerstedt_pres1.pdf
• Ulf_Tigerstedt_pres2.pdf
• VO discussion

Wednesday, 28 June

09:00 → 10:00 Board meeting: Open Forum

10:00 → 12:00 Board meeting: Closed meeting

10:00 → 10:30 Break

10:30 → 13:00 Technical workshop: one-to-one discussions

Preliminary list of topics. The actual agenda will be fixed on Tuesday morning.

1) The next generation Information Index Service for ARC: ARCHERY, the ARC Hierarchical Endpoints Registry.
--Intro presentation by Andrii Salnikov
--Discussion on deployment, operation, migration & retirement of the old EGIS framework.

2) Managing VO-based access control in ARC (authgroups and other VO related concepts) versus VO's in ATLAS/WLCG.
--Initial presentation by Andrej Filipcic and Oxana,
--Discussion

3) Elasticsearch and ARC
-- presentation by Dmytro
-- discussion

4) ACT-ARC
-- presentation by Maiken

5) Evolution of ATLAS Distributed Data Management and its possible impact on ARC future,
-- presentation by Vincent Garonne
-- discussion

6) Living in a world of no Globus: the effects of the Globus support discontinuation news.
-- presentation by Mattias
-- discussion

7) Post mortem analysis and report on recent ARC instability troubles: the problem(s), the fixes and the lesson learnt.
-- Intro by Oxana and Aleksander
-- Discussion

8) Misuse of mutexes and broken state of locking in ARC. Problems with sqlite3 delegation db.
-- Presentation by Ulf

9) Infosys I/O performance tests in the control-directory.
-- Presentation by Florido
-- discussion afterwards

10) Feedback from KIT/German cloud (to be confirmed)

11) Status Report from the ARC release manager: release plans, release procedures, svn status. Content of the next major release.
-- presentation by Maiken followed by discussions

12) Client-side development: API status, support status and plans for python, java, etc.. and the bad practice of coding against the CLI.
-- Initial presentation by Martin
-- discussion

13) The new ARC config (server-side).
-- presentation by Balazs,
-- discussion

slides

• act-ARC-LOCAL-Maiken.pptx
• arc_conf_tromso.pptx
• ARC-release-procedures-Maiken.pptx
• ARC-SDK-overview-2017-Tromsø.odp
• ATLAS_DDM__Evolution_&_Impact_on_ARC.pptx
• bugs.odp
• Globus-ARC.pdf
• The next generation Information Index Service for ARC: ARCHERY, the ARC Hierarchical Endpoints Registry
• Tromso-tech-meeting-agenda-and-notes.txt
• Ulf_Tigerstedt_pres1.pdf
• Ulf_Tigerstedt_pres2.pdf
• VO discussion

12:00 → 14:00 Norwegian Tier-1: Closed session

13:00 → 14:00 Lunch

14:00 → 15:40 Conference: Plenary Session 1

14:00 Welcome to the Plenary Conference and introduction of local activities

Speaker: Roy Dragseth

14:30 The NorduGrid Collaboration - Status and Plans

Speaker: Farid Ould-Saada (UiO)

14:50 Norwegian eInfrastructure for Research and Education

Speaker: Gunnar Bøe

15:20 Status and advances of ARC

Speaker: Balázs Kónya (LU)

Slides ng2017_balazs_konya.pptx

15:40 → 16:10 Break

16:10 → 18:40 Conference: Plenary Session 2

16:10 DIRAC software framework

Speaker: Andrei Tsaregorodtsev (CPPM)

Slides DIRAC_NorduGRID_2017.pdf

16:40 NeIC - The Nordic eInfrastructure Collaboration

Speaker: Mattias Wadenstein (NeIC)

Slides 20170628-NeIC-and-Nordugrid.pdf

17:10 ALICE Computing

Speaker: Dr Boris Wagner (University of Bergen)

Slides nordugridConference2017.pdf

17:35 HEP Software Foundation

Speaker: Dr James Catmore

Slides NorduGrid_HEPSW.pdf

19:30 → 20:30 Social program: Football

See here for details: https://indico.lucas.lu.se/event/573/page/1
Note: there will be a reception just after the demo session today. At around 18:00.
Then we go for dinner in town (starts at 20:00).

Thursday, 29 June

08:30 → 10:05 Conference: Plenary Session 3

08:30 The challenges of High luminosity LHC: computing, software and physics

Speaker: Borut Kersevan (IJS)

09:05 CERN-IT Challenges: the byte, the core and the bit

Speaker: Xavier Espinal (CERN)

Slides NDGF2017-CERN-IT-Challenges_v3.pdf

09:30 EISCAT-3D project

Speaker: John White (NeIC)

Slides EISCAT_NorduGrid.pdf

10:05 → 10:30 Break

10:30 → 13:00 Conference: Plenary Session 4

10:30 Virtualisation & containers - a RAL perspective

Speaker: Andrew Lahiff (RAL)

Slides NorduGrid2017_RAL.pdf

10:55 Web-service for FPGA synthesis using ARC-powered grid infrastructure

Speaker: Andrii Salnikov (Kyiv University)

Extended abstract https://docs.google.com/document/d/1tn9Zx0ouxaIcxXv44h_YLb2APbfxVuaK6leO4RN81PM/edit

Slides Nordugrid2017_STRAGS.pdf

11:20 How CodeRefinery can support ARC software and vice versa

In this short presentation I will introduce the CodeRefinery project and discuss recommendations for the ARC software maintenance and release cycle and how both projects could support each other.

Speaker: Radovan Bast (NeIC / UiT)

Slides http://bit.ly/nordugrid-2017

11:45 Machine learning and anomaly detection

Speaker: James Catmore (UiO)

Slides ML-Nordugrid.pdf

12:10 ELIXIR activities in Norway

Speaker: Lars Ailo Bongo (UiT)

Slides NorduGrid-Elixir.pptx

12:35 Population models

Is it possible to reverse the low total fertility rate (TFR) in the developed world? Using a hypothetical model of population we have analyzed the decline of the TFR which have took place in the background of ongoing global economic changes, and a liberalization process after the end of the Cold War. These phenomena have affected more that 110 millions of inhabitants of Central Europe and the Baltics and approximately 80 millions of inhabitants in Germany. The model has features of complex and evolving system of interacting individuals, and it enables to investigate a broad spectrum of input factors on individual decisions to limit the offspring. Evolving agents with simple implementation of AI features are key elements of the model. The model is in the initial state so we present initial ideas how to realize it.

Speaker: Jozef Černák (UPJS)

Slides tromso_cernak.pdf

13:00 → 14:00 Lunch

14:00 → 15:10 Demo: Introduction

14:00 Demo: Introduction to ARC, ARC Control Tower and ATLAS@home

Speaker: Andrej Filipcic (IJS)

14:45 Integrating Piz Daint @ CSCS in WLCG with ARC

Speaker: Mr Gianfranco Sciacca

Slides LHConCRAY-Nordugrid2017.pdf

15:10 → 15:40 Break

15:40 → 17:35 Demo: ARC at work

15:40 ARC frontend to HPC

-David Cameron: ARC and ATLAS Event Service for HPC

Speaker: David Cameron (UiO)

Slides NG_conf_17_demo_HPC.pptx

16:10 ARC frontend to Clouds

Speaker: Sigve Haug (UniBe)

Slides NGC17-ARC-Cloud-FE.pdf

16:40 ARC frontend to volunteer computing

Speaker: David Cameron (UiO)

Slides NG_conf_17_demo_BOINC.pptx

18:00 → 21:00 Social program

See here for details: https://indico.lucas.lu.se/event/573/page/1
Note: there will be a reception just after the demo session today. At around 18:00.
Then we go for dinner in town (starts at 20:00).

Friday, 30 June

08:30 → 09:50 Conference: Plenary Session 5

08:30 Advanced Computing and Cyberinfrastructure in the US : The View from the Texas Advanced Computing Center

Speaker: Dan Stanzione (TACC)

Slides TACC-NORDUGRID-JUNE-2017.pptx

09:10 PRACE in the European HPC landscape

Speaker: Serge Bogaerts (PRACE)

Slides PRACE_europeanHPClandscape_v1.pdf

09:50 → 10:10 Short Break

10:10 → 11:10 Conference: Plenary Session 5: Conclusion

10:10 From Data Factories to Insight as a Service: Conference summary and Outlook discussion

Speakers: All, Dr Sigve Haug

notes NGC17-Closing-Notes.pdf