Technical Coordination Weekly

Tuesday 14 Nov 2017, 14:00 → 15:30 Europe/Stockholm

Skype

Balazs Konya (Lunds universitet)

Technical coordination group members and invited persons

14 November 2017; 14:05 - 15:15
Present: Mattias, Balazs, Anders, Maiken, David, Aleksandr, Oxana

== News

EOSC is upon us, everybody is asked to endorse it, Balazs did :-) See https://ec.europa.eu/research/openscience/index.cfm?pg=open-science-cloud for details

ARC6 meeting for tomorrow: people with names mentioned in Wiki should report progress: http://wiki.nordugrid.org/wiki/Preparation_major_release_2017 ; Balazs will send a reminder.

Maiken continues working on localplugin. Some progress on patch collection, though mostly quiet.

Oxana attended GDB, which had two authorisation talks, believes that new authorisation model (oauth2 etc), AARC recommendations, should be taken seriously.

Anders started ARC6 nightly builds.

Mattias: Grid Community Forum is officially up, to take over from Globus. Has a mailing list so far (hosted by EGI), and a github repository.

Aleksandr works on bugs and stability.

David: an agreement was reached that Harvester will focus on HPC and pull-model while aCT will do push-model, to ARC and other CEs. In a longer term some more coherent approach may be achieved. ARC transfers scalability/bottlenecks should be discussed in Ljubljana. CSCS HPC site allocated 25000 cores for ATLAS submission tests, which worked well with simulation jobs (18-core jobs), except that some ancient version of ARC was used, crashing every minute or so. Gianfranco prepares nice slides.

== Data transfer scalability

Jens re-started discussion of stage-in scalability, ARC can't transfer many files fast anough to fill the nodes. One reason is that some parts of the code still have locks that cause entire A-REX to freeze; another problem is that A-REX is slow to pick up the finished transfers, so there are much fewer transfers than the settings allow. 1000 input files for a single job create a bottleneck; in NDGF distributed storage they may come from different locations. Some re-design (transfer overbooking) might help.

== Bugs

Little changes, only a new EMI-ES bug.

== Release

No bug fixes lately, so no bugfix release.

== A.O.B.

A git migration section should be scheduled for Ljubljana meeting, with a hands-on exercise, at least half a day.

 

14:00 → 14:20 News

ARC-related news from various activities

14:20 → 14:30 Actions follow-up

Follow-up on actions defined at the previous meeting

14:30 → 14:50 Release status

Coming release status

14:50 → 15:20 Bugs

New bugs since previous meeting, as well as blockers and critical ones

15:20 → 15:30 A.O.B.