Technical Coordination Weekly (extended)

Europe/Stockholm
Skype

Skype

Balazs Konya (Lunds universitet)
Description
Technical coordination group members and invited persons; dedicated to ARC 6 release preparation

1 November 2017, 10:00 - 11:10

Present: Balazs, Maiken, Andrii, Mattias, Martin, Anders, Florido, David, Oxana
 

= F2F technical meeting

Tech meeting: in Ljubljana, November 28 - December 1 (Tue-Fri), starting Tuesday morning and ending Friday noon. Balazs will start the Indico page with registration and agenda.
 

= ARC 6 preparation status

Checking status of components as in http://wiki.nordugrid.org/wiki/Preparation_major_release_2017
 

== New features

* Python-lrms (with-ssh): Martin only tested SLURM, LSF plugin also exists and also SCEAPI, but not tested. The latter is different, as only REST is allowed. The Chinese machines use a private build of ARC, tailored and not officially released, but it is used in production. Plugins for other batch systems do not exist yet. In particular, not for HTCondor, and HTCondor Python plugin will not be ready for ARC6. A week more is needed to finish SLURM testing. LSF status is unclear, tests were never done. Fork is not there, but would be nice to have, otherwise we'll end up with just SLURM support.

* Openssl update: mostly done, but may mean no support for older operating sustems. Mattias will investigate.

* Event-driven job processing: status unclear. Aleksandr indiicated last week that more work is needed, in terms of code clean-up and testing.

* ARC configuration: JURA is missing, is more than renaming. Given that every site needs it, careful migration instructions or tools are needed. A new responsible is needed, since Gabor moved on.

* New packages (incl. LDAP-free deployment, bug 3653). A review of current packaging is needed, and a proposal how to improve it. Mattias will give it a try, report in 2 weeks. Dropping EGIIS may help.

* Single defaults file: needs a coordinator, Florido will report in 2 weeks.

* zeroconf readiness: the main problem is that one needs a toy certificate, so not fully automatic. Zeroconf is needed for bost developers and sites, with some differences.Related to the defaults file. Andrii and Florido will iterate, not implementation-ready yet. May be ready only for 6.1

* Gridftp- and ldap-free installation for localplugin - related to new packaging, might be distribution-specific.

* ARCHERY - archery-manage is not released yet, and configuration is not decided yet, otherwise everything is in place. Deployment on nordugrid.org is yet to be done, Andrii provided a proposal, Anders wants to upgrade service first.

* REST interface - almost ready, and even documented in the sysadmin manual.

* New runtime environments: the code is in trunk for a year already, needs to be tested and packaged - maybe with A-REX, or maybe separately.

* Martin works on testutility (http://svn.nordugrid.org/trac/nordugrid/browser/contrib/arctestutility/trunk), will report in 2 weeks
 

== Clean-up

* Dropping EGIIS: needs to be done, registrations also need to be removed, and maybe queries in the client (may break backwards compatibility). Mattias is the best candidate. Maiken will do a ARC 6 copy of the event-driven branch for Mattias to work on it.

* Perflogging: unresolvable permission issue, the easiest way is to drop it, as it would need a complete redesign to be useful. Code can be kept, but configuration can be removed. David will formulate the proposal for the next meeting.

* Removing CREAM etc, ARC0 interface renaming - Balazs will come with a proposal.
 

== Data staging issues

Some issues are still open (e.g. bug 3620, and whatever problems Jens has), but probably won't be ready for ARC 6.
 

= Next meeting

Balazs will send a Doodle, in ~ 2 weeks.

 

There are minutes attached to this event. Show them.
    • 14:00 14:20
      News 20m
      ARC-related news from various activities
    • 14:20 14:30
      Actions follow-up 10m
      Follow-up on actions defined at the previous meeting
    • 14:30 14:50
      Release status 20m
      Coming release status
    • 14:50 15:20
      Bugs 30m
      New bugs since previous meeting, as well as blockers and critical ones
    • 15:20 15:30
      A.O.B. 10m