DQCS Shift Notes and Checklist

Documentation

Prerequisites

  • ☐ ELog access

  • ☐ Subscribed to lhcb-simulation, lhcb-distributed-analysis, lhcb-geoc mailing lists

  • ☐ Join Simulation and Computing Operations Mattermost Channels

  • ☐ Get Grid Certificate

  • lhcb_shifter role available on DIRAC portal

  • ☐ test generation of DQCS report made from this or this repo

MC Quality checks

Nightly Tests docs Gauss LHCbPR Tests docs Dirac portal docs

Every couple of hours

  • ☐ Monitor Dirac Portal plots for anomalies and report it on Operation channel monitoring the plots on desktops (Concezio Bozzi’s ones are OK). They appear going to “Settings->Group : lhcb_shifter”. Then go to “Application->Administration->Public State Manager”, select “Desktops->Shared Desktops” and choose the desktop with saved the plots to inspect. Report in Computing Operations

Once a Day

Once a Week

For each slot, check:

  • the given slot builds for all platforms

  • all merge requests were successfully merged in the given nightly slot
    • if there is an arrow next to the project name, click on the blue page icon and verify it in checkout log

  • there are no new test failures that appeared for the x86_64_v2-centos7-gcc11-opt platform
    • compare to previous build (or few builds) using the [Compare with previous builds] button

    • compare the latest lhcb-sim10-dev slot with the latest lhcb-sim10 slot using the [Compare slots] button

Warning

lhcb-sim11 has more platform that needs to be monitored:

  • x86_64_v2-centos7-gcc11+detdesc-opt,

  • x86_64_v2-centos7-gcc12-opt,

  • x86_64_v2-centos7-gcc12+detdesc-opt

  • x86_64_v2-el9-gcc12-opt

Note

The *-dbg tags are less important, especially as far as tests are concerned.

Week schedule

Friday before

Monday

  • time=10:00 copy and update LHCb Computing Operations meeting event and chair it asking news about the tiers and other topics

  • ☐ do Once a day tasks

  • ☐ check nightly report prepared by the previous shifter and update it using this repo and update Simulation Data Quality codimd

Tuesday

  • ☐ do Once a day tasks

  • time=16:30 attend Simulation Meeting reporting information on previous week and upload a .md and a .html copy of this codimd

  • ☐ clear out tables on codimd and start preparing the report for the next shifter

Wednesday

  • time=10:00 copy and update LHCb Computing Operations meeting event and chair it asking news about the tiers and other topics

  • ☐ do Once a day tasks

Thursday

  • ☐ do Once a day tasks

Friday

  • time=10:00 copy and update LHCb Computing Operations meeting event and chair it asking news about the tiers and other topics

  • ☐ do Once a week tasks

  • ☐ do Once a day tasks

Saturday

  • ☐ do Once a day tasks

Sunday

  • ☐ do Once a day tasks

  • ☐ generate nightly report using this repo and update the codimd for the next user