Index index by Group index by Distribution index by Vendor index by creation date index by Name Mirrors Help Search

slurm-config-23.02.0-4.1 RPM for noarch

From OpenSuSE Ports Tumbleweed for noarch

Name: slurm-config Distribution: openSUSE:Factory:zSystems
Version: 23.02.0 Vendor: openSUSE
Release: 4.1 Build date: Thu Mar 16 04:15:04 2023
Group: Productivity/Clustering/Computing Build host: s390zp23
Size: 8140 Source RPM: slurm-23.02.0-4.1.src.rpm
Summary: Config files and directories for slurm services
This package contains the slurm config files necessary direcories
for the slurm daemons.






* Wed Mar 15 2023 Christian Goll <>
  - slurm-plugins need to require pmix-pluginlib (bsc#1209260)
* Tue Mar 07 2023 Egbert Eich <>
  - Stop pulling firewall rules from github. There is no benefit to
    host these separately.
  - Remove pre-sle12 pieces.
* Wed Mar 01 2023 Egbert Eich <>
  - Add missing Provides:, Conflicts: and Obsoletes: to slurm-cray,
    slurm-hdf5 and slurm-testsuite to avoid package conflicts.
  - Unify Obsoletes:.
  - Consolidate spec files between different Slurm releases in
    Leap/SLE maintenance.
  - Add dependency for the general plugin package to the
    AcctGatherProfile HDF5 plugin.
  - Adjust node RealMemory in slurm.conf of test suite for 8G test
* Mon Feb 20 2023 Egbert Eich <>
  - updated to 23.02.0
    * Highlights
      + slurmctld - Add new RPC rate limiting feature. This is enabled through
      SlurmctldParameters=rl_enable, otherwise disabled by default.
      + Make scontrol reconfigure and sending a SIGHUP to the slurmctld behave
      the same. If you were using SIGHUP as a 'lighter' scontrol reconfigure
      to rotate logs please update your scripts to use SIGUSR2 instead.
      + Change cloud nodes to show by default. PrivateData=cloud is no longer
      + sreport - Count planned (FKA reserved) time for jobs running in
      IGNORE_JOBS reservations. Previously was lumped into IDLE time.
      + job_container/tmpfs - Support running with an arbitrary list of private
      mount points (/tmp and /dev/shm are the default, but not required).
      + job_container/tmpfs - Set more environment variables in InitScript.
      + Make all cgroup directories created by Slurm owned by root. This was the
      behavior in cgroup/v2 but not in cgroup/v1 where by default the step
      directories ownership were set to the user and group of the job.
      + accounting_storage/mysql - change purge/archive to calculate record ages
      based on end time, rather than start or submission times.
      + job_submit/lua - add support for log_user() from slurm_job_modify().
      + Run the following scripts in slurmscriptd instead of slurmctld:
      ResumeProgram, ResumeFailProgram, SuspendProgram, ResvProlog, ResvEpilog,
      and RebootProgram (only with SlurmctldParameters=reboot_from_controller).
      + Only permit changing log levels with 'srun --slurmd-debug' by root
      or SlurmUser.
      + slurmctld will fatal() when reconfiguring the job_submit plugin fails.
      + Add PowerDownOnIdle partition option to power down nodes after nodes
      become idle.
      + Add "[jobid.stepid]" prefix from slurmstepd and "slurmscriptd" prefix
      from slurmcriptd to Syslog logging. Previously was only happening when
      logging to a file.
      + Add purge and archive functionality for job environment and job batch
      script records.
      + Extend support for Include files to all "configless" client commands.
      + Make node weight usable for powered down and rebooting nodes.
      + Removed 'launch' plugin.
      + Add "Extra" field to job to store extra information other than a comment.
      + Add usage gathering for AMD (requires ROCM 5.5+) and NVIDIA gpus.
      + Add job's allocated nodes, features, oversubscribe, partition, and
      reservation to SLURM_RESUME_FILE output for power saving.
      + Automatically create directories for stdout/stderr output files. Paths
      may use %j and related substitution characters as well.
      + Add --tres-per-task to salloc/sbatch/srun.
      + Allow nodefeatures plugin features to work with cloud nodes.
      e.g. - Powered down nodes have no active changeable features.
    - Nodes can't be changed to other active features until powered down.
    - Active changeable features are reset/cleared on power down.
      + Make slurmstepd cgroups constrained by total configured memory from
      slurm.conf (NodeName=<> RealMemory=#) instead of total physical memory.
      + node_features/helpers - add support for the OR and parentheses operators
      in a --constraint expression.
      + slurmctld will fatal() when [Prolog|Epilog]Slurmctld are defined but
      are not executable.
      + Validate node registered active features are a super set of node's
      currently active changeable features.
      + On clusters without any PrologFlags options, batch jobs with failed
      prologs no longer generate an output file.
      + Add SLURM_JOB_START_TIME and SLURM_JOB_END_TIME environment variables.
      + Add SuspendExcStates option to slurm.conf to avoid suspending/powering
      down specific node states.
      + Add support for DCMI power readings in IPMI plugin.
      + slurmrestd served /slurm/v0.0.39 and /slurmdb/v0.0.39 endpoints had major
      changes from prior versions. Almost all schemas have been renamed and
      modified. Sites using OpenAPI Generator clients are highly suggested to
      upgrade to to using atleast version 6.x due to limitations with prior
      + Allow for --nodelist to contain more nodes than required by --nodes.
      + Rename "nodes" to "nodes_resume" in SLURM_RESUME_FILE job output.
      + Rename "all_nodes" to "all_nodes_resume" in SLURM_RESUME_FILE output.
      + Add jobcomp/kafka plugin.
      + Add new PreemptParameters=reclaim_licenses option which will allow higher
      priority jobs to preempt jobs to free up used licenses. (This is only
      enabled for with PreemptModes of CANCEL and REQUEUE, as Slurm cannot
      guarantee suspended jobs will release licenses correctly.)
      + hpe/slingshot - add support for the instant-on feature.
      + Add ability to update SuspendExc* parameters with scontrol.
      + Add ability to restore SuspendExc* parameters on restart with slurmctld
    - R option.
      + Add ability to clear a GRES specification by setting it to "0" via
      'scontrol update job'.
      + Add SLURM_JOB_OVERSUBSCRIBE environment variable for Epilog, Prolog,
      EpilogSlurmctld, PrologSlurmctld, and mail ouput.
      + System node down reasons are appended to existing reasons, separated
      by ':'.
      + New command scrun has been added. scrun acts as an Open Container
      Initiative (OCI) runtime proxy to run containers seamlessly via Slurm.
      + Fixed GpuFreqDef option. When set in slurm.conf, it will be used if
    - -gpu-freq was not explicitly set by the job step.
    * Configuration Changes
      + job_container.conf - Added "Dirs" option to list desired private mount
      + node_features plugins - invalid users specified for AllowUserBoot will
      now result in fatal() rather than just an error.
      + Deprecate AllowedKmemSpace, ConstrainKmemSpace, MaxKmemPercent, and
      + Allow jobs to queue even if the user is not in AllowGroups when
      EnforcePartLimits=no is set. This ensures consistency for all the
      Partition access controls, and matches the documented behavior for
      + Add InfluxDBTimeout parameter to acct_gather.conf.
      + job_container/tmpfs - add support for expanding %h and %n in BasePath.
      + slurm.conf - Removed SlurmctldPlugstack option.
      + Add new SlurmctldParameters=validate_nodeaddr_threads=<number> option to
      allow concurrent hostname resolution at slurmctld startup.
      + Add new AccountingStoreFlags=job_extra option to store a job's extra field
      in the database.
      + Add new "defer_batch" option to SchedulerParameters to only defer
      scheduling for batch jobs.
      + Add new DebugFlags option 'JobComp' to replace 'Elasticsearch'.
      + Add configurable job requeue limit parameter - MaxBatchRequeue - in
      slurm.conf to permit changes from the old hard-coded value of 5.
      + helpers.conf - Allow specification of node specific features.
      + helpers.conf - Allow many features to one helper script.
      + job_container/tmpfs - Add "Shared" option to support shared namespaces.
      This allows autofs to work with the job_container/tmpfs plugin when
      + acct_gather.conf - Added EnergyIPMIPowerSensors=Node=DCMI and
      + Add new "getnameinfo_cache_timeout=<number>" option to
      CommunicationParameters to adjust or disable caching the results of
      + Add new PrologFlags=ForceRequeueOnFail option to automatically requeue
      batch jobs on Prolog failures regardless of the job --requeue setting.
      + Add HealthCheckNodeState=NONDRAINED_IDLE option.
      + Add 'explicit' to Flags in gres.conf. This makes it so the gres is not
      automatically added to a job's allocation when --exclusive is used. Note
      that this is a per-node flag.
      + Moved the "preempt_" options from SchedulerParameters to
      PreemptParameters, and dropped the prefix from the option names.
      (The old options will still be parsed for backwards compatibility,
      but are now undocumented.)
      + Add LaunchParameters=ulimit_pam_adopt, which enables setting RLIMIT_RSS
      in adopted processes.
      + Update SwitchParameters=job_vni to enable/disable creating job VNIs
      for all jobs, or when a user requests them.
      + Update SwitchParameters=single_node_vni to enable/disable creating
      single node vnis for all jobs, or when a user requests them.
      + Add ability to preserve SuspendExc* parameters on reconfig with
      + slurmdbd.conf - Add new AllResourcesAbsolute to force all new resources
      to be created with the Absolute flag.
      + topology/tree - Add new TopologyParam=SwitchAsNodeRank option to reorder
      nodes based on switch layout. This can be useful if the naming convention
      for the nodes does not natually map to the network topology.
      + Removed the default setting for GpuFreqDef. If unset, no attempt to change
      the GPU frequency will be made if --gpu-freq is not set for the step.
    * Command Changes
      + sacctmgr - no longer force updates to the AdminComment, Comment, or
      SystemComment to lower-case.
      + sinfo - Add -F/--future option to sinfo to display future nodes.
      + sacct - Rename 'Reserved' field to 'Planned' to match sreport and the
      nomenclature of the 'Planned' node.
      + scontrol - advanced reservation flag MAINT will no longer replace nodes,
      similar to STATIC_ALLOC
      + sbatch - add parsing for #PBS -d and #PBS -w.
      + scontrol show assoc_mgr will show username(uid) instead of uid in
      QoS section.
      + Add strigger --draining and -R/--resume options.
      + Change --oversubscribe and --exclusive to be mutually exclusive for
      job submission. Job submission commands will now fatal if both are set.
      Previously, these options would override each other, with the last one
      in the job submission command taking effect.
      + scontrol - Requested TRES and allocated TRES will now always be printed
      when showing jobs, instead of one TRES output that was either the
      requested or allocated.
      + srun --ntasks-per-core now applies to job and step allocations. Now,
      use of --ntasks-per-core=1 implies --cpu-bind=cores and
    - -ntasks-per-core>1 implies --cpu-bind=threads.
      + salloc/sbatch/srun - Check and abort if ntasks-per-core >
      + scontrol - Add ResumeAfter=<secs> option to "scontrol update nodename=".
      + Add a new "nodes=" argument to scontrol setdebug to allow the debug
      level on the slurmd processes to be temporarily altered.
      + Add a new "nodes=" argument to "scontrol setdebugflags" as well.
      + Make it so scrontab prints client-side the job_submit() err_msg (which
      can be set i.e. by using the log_user() function for the lua plugin).
      + scontrol - Reservations will not be allowed to have STATIC_ALLOC or
      MAINT flags and REPLACE[_DOWN] flags simultaneously.
      + scontrol - Reservations will only accept one reoccurring flag when
      being created or updated.
      + scontrol - A reservation cannot be updated to be reoccurring if it is
      already a floating reservation.
      + squeue - removed unused '%s' and 'SelectJobInfo' formats.
      + squeue - align print format for exit and derived codes with that of
      other components (<exit_status>:<signal_number>).
      + sacct - Add --array option to expand job arrays and display array
      tasks on separate lines.
      + Partial support for '--json' and '--yaml' formated outputs have been
      implemented for sacctmgr, sdiag, sinfo, squeue, and scontrol. The
      resultant data ouput will be filtered by normal command arguments.
      Formatting arguments will continue to be ignored.
      + salloc/sbatch/srun - extended the --nodes syntax to allow for a list
      of valid node counts to be allocated to the job. This also supports
      a "step count" value (e.g., --nodes=20-100:20 is equivalent to
    - -nodes=20,40,60,80,100) which can simplify the syntax when the job
      needs to scale by a certain "chunk" size.
      + srun - add user requestible vnis with '--network=job_vni' option.
      + srun - add user requestible single node vnis with the
      '--network=single_node_vni' option.
    * API Changes
      + job_container plugins - container_p_stepd_create() function signature
      replaced uint32_t uid with stepd_step_rec_t* step.
      + gres plugins - gres_g_get_devices() function signature replaced pid_t
      pid with stepd_step_rec_t* step.
      + cgroup plugins - task_cgroup_devices_constrain() function signature
      removed pid_t pid.
      + task plugins - replace task_p_pre_set_affinity(), task_p_set_affinity(),
      and task_p_post_set_affinity() with task_p_pre_launch_priv() like it
      was back in slurm 20.11.
      + Allow for concurrent processing of job_submit_g_submit() and
      job_submit_g_modify() calls. If your plugin is not capable of concurrent
      operation you must add additional locking within your plugin.
      + Removed return value from slurm_list_append().
      + The List and ListIterator types have been removed in favor of list_t
      and list_itr_t respectively.
      + burst buffer plugins - add bb_g_build_het_job_script().
      bb_g_get_status() - added authenticated UID and GID.
      bb_g_run_script() - added job_info argument.
      + burst_buffer.lua - Pass UID and GID to most hooks. Pass job_info
      (detailed job information) to many hooks. See
      etc/burst_buffer.lua.example for a complete list of changes.
      WARNING: Backwards compatibility is broken for
      slurm_bb_get_status: UID and GID are passed before the variadic
      arguments. If UID and GID are not explicitly listed as arguments to
      slurm_bb_get_status(), then they will be included in the variadic
      Backwards compatibility is maintained for all other hooks because
      the new arguments are passed after the existing arguments.
      + node_features plugins - node_features_p_reboot_weight() function
      node_features_p_job_valid() - added parameter feature_list.
      node_features_p_job_xlate() - added parameters feature_list and
      + New data_parser interface with v0.0.39 plugin.
    * Added:    Fix-test-1.99.patch
    * Reworked: Fix-test-38.11.patch
* Thu Feb 09 2023 Egbert Eich <>
  - testsuite: on later SUSE versions claim ownership of directory
* Fri Dec 02 2022 Egbert Eich <>
  - Move the ext_sensors/rrd plugin to a separate package: this
    plugin requires librrd which in turn requires huge parts of
    the client side X Window System stack.
    There is probably no use in cluttering up a system for a
    plugin that probably only used by a few.
* Fri Oct 21 2022 Egbert Eich <>
  - Test Suite fixes:
    * Update
    * Clean up left over files when de-installing test suite.
    * Adjustment to test suite package: for SLE mark the openmpi4
      devel package and slurm-hdf5 optional.
    * Add -ffat-lto-objects to the build flags when LTO is set to
      make sure the object files we ship with the test suite still
      work correctly.
    * Improve copy ssh fingerprints from all nodes.
* Fri Oct 14 2022 Christian Goll <>
  - updated to 22.05.5
  - NOTE: Slurm validates that libraries are of the same version. Unfortunately,
    due to an oversight, we failed to notice that the slurmstepd loads the
    hash_k12 library only after a job has completed. This means that if the
    hash_k12 library is upgraded before a job finishes, the slurmstepd will load
    the new library when the job finishes, and will fail due to a mismatch of
    versions.  This results in nodes with slurmstepd processes stuck
    indefinitely. These processes require manual intervention to clean up. There
    is no clean way to resolve these hung slurmstepd processes.
    The only recommended way to upgrade between minor versions of 22.05 with
    RPM’s or upgrades that replace current binaries and libraries is to drain the
    nodes of running jobs first.
  - Fixes a number of moderate severity issues, noteable are:
    * Load hash plugin at slurmstepd launch time to prevent issues loading the
      plugin at step completion if the Slurm installation is upgraded.
    * Update nvml plugin to match the unique id format for MIG devices in new
      Nvidia drivers.
    * Fix multi-node step launch failure when nodes in the controller aren't in
      natural order. This can happen with inconsistent node naming (such as
      node15 and node052) or with dynamic nodes which can register in any order.
    * job_container/tmpfs - cleanup containers even when the .ns file isn't
      mounted anymore.
    * Wait up to PrologEpilogTimeout before shutting down slurmd to allow prolog
      and epilog scripts to complete or timeout. Previously, slurmd waited 120
      seconds before timing out and killing prolog and epilog scripts.
* Sat Sep 24 2022 Egbert Eich <>
  - Do not deduplicate files of testsuite Slurm configuration.
    This directory is supposed to be mounted over /etc/slurm
    therefore it must not contain softlinks to the files in
    this directory.
  - Improve .a and .o file collection for test suite: find these
    files even if there are multiple ones in a single line.
* Tue Sep 20 2022 Egbert Eich <>
  - Fix build for older product version.
* Tue Aug 02 2022 Egbert Eich <>
  - Fix a potential security vulnerability in the test package
    (bsc#1201674, CVE-2022-31251).
* Thu Jul 21 2022 Bernhard Wiedemann <>
  - make slurmtest.tar reproducible
* Thu Jul 14 2022 Egbert Eich <>
  - Improve check for mpicc in testsuite package: if binary isn't
    found, don't crash.
  - Patch NOFILE Limit in the slurmd.service copy for the testsuite.
* Mon Jun 20 2022 Christian Goll <>
  - update to 22.05.2 with following fixes:
    * Fix regression which allowed the oversubscription of licenses.
    * Fix a segfault in slurmctld when requesting gres in job arrays.
* Wed Jun 08 2022 Egbert Eich <>
  - Package the Slurm testsuite for QA purposes.
    NOTE: This package is not meant to be used for testing by the
    user but rather for testing by the maintainers to ensure the
    package is working properly.
    DO NOT report test suite failures unless you are able to confirm
    that the failure is really a bug.
    * Fixes for test suite:
    * Add documentation:
  - Allow log in as user 'slurm'. This allows admins to run certain
    priviledged commands more easily without becoming root.
* Tue May 31 2022 Christian Goll <>
  - update to 22.05.0 with following changes:
  - Support for dynamic node addition and removal
  - Support for native Linux cgroup v2 operation
  - Newly added plugins to support HPE Slingshot 11 networks
    (switch/hpe_slingshot), and Intel Xe GPUs (gpu/oneapi)
  - Added new acct_gather_interconnect/sysfs plugin to collect statistics
    from arbitrary network interfaces.
  - Expanded and synced set of environment variables available in the
    Prolog/Epilog/PrologSlurmctld/EpilogSlurmctld scripts.
  - New "--prefer" option to job submissions to allow for a "soft
    constraint" request to influence node selection.
  - Optional support for license planning in the backfill scheduler with
    "bf_licenses" option in SchedulerParameters.
  - removed file slurm-2.4.4-init.patch as sysvinit is now realy deprecated
  - removed file load-pmix-major-version.patch as fixed upstream
  - set environment variable SUSE_ZNOW to 0 in %build to avoid module load
    failures due to unresolved symbols as module take advantage of lazy
    bindings (bsc#1200030).
* Tue May 10 2022 Egbert Eich <>
  - Add a comment about the CommunicationParameters=block_null_hash
    option warning users who migrate - just in case.
* Fri May 06 2022 Christian Goll <>
  - Update to 21.08.8 which fixes CVE-2022-29500 (bsc#1199278),
    CVE-2022-29501 (bsc#1199279), and CVE-2022-29502 (bsc#1199281).
  - Added 'CommunicationParameters=block_null_hash' to slurm.conf, please
    add this parameter to existing configurations.
* Mon May 02 2022 Christian Goll <>
  - Update to 21.08.7 with following changes:
    * openapi/v0.0.37 - correct calculation for bf_queue_len_mean in /diag.
    * Avoid shrinking a reservation when overlapping with downed nodes.
    * Only check TRES limits against current usage for TRES requested by the job.
    * Do not allocate shared gres (MPS) in whole-node allocations
    * Constrain slurmstepd to job/step cgroup like in previous versions of Slurm.
    * Fix warnings on 32-bit compilers related to printf() formats.
    * Fix reconfigure issues after disabling/reenabling the GANG PreemptMode.
    * Fix race condition where a cgroup was being deleted while another step
      was creating it.
    * Set the slurmd port correctly if multi-slurmd
    * Fix FAIL mail not being sent if a job was cancelled due to preemption.
    * slurmrestd - move debug logs for HTTP handling to be gated by debugflag
      NETWORK to avoid unnecessary logging of communication contents.
    * Fix issue with bad memory access when shrinking running steps.
    * Fix various issues with internal job accounting with GRES when jobs are
    * Fix ipmi polling on slurmd reconfig or restart.
    * Fix srun crash when reserved ports are being used and het step fails
      to launch.
    * openapi/dbv0.0.37 - fix DELETE execution path on /user/{user_name}.
    * slurmctld - Properly requeue all components of a het job if PrologSlurmctld
    * rlimits - remove final calls to limit nofiles to 4096 but to instead use
      the max possible nofiles in slurmd and slurmdbd.
    * Allow the DBD agent to load large messages (up to MAX_BUF_SIZE) from state.
    * Fix potential deadlock during slurmctld restart when there is a completing
    * slurmstepd - reduce user requested soft rlimits when they are above max
      hard rlimits to avoid rlimit request being completely ignored and
      processes using default limits.
    * Fix Slurm user commands displaying available features as active features
      when no features were active.
    * Don't power down nodes that are rebooting.
    * Clear pending node reboot on power down request.
    * Ignore node registrations while node is powering down.
    * Don't reboot any node that is power<ing|ed> down.
    * Don't allow a node to reboot if it's marked for power down.
    * Fix issuing reboot and downing when rebooting a powering up node.
    * Clear DRAIN on node after failing to resume before ResumeTimeout.
    * Prevent repeating power down if node fails to resume before ResumeTimeout.
    * Fix federated cloud node communication with srun and cloud_dns.
    * Fix jobs being scheduled on nodes marked to be powered_down when idle.
    * Fix problem where a privileged user could not view array tasks specified by
      <array_job_id>_<task_id> when PrivateData had the jobs value set.
    - Changes in Slurm 21.08.6
    * Fix plugin_name definitions in a number of plugins to improve logging.
    * Close sbcast file transfers when job is cancelled.
    * scrontab - fix handling of --gpus and --ntasks-per-gpu options.
    * sched/backfill - fix job_queue_rec_t memory leak.
    * Fix magnetic reservation logic in both main and backfill schedulers.
    * job_container/tmpfs - fix memory leak when using InitScript.
    * slurmrestd / openapi - fix memory leaks.
    * Fix slurmctld segfault due to job array resv_list double free.
    * Fix multi-reservation job testing logic.
    * Fix slurmctld segfault due to insufficient job reservation parse validation.
    * Fix main and backfill schedulers handling for already rejected job array.
    * sched/backfill - restore resv_ptr after yielding locks.
    * acct_gather_energy/xcc - appropriately close and destroy the IPMI context.
    * Protect slurmstepd from making multiple calls to the cleanup logic.
    * Prevent slurmstepd segfault at cleanup time in mpi_fini().
    * Fix slurmctld sometimes hanging if shutdown while PrologSlurmctld or
      EpilogSlurmctld were running and PrologEpilogTimeout is set in slurm.conf.
    * Fix affinity of the batch step if batch host is different than the first
      node in the allocation.
    * slurmdbd - fix segfault after multiple failover/failback operations.
    * Fix jobcomp filetxt job selection condition.
    * Fix -f flag of sacct not being used.
    * Select cores for job steps according to the socket distribution. Previously,
      sockets were always filled before selecting cores from the next socket.
    * Keep node in Future state if epilog completes while in Future state.
    * Fix erroneous --constraint behavior by preventing multiple sets of brackets.
    * Make ResetAccrueTime update the job's accrue_time to now.
    * Fix sattach initialization with configless mode.
    * Revert packing limit checks affecting pmi2.
    * sacct - fixed assertion failure when using -c option and a federation
    * Fix issue that allowed steps to overallocate the job's memory.
    * Fix the sanity check mode of AutoDetect so that it actually works.
    * Fix deallocated nodes that didn't actually launch a job from waiting for
      Epilogslurmctld to complete before clearing completing node's state.
    * Job should be in a completing state if EpilogSlurmctld when being requeued.
    * Fix job not being requeued properly if all node epilog's completed before
      EpilogSlurmctld finished.
    * Keep job completing until EpilogSlurmctld is completed even when "downing"
      a node.
    * Fix handling reboot with multiple job features.
    * Fix nodes getting powered down when creating new partitions.
    * Fix bad bit_realloc which potentially could lead to bad memory access.
    * slurmctld - remove limit on the number of open files.
    * Fix bug where job_state file of size above 2GB wasn't saved without any
      error message.
    * Fix various issues with no_consume gres.
    * Fix regression in 21.08.0rc1 where job steps failed to launch on systems
      that reserved a CPU in a cgroup outside of Slurm (for example, on systems
      with WekaIO).
    * Fix OverTimeLimit not being reset on scontrol reconfigure when it is
      removed from slurm.conf.
    * serializer/yaml - use dynamic buffer to allow creation of YAML outputs
      larger than 1MiB.
    * Fix minor memory leak affecting openapi users at process termination.
    * Fix batch jobs not resolving the username when nss_slurm is enabled.
    * slurmrestd - Avoid slurmrestd ignoring invalid HTTP method if the response
      serialized without error.
    * openapi/dbv0.0.37 - Correct conditional that caused the diag output to
      give an internal server error status on success.
    * Make --mem-bind=sort work with task_affinity
    * Fix sacctmgr to set MaxJobsAccruePer{User|Account} and MinPrioThres in
      sacctmgr add qos, modify already worked correctly.
    * job_container/tmpfs - avoid printing extraneous error messages in Prolog
      and Epilog, and when the job completes.
    * Fix step CPU memory allocation with --threads-per-core without --exact.
    * Remove implicit --exact when --threads-per-core or --hint=nomultithread
      is used.
    * Do not allow a step to request more threads per core than the
      allocation did.
    * Remove implicit --exact when --cpus-per-task is used.
* Wed Dec 22 2021 Christian Goll <>
  - update to 21.08.5 with following changes:
    * Fix issue where typeless GRES node updates were not immediately reflected.
    * Fix setting the default scrontab job working directory so that it's the home
      of the different user (*u <user>) and not that of root or SlurmUser editor.
    * Fix stepd not respecting SlurmdSyslogDebug.
    * Fix concurrency issue with squeue.
    * Fix job start time not being reset after launch when job is packed onto
      already booting node.
    * Fix updating SLURM_NODE_ALIASES for jobs packed onto powering up nodes.
    * Cray - Fix issues with starting hetjobs.
    * auth/jwks - Print fatal() message when jwks is configured but file could
      not be opened.
    * If sacctmgr has an association with an unknown qos as the default qos
      print 'UNKN*###' instead of leaving a blank name.
    * Correctly determine task count when giving --cpus-per-gpu, --gpus and
    * -ntasks-per-node without task count.
    * slurmctld - Fix places where the global last_job_update was not being set
      to the time of update when a job's reason and description were updated.
    * slurmctld - Fix case where a job submitted with more than one partition
      would not have its reason updated while waiting to start.
    * Fix memory leak in node feature rebooting.
    * Fix time limit permanetly set to 1 minute by backfill for job array tasks
      higher than the first with QOS NoReserve flag and PreemptMode configured.
    * Fix sacct -N to show jobs that started in the current second
    * Fix issue on running steps where both SLURM_NTASKS_PER_TRES and
      SLURM_NTASKS_PER_GPU are set.
    * Handle oversubscription request correctly when also requesting
    * -ntasks-per-tres.
    * Correctly detect when a step requests bad gres inside an allocation.
    * slurmstepd - Correct possible deadlock when UnkillableStepTimeout triggers.
    * srun - use maximum number of open files while handling job I/O.
    * Fix writing to Xauthority files on root_squash NFS exports, which was
      preventing X11 forwarding from completing setup.
    * Fix regression in 21.08.0rc1 that broke --gres=none.
    * Fix srun --cpus-per-task and --threads-per-core not implicitly setting
    * -exact. It was meant to work this way in 21.08.
    * Fix regression in 21.08.0 that broke dynamic future nodes.
    * Fix dynamic future nodes remembering active state on restart.
    * Fix powered down nodes getting stuck in COMPLETING+POWERED_DOWN when job is
      cancelled before nodes are powering up.
* Wed Nov 17 2021 Christian Goll <>
  - updated to 21.08.4 which fixes (CVE-2021-43337) which is only present
    in 21.08 tree.
    * CVE-2021-43337:
      For sites using the new AccountingStoreFlags=job_script and/or job_env
      options, an issue was reported with the access control rules in SlurmDBD
      that will permit users to request job scripts and environment files that
      they should not have access to. (Scripts/environments are meant to only be
      accessible by user accounts with administrator privileges, by account
      coordinators for jobs submitted under their account, and by the user
  - changes from 21.08.3:
    * This includes a number of fixes since the last release a month ago,
      including one critical fix to prevent a communication issue between
      slurmctld and slurmdbd for sites that have started using the new
      AccountingStoreFlags=job_script functionality.
* Fri Oct 29 2021 Egbert Eich <>
  - Utilize sysuser infrastructure to set user/group slurm.
    For munge authentication slurm should have a fixed UID across
    all nodes including the management server. Set it to 120
  - Limit firewalld service definitions to SUSE versions >= 15.
* Mon Oct 18 2021 Christian Goll <>
  - added service definitions for firewalld (JSC#SLE-22741)
* Wed Oct 06 2021 Christian Goll <>
  - update to 21.08.2
  - major change:
    * removed of support of the TaskAffinity=yes option in cgroup.conf. Please
      consider using "TaskPlugins=cgroup,affinity" in slurm.conf as an option.
  - minor changes and bugfixes:
    * slurmctld - fix how the max number of cores on a node in a partition are
      calculated when the partition contains multi*socket nodes. This in turn
      corrects certain jobs node count estimations displayed client*side.
    * job_submit/cray_aries - fix "craynetwork" GRES specification after changes
      introduced in 21.08.0rc1 that made TRES always have a type prefix.
    * Ignore nonsensical check in the slurmd for [Pro|Epi]logSlurmctld.
    * Fix writing to stderr/syslog when systemd runs slurmctld in the foreground.
    * Fix issue with updating job started with node range.
    * Fix issue with nodes not clearing state in the database when the slurmctld
      is started with clean*start.
    * Fix hetjob components > 1 timing out due to InactiveLimit.
    * Fix sprio printing -nan for normalized association priority if
      PriorityWeightAssoc was not defined.
    * Disallow FirstJobId=0.
    * Preserve job start info in the database for a requeued job that hadn't
      registered the first time in the database yet.
    * Only send one message on prolog failure from the slurmd.
    * Remove support for TaskAffinity=yes in cgroup.conf.
    * accounting_storage/mysql - fix issue where querying jobs via sacct
    * -whole-hetjob=yes or slurmrestd (which automatically includes this flag)
      could in some cases return more records than expected.
    * Fix issue for preemption of job array task that makes afterok dependency
      fail. Additionally, send emails when requeueing happens due to preemption.
    * Fix sending requeue mail type.
    * Properly resize a job's GRES bitmaps and counts when resizing the job.
    * Fix node being able to transition to CLOUD state from non-cloud state.
    * Fix regression introduced in 21.08.0rc1 which broke a step's ability to
      inherit GRES from the job when the step didn't request GRES but the job did.
    * Fix errors in logic when picking nodes based on bracketed anded constraints.
      This also enforces the requirement to have a count when using such
    * Handle job resize better in the database.
    * Exclude currently running, resized jobs from the runaway jobs list.
    * Make it possible to shrink a job more than once.
* Tue Sep 28 2021 Christian Goll <>
  - moved pam module from /lib64 to /usr/lib64 which fixes boo#1191095
    via the macro %_pam_moduledir
* Fri Sep 17 2021 Christian Goll <>
  - updated to 21.08.1 with following bug fixes:
    * Fix potential memory leak if a problem happens while allocating GRES for
      a job.
    * If an overallocation of GRES happens terminate the creation of a job.
    * AutoDetect=nvml: Fatal if no devices found in MIG mode.
    * Print federation and cluster sacctmgr error messages to stderr.
    * Fix off by one error in --gpu-bind=mask_gpu.
    * Add --gpu-bind=none to disable gpu binding when using --gpus-per-task.
    * Handle the burst buffer state "alloc-revoke" which previously would not
      display in the job correctly.
    * Fix issue in the slurmstepd SPANK prolog/epilog handler where configuration
      values were used before being initialized.
    * Restore a step's ability to utilize all of an allocations memory if --mem=0.
    * Fix --cpu-bind=verbose garbage taskid.
    * Fix cgroup task affinity issues from garbage taskid info.
    * Make gres_job_state_validate() client logging behavior as before 44466a4641.
    * Fix steps with --hint overriding an allocation with --threads-per-core.
    * Require requesting a GPU if --mem-per-gpu is requested.
    * Return error early if a job is requesting --ntasks-per-gpu and no gpus or
      task count.
    * Properly clear out pending step if unavailable to run with available
    * Kill all processes spawned by burst_buffer.lua including decendents.
    * openapi/v0.0.{35,36,37} - Avoid setting default values of min_cpus,
      job name, cwd, mail_type, and contiguous on job update.
    * openapi/v0.0.{35,36,37} - Clear user hold on job update if hold=false.
    * Prevent CRON_JOB flag from being cleared when loading job state.
    * sacctmgr - Fix deleting WCKeys when not specifying a cluster.
    * Fix getting memory for a step when the first node in the step isn't the
      first node in the allocation.
    * Make SelectTypeParameters=CR_Core_Memory default for cons_tres and cons_res.
    * Correctly handle mutex unlocks in the gres code if failures happen.
    * Give better error message if -m plane is given with no size.
    * Fix --distribution=arbitrary for salloc.
    * Fix jobcomp/script regression introduced in 21.08.0rc1 0c75b9ac9d.
    * Only send the batch node in the step_hostlist in the job credential.
    * When setting affinity for the batch step don't assume the batch host is node
    * In task/affinity better checking for node existence when laying out
    * slurmrestd - fix job submission with auth/jwt.
  - removed Fix-statement-condition-in-netloc-autoconf-macro.patch
    issue was fixed upstream
* Mon Sep 06 2021 Egbert Eich <>
  - Fix-statement-condition-in-netloc-autoconf-macro.patch:
    Fix netloc check, reestablish netloc disable code.
  - Make configure arg '--with-pmix' conditional.
  - Move openapi plugins to package slurm-restd.
* Thu Sep 02 2021 Christian Goll <>
  - updated to 21.08.0, major changes:
    * A new "AccountingStoreFlags=job_script" option to store the job scripts
      directly in SlurmDBD.
    * Added "sacct -o SubmitLine" format option to get the submit line
      of a job/step.
    * Changes to the node state management so that nodes are marked as PLANNED
      instead of IDLE if the scheduler is still accumulating resources while
      waiting to launch a job on them.
    * RS256 token support in auth/jwt.
    * Overhaul of the cgroup subsystems to simplify operation, mitigate a number
      of inherent race conditions, and prepare for future cgroup v2 support.
    * Further improvements to cloud node power state management.
    * A new child process of the Slurm controller called "slurmscriptd"
      responsible for executing PrologSlurmctld and EpilogSlurmctld scripts,
      which significantly reduces performance issues associated with enabling
      those options.
    * A new burst_buffer/lua plugin allowing for site-specific asynchronous job
      data management.
    * Fixes to the job_container/tmpfs plugin to allow the slurmd process to be
      restarted while the job is running without issue.
    * Added json/yaml output to sacct, squeue, and sinfo commands.
    * Added a new node_features/helpers plugin to provide a generic way to change
      settings on a compute node across a reboot.
    * Added support for automatically detecting and broadcasting shared libraries
      for an executable launched with "srun --bcast".
    * Added initial OCI container execution support with a new --container option
      to sbatch and srun.
    * Improved "configless" support by allowing multiple control servers to be
      specified through the slurmd --conf-server option, and send additional
      configuration files at startup including cli_filter.lua.
  - minor changes:
    * If an overallocation of GRES happens terminate the creation of a job.
    * AutoDetect=nvml: Fatal if no devices found in MIG mode.
    * Print federation and cluster sacctmgr error messages to stderr.
    * Add --gpu-bind=none to disable gpu binding when using --gpus-per-task.
    * Handle the burst buffer state "alloc-revoke" which previously would not
      display in the job correctly.
    * Fix issue in the slurmstepd SPANK prolog/epilog handler where configuration
      values were used before being initialized.
    * Restored --gpu-bind=single:<ntasks> to check core affinity like
    * -gpu-bind=closest does. This removal of this behavior only was in rc2.
    * slurmd - Fix assert failure on initialization due to bad node name.
    * Fix error codes in cgroup/v1.
    * Don't destroy the memory step outside fini, which leads to a double destroy
      causing an error message.
    * Add support for lua 5.4.
    * Force cgroup.clone_children to 0 in slurm cgroup directories. This caused
      issues in task cpuset plugin in systems with it enabled by default.
    * Clear GRES HAS_TYPE flag when removing type name.
    * Environment flags in gres.conf now override flags set by AutoDetect.
    * Environment flags in gres.conf now apply to subsequent gres.conf lines where
      Environment flags are not set.
    * Set missing job_uid and job_gid members when preparing a kill_job_msg_t in
      abort_job_on_node(), abort_job_on_nodes() and kill_job_on_node().
    * Fix swappiness not being set in cgroups.
    * Fix coordinators for new subaccounts.
    * Fix coordinators when adding existing users with PrivateData=users.
    * slurmctld - do not attempt to relinquish control to self.
    * openapi/v0.0.37 - Honor kill_on_invalid_dependency as job parameter.
    * Check max_gres when doing step allocation, fix for regression in rc2.
    * SPANK plugins are now required to match the current Slurm version, and must
      be recompiled for each new Slurm release.
    * node_features/helpers - add ExecTime configuration option.
    * srun - Fix force termination with -X.
    * On slurmctld restart set node typed GRES counts correctly.
    * Fix places where a step wasn't allocated in the slurmctld but wasn't ever
      removed from the job.
    * Fix step allocation memory when using --threads-per-core.
    * Fix step allocations to consume all threads on a core when using
    * Add check to validate cpu request on a step if --threads-per-core is given
      and it is less than what the core on the node has in the allocation.
    * Fix issue where a step could request more gres than the job had and the step
      would hang forever. This bug was only introduced in 21.08.0rc2.
    * Only print \r\n for logging messages on stderr when --pty has been
      explicitly requested.
    * Relax check on SPANK plugins to only require Slurm major + minor versions
      to match.
    * job_container/tmpfs - delegate handling of /dev/shm to the extern step
      so new step launches will be attached correctly even after the slurmd
      process has been restarted.
    * Limit the wait time in proctrack_g_wait() to UnkillableStepTimeout instead
      of a hardcoded value of 256 seconds, and limit the delay between tests to a
      maximum of 32 seconds.
    * fatal() on start if using job_container/tmpfs without PrologFlags=Contian.
    * Load bf_when_last_cycle from job state only if protocol version >= 21.08.
    * Docs - remove man3 section entirely.
    * Set step memory when using MemPerGPU or DefMemPerGPU. Previously a step's
      memory was not set even when it requested *-mem-per-gpu and at least one
    * Add cli_filter.lua support in configless mode.
    * Check that the step requests at least as many gres as nodes.
    * Make job's SLURM_JOB_GPUS print global GPU IDs instead of MIG unique_ids.
    * Fix miscounting of GPU envs in prolog/epilog if MultipleFiles was used.
    * Support MIGs in prolog/epilog's CUDA_VISIBLE_DEVICES & co.
    * Add SLURM_JOB_GPUS back into Prolog; add it to Epilog.
    * Fix issue where the original executable, not the bcast'd version, was
      executed with 'srun *-bcast'.
    * sacct - print '-' header correctly for fields over 53-characters wide.
    * openapi/dbv0.0.37 - replace "REST" with "Slurm OpenAPI" for plugin_name.
    * openapi/v0.0.37 - replace "REST" with "Slurm OpenAPI" for plugin_name.
    * configless - fix segfault on 'scontrol reconfigure'.
    * Use FREE_NULL_LIST instead of list_destroy.
    * If we made are running an interactive session we need to force track_steps.
    * Disable OPOST flag when using --pty to avoid issues with Emac.
    * Fix issue where extra bonus core was allocated in some situations.
    * Avoid putting gres with count of 0 on a TRES req/alloc.
    * Fix memory in requested TRES when --mem-per-gpu is used.
    * Changed ReqMem field in sacct to match memory from ReqTRES.
    * Changed --gpu-bind=single:<ntasks> to no longer check core affinity like
    * -gpu-bind=closest does. This consequently affects --ntasks-per-gpu.
    * slurmrestd - add v0.0.37 OpenAPI plugin.
    * slurmrestd/v0.0.37 - rename standard_in -> standard_input.
    * slurmrestd/v0.0.37 - rename standard_out -> standard_output.
    * Changed the --format handling for negative field widths (left justified)
      to apply to the column headers as well as the printed fields.
    * Add LimitFactor to the QOS. A float that is factored into an associations
      [Grp|Max]TRES limits.  For example, if the LimitFactor is 2, then an
      association with a GrpTRES of 30 CPUs, would be allowed to allocate 60
      CPUs when running under this QOS.
    * slurmrestd - Pass SLURM_NO_CHANGE_IN_DATA to client as 403 (Not Modified).
    * slurmrestd/v0.0.37 - Add update_time field to Jobs query to allow clients
      to only get jobs list based on change timestamp.
    * Reset job eligible time when job is manually held.
    * Add DEBUG_FLAG_JAG to improve logging related to job account gathering.
    * Convert logging in account_gather/common to DEBUG_FLAG_JAG.
    * Add more logging for jag_common_poll_data() when prec_extra() called.
    * slurmrestd/v0.0.37 - add API to fetch reservation(s) info.
    * Catch more errors in task/cgroup initalization and cleanup to avoid allowing
      jobs to start when cgroups failure to configure correctly.
    * Fix cgroup ns detection when using containers (e.g. LXC or Docker).
    * Reset job's next_step_id counter to 0 after being requeued.
    * Make scontrol exit with non-zero status after failing to delete a partition
      or reservation.
    * Make NtasksPerTRES optional in slurm_sprint_job_info().
    * slurmrestd/v0.0.37 - Add update_time field to nodes query to allow clients
      to only get nodes list based on change timestamp.
    * common/parse_config - catch and propagate return codes when handling a match
      on a key-value pattern. This implies error codes detected in the handlers
      are now not ignored and users of _handle_keyvalue_match() can fatal().
    * common/hostlist - fix hostlist_delete_nth() xassert() upper bound check.
    * API change: Removed slurm_kill_job_msg and modified the function signature
      for slurm_kill_job2. slurm_kill_job2 should be used instead of
    * Fix non-zero exit code for scontrol ping when all controllers are down.
    * Enforce a valid configuration for AccountingStorageEnforce in slurm.conf.
      If the configuration is invalid, then an error message will be printed and
      the command or daemon (including slurmctld) will not run.
    * slurmrestd/v0.0.37 - Add update_time field to partitions/reservations query
      to allow clients to only get the entities list when something changed.
    * slurmdbd.service - add "After" relationship to all common names for MariaDB
      to reduce startup delays.
    * slurmrestd/v0.0.37 - Correct displaying node states that are UNKNOWN.
    * slurmrestd/v0.0.37 - Add flags to node states.
    * Fix first job on fresh cluster not being assigned JobId=1 (or FirstJobId).
    * squeue - make it so --nodelist is sensitive to --clusters.
    * squeue - do --nodelist node validation in the same order as listing.
    * Removed AccountingStoreJobComment option.  Please update your config to use
      AccountingStoreFlags=job_comment instead.
    * AccountingStoreFlags=job_script allows you to store the job's batch script.
    * AccountingStoreFlags=job_env allows you to store the job's env vars.
    * Add sacct -o SubmitLine to get the submit line of a job/step.
    * Removed DefaultStorage{Host,Loc,Pass,Port,Type,User} options.
    * Fix NtasksPerTRES delimiter from : to = in scontrol show job output.
    * Removed CacheGroups, CheckpointType, JobCheckpointDir, MemLimitEnforce,
      SchedulerPort, SchedulerRootFilter options.
    * Make job accounting queries use consistent timeframes with and w/o jobs.
    * --cpus-per-task and --threads-per-core now imply --exact.
      This fixes issues where steps would be allocated the wrong number of CPUs.
    * configure: the --with option handling has been made consistent across the
      various optional libraries. Specifying *-with-foo=/path/to/foo will only
      check that directory for the applicable library (rather than, in some cases,
      falling back to the default directories), and will always error the build
      if the library is not found (instead of a mix of error messages and non-
      fatal warning messages).
    * configure: replace --with-rmsi_dir option with proper handling for
    * -with-rsmi=dir.
    * Pass additional job environment variables to MailProg.
    * Add SLURM_JOB_WORK_DIR to Prolog, Epilog.
    * Removed sched/hold plugin.
    * Fix srun overwriting SLURM_SUBMIT_DIR and SLURM_SUBMIT_HOST when within an
      existing allocation.
    * step_ctx code has been removed from the api.
    * cli_filter/lua, jobcomp/lua, job_submit/lua now load their scripts from the
      same directory as the slurm.conf file (and thus now will respect changes
      to the SLURM_CONF environment variable).
    * SPANK - call slurm_spank_init if defined without slurm_spank_slurmd_exit in
      slurmd context.
    * job_container/tmpfs - Remove need for .active file to allow salloc without
      an interactive step to work.
    * slurmd - Delay background node registration on every failure up to 128s on
    * slurmctld - Always notify slurmd that node registration was accepted to
      avoid slurmd needless attempting to re-register if there is configuration
    * Put node into "INVAL" state upon registering with an invalid node
      configuration. Node must register with a valid configuration to continue.
    * Make --cpu-bind=threads default for --threads-per-core -- cli and env can
    * jobcomp/elasticsearch - Use data_t to serialize data. The plugin now has the
      JSON-C library as a prerequisite.
    * scrontab - create the temporary file under the TMPDIR environment variable
      (if set), otherwise continue to use TmpFS as configured in slurm.conf.
    * Add LastBusyTime to "scontrol show nodes" and slurmrestd nodes output,
      which represents the time the node last had jobs on it.
    * slurmd - allow multiple comma-separated controllers to be specified in
      configless mode with *-conf-server
    * sacctmgr - changed column headings to "ParentID" and "ParentName" instead
      of "Par ID" and "Par Name" respectively.
    * Perl API - make sure man pages are installed under the --prefix given to
    * Manually powering down of nodes with scontrol now ignores
      input environment variables for salloc and sbatch, respectively. They do
      the same thing as *-threads-per-core.
    * Distinguish queued reboot requests (REBOOT) from issued reboots (REBOOT^).
    * Set the maximum number of open files per process to 4096 to avoid
      performance issues when closing the entire range with closeall().
    * auth/jwt - add support for RS256 tokens.
    * Relax reservation purge due to any invalid uid after creation time.
    * Reject srun that requests both --exclusive and --overlap.
    * service files - change dependency to network-online rather than just
      network to ensure DNS and other services are available.
    * RSMI: Fix incorrect PCI BDF bits.
    * plugins/cli_filter - Convert to using data_t to serialize JSON.
    * Fix testing array job after regaining locks in backfill.
    * Don't display node's comment with "scontrol show nodes" unless set.
    * Add "Extra" field to node to store extra information other than a comment.
    * scrontab - Use /tmp instead of TmpFS if TMPDIR is not set.
    * Add ResumeTimeout, SuspendTimeout and SuspendTime to Partitions.
    * sreport - change to sorting TopUsage by the --tres option.
    * slurmrestd - do not run allow operation as SlurmUser/root by default.
    * Allow map_cpu and mask_cpu for non-whole node allocation.
    * TaskPluginParam=verbose is now treated as a default. Previously it would be
      applied regardless of the job specifying a *-cpu-bind.
    * Add "node_reg_mem_percent" SlurmctldParameter to define percentage of
      memory nodes are allowed to register with.
    * Show correct number of SocketsPerBoard in slurmd -C with hwloc2.
    * Alter sreport's cluster utilization report column name from
      'Reserved' to 'Planned' to match the nomenclature of the 'Planned' node.
    * Add StateComplete format option to sinfo to show base_state+flags.
    * "scontrol show node" now shows State as base_state+flags instead of
      shortened state with flags appended. eg. IDLE# *> IDLE+POWERING_UP.
      Also "POWER" state flag string is "POWERED_DOWN".
    * slurmd/req - add missing job_env_t's het_job_id initialization off the
      request in _rpc_{abort,terminate}_job(). This caused problems for Native
      Cray builds when joining a CNCU job_container plugin with Epilog configured.
    * Fix joining a CNCU job_container on a Native Cray build before executing the
      UnkillableStepProgram for a HetJob step.
    * slurmrestd/v0.0.35 - Plugin has been tagged as deprecated.
    * srun - Job steps requiring more cores than available to be rejected unless
      '--overlap' is specificed.
    * Add bf_node_space_size to SchedulerParameters.
    * Add scontrol update node state=POWER_DOWN_FORCE and POWER_DOWN_ASAP as new
      ways to power off and reset especially CLOUD nodes.
    * Define and separate node power state transitions. Previously a powering
      down node was in both states, POWERING_OFF and POWERED_OFF. These are now
    * Create a new process called slurmscriptd which runs PrologSlurmctld and
      EpilogSlurmctld. This avoids fork() calls from slurmctld, and can avoid
      performance issues if the slurmctld has a large memory footprint.
    * Added new Script option to DebugFlags for debugging slurmscriptd.
    * scrontab - add ability to update crontab from a file or standard input.
    * scrontab - add ability to set and expand variables.
    * Pass JSON of job to node mappings to ResumeProgram.
    * If running steps in an allocation with CR_PACK_NODE or -mpack the srun will
      only attempt to allocate as much as needed from the allocation instead
      of always trying to allocate every node in the allocation.
    * Jobs that request the whole node now check to see if any gres are allocated.
    * Rename SbcastParameters to BcastParameters.
    * Make srun sensitive to BcastParameters.
    * RSMI: Add gres_links_create_empty() and preserve RSMI enumeration order.
    * GPUs: Use index instead of dev_num for CUDA_VISIBLE_DEVICES
    * Don't run epilog on nodes if job never launched.
    * QOS accrue limits only apply to the job QOS, not partition QOS.
    * Add --gpu-bind=per_task:<gpus_per_task> option, --gpus-per-task will now
      set this option by default.
    * Treat any return code from SPANK plugin that is not SLURM_SUCCESS to be an
      error or rejection.
    * Print the statistics for extern step adopted processes in sstat.
    * Fix SLURM_NODE_ALIASES to work for ipv6 node addrs.
    * Add support for automatically detecting and broadcasting executable shared
      object dependencies for sbcast and srun *-bcast.
* Fri Jul 02 2021 Christian Goll <>
  - Updated to  20.11.8:
    * slurmctld - fix erroneous "StepId=CORRUPT" messages in error logs.
    * Correct the error given when auth plugin fails to pack a credential.
    * Fix unused-variable compiler warning on FreeBSD in fd_resolve_path().
    * acct_gather_filesystem/lustre - only emit collection error once per step.
    * Add GRES environment variables (e.g., CUDA_VISIBLE_DEVICES) into the
      interactive step, the same as is done for the batch step.
    * Fix various potential deadlocks when altering objects in the database
      dealing with every cluster in the database.
    * slurmrestd:
    - handle slurmdbd connection failures without segfaulting.
    - fix segfault for searches in slurmdb/v0.0.36/jobs.
    - remove (non-functioning) users query parameter for
      slurmdb/v0.0.36/jobs from openapi.json
    - fix segfault in slurmrestd db/jobs with numeric queries
    - add argv handling for job/submit endpoint.
    - add description for slurmdb/job endpoint.
    * slurmrestd/dbv0.0.36:
    - Fix values dumped in job state/current and
      job step state.
    - Correct description for previous state property.
    * srun:
    - fix broken node step allocation in a heterogeneous allocation.
    - leave SLURM_DIST_UNKNOWN as default for --interactive.
    * Fail step creation if -n is not multiple of --ntasks-per-gpu.
    * job_container/tmpfs - Fix slowdown on teardown.
    * Fix problem with SlurmctldProlog where requeued jobs would never launch.
    * job_container/tmpfs - Fix issue when restarting slurmd where the namespace
      mount points could disappear.
    * sacct:
    - avoid truncating JobId at 34 characters.
    - fix segfault when printing StepId (or when using --long).
    * scancel - fix segfault when --wckey filtering option is used.
    * select/cons_tres - Fix memory leak.
    * Prevent file descriptor leak in job_container/tmpfs on slurmd restart.
    * perlapi/libslurmdb - expose tres_req_str to job hash.
    * scrontab - close and reopen temporary crontab file to deal with editors
      that do not change the original file, but instead write out then rename
      a new file.
    * sstat - fix linking so that it will work when --without-shared-libslurm
      was used to build Slurm.
    * Clear allocated cpus for running steps in a job before handling requested
      nodes on new step.
    * Don't reject a step if not enough nodes are available. Instead, defer the
      step until enough nodes are available to satisfy the request.
    * Don't reject a step if it requests at least one specific node that is
      already allocated to another step. Instead, defer the step until the
      requested node(s) become available.
    * Better handling of --mem=0.
    * Ignore DefCpuPerGpu when --cpus-per-task given.
* Fri May 14 2021 Christian Goll <>
  - Updated to 20.11.7 which fixes CVE-2021-31215 (bsc#1186024)
  - New features in 20.11.7:
    * slurmd - handle configless failures gracefully instead of hanging
    * select/cons_tres - fix Dragonfly topology not selecting nodes in the same
    leaf switch when it should as well as requests with *-switches option.
    * Fix issue where certain step requests wouldn't run if the first node in the
    job allocation was full and there were idle resources on other nodes in
    the job allocation.
    * Fix deadlock issue with <Prolog|Epilog>Slurmctld.
    * torque/qstat - fix printf error message in output.
    * When adding associations or wckeys avoid checking multiple times a user or
    cluster name.
    * Fix wrong jobacctgather information on a step on multiple nodes
    due to timeouts sending its the information gathered on its node.
    * Fix missing xstrdup which could result in slurmctld segfault on array jobs.
    * Fix security issue in PrologSlurmctld and EpilogSlurmctld by always
    prepending SPANK_ to all user-set environment variables. CVE-2021-31215.
  - New features in 20.11.6:
    * Fix sacct assert with the --qos option.
    * Use pkg-config --atleast-version instead of --modversion for systemd.
    * common/fd - fix getsockopt() call in fd_get_socket_error().
    * Properly handle the return from fd_get_socket_error() in _conn_readable().
    * cons_res - Fix issue where running jobs were not taken into consideration
    when creating a reservation.
    * Avoid a deadlock between job_list for_each and assoc QOS_LOCK.
    * Fix TRESRunMins usage for partition qos on restart/reconfig.
    * Fix printing of number of tasks on a completed job that didn't request
    * Fix updating GrpTRESRunMins when decrementing job time is bigger than it.
    * Make it so we handle multithreaded allocations correctly when doing
    - -exclusive or --core-spec allocations.
    * Fix incorrect round-up division in _pick_step_cores
    * Use appropriate math to adjust cpu counts when --ntasks-per-core=1.
    * cons_tres - Fix consideration of power downed nodes.
    * cons_tres - Fix DefCpuPerGPU, increase cpus-per-task to match with
    gpus-per-task * cpus-per-gpu.
    * Fix under-cpu memory auto-adjustment when MaxMemPerCPU is set.
    * Make it possible to override CR_CORE_DEFAULT_DIST_BLOCK.
    * Perl API - fix retrieving/storing of slurm_step_id_t in job_step_info_t.
    * Recover state of burst buffers when slurmctld is restarted to avoid skipping
    burst buffer stages.
    * Fix race condition in burst buffer plugin which caused a burst buffer
    in stage-in to not get state saved if slurmctld stopped.
    * auth/jwt - print an error if jwt_file= has not been set in slurmdbd.
    * Fix RESV_DEL_HOLD not being a valid state when using squeue --states.
    * Add missing squeue selectable states in valid states error message.
    * Fix scheduling last array task multiple times on error, causing segfault.
    * Fix issue where a step could be allocated more memory than the job when
    dealing with --mem-per-cpu and --threads-per-core.
    * Fix removing qos from assoc with -= can lead to assoc with no qos
    * auth/jwt - fix segfault on invalid credential in slurmdbd due to
    missing validate_slurm_user() function in context.
    * Fix single Port= not being applied to range of nodes in slurm.conf
    * Fix Jobs not requesting a tres are not starting because of that tres limit.
    * acct_gather_energy/rapl - fix AveWatts calculation.
    * job_container/tmpfs - Fix issues with cleanup and slurmd restarting on
    running jobs.
* Mon May 03 2021 Egbert Eich <>
  - Ship REST API version and auth plugins with slurmrestd.
  - Add YAML support for REST API to build (bsc#1185603).
* Wed Mar 17 2021 Christian Goll <>
  - Udpate to 20.11.5:
  - New features:
    * New job_container/tmpfs plugin developed by NERSC that can be used to
    create per-job filesystem namespaces.  Documentaiion and configuration
    can be found in the respecting man page.
  - Bug fixes:
    * Fix main scheduler bug where bf_hetjob_prio truncates SchedulerParameters.
    * Fix sacct not displaying UserCPU, SystemCPU and TotalCPU for large times.
    * scrontab - fix to return the correct index for a bad #SCRON option.
    * scrontab - fix memory leak when invalid option found in #SCRON line.
    * Add errno for when a user requests multiple partitions and they are using
    partition based associations.
    * Fix issue where a job could run in a wrong partition when using
    EnforcePartLimits=any and partition based associations.
    * Remove possible deadlock when adding associations/wckeys in multiple
    * When using PrologFlags=alloc make sure the correct Slurm version is set
    in the credential.
    * When sending a job a warning signal make sure we always send SIGCONT
    * Fix issue where a batch job would continue running if a prolog failed on a
    node that wasn't the batch host and requeuing was disabled.
    * Fix issue where sometimes salloc/srun wouldn't get a message about a prolog
    failure in the job's stdout.
    * Requeue or kill job on a prolog failure when PrologFlags is not set.
    * Fix race condition causing node reboots to get requeued before
    ResumeTimeout expires.
    * Preserve node boot_req_time on reconfigure.
    * Preserve node power_save_req_time on reconfigure.
    * Fix node reboots being queued and issued multiple times and preventing the
    reboot to time out.
    * Fix run_command to exit correctly if track_script kills the calling thread.
    * Only requeue a job when the PrologSlurmctld returns nonzero.
    * When a job is signaled with SIGKILL make sure we flush all
    prologs/setup scripts.
    * Handle burst buffer scripts if the job is canceled while stage_in is
    * When shutting down the slurmctld make note to ignore error message when
    we have to kill a prolog/setup script we are tracking.
    * scrontab - add support for the --open-mode option.
    * acct_gather_profile/influxdb - avoid segfault on plugin shutdown if setup
    has not completed successfully.
    * Reduce delay in starting salloc allocations when running with prologs.
    * Alter AllocNodes check to work if the allocating node's domain doesn't
    match the slurmctld's. This restores the pre*20.11 behavior.
    * Fix slurmctld segfault if jobs from a prior version had the now-removed
    INVALID_DEPEND state flag set and were allowed to run in 20.11.
    * Add job_container/tmpfs plugin to give a method to provide a private /tmp
    per job.
    * Set the correct core affinity when using AutoDetect.
    * slurmrestd - mark "environment" as required for job submissions in schema.
* Tue Feb 23 2021 Christian Goll <>
  - Udpate to 20.11.04
    * Fix node selection for advanced reservations with features.
    * mpi/pmix: Handle pipe failure better when using ucx.
    * mpi/pmix: include PMIX_NODEID for each process entry.
    * Fix job getting rejected after being requeued on same node that died.
    * job_submit/lua - add "network" field.
    * Fix situations when a reoccuring reservation could erroneously skip a
    * Ensure that a reservations [pro|epi]log are ran on reoccuring reservations.
    * Fix threads-per-core memory allocation issue when using CR_CPU_MEMORY.
    * Fix scheduling issue with --gpus.
    * Fix gpu allocations that request --cpus-per-task.
    * mpi/pmix: fixed print messages for all PMIXP_* macros
    * Add mapping for XCPU to --signal option.
    * Fix regression in 20.11 that prevented a full pass of the main scheduler
    from ever executing.
    * Work around a glibc bug in which "0" is incorrectly printed as "nan"
    which will result in corrupted association state on restart.
    * Fix regression in 20.11 which made slurmd incorrectly attempt to find the
    parent slurmd address when not applicable and send incorrect reverse*tree
    info to the slurmstepd.
    * Fix cgroup ns detection when using containers (e.g. LXC or Docker).
    * scrontab - change temporary file handling to work with emacs.
  - Removed
  - Added: load-pmix-major-version.patch
* Wed Jan 20 2021 Ana Guerrero Lopez <>
  - Update to 20.11.03
  - This release includes a major functional change to how job step launch is
    handled compared to the previous 20.11 releases. This affects srun as
    well as MPI stacks - such as Open MPI - which may use srun internally as
    part of the process launch.
    One of the changes made in the Slurm 20.11 release was to the semantics
    for job steps launched through the 'srun' command. This also
    inadvertently impacts many MPI releases that use srun underneath their
    own mpiexec/mpirun command.
    For 20.11.{0,1,2} releases, the default behavior for srun was changed
    such that each step was allocated exactly what was requested by the
    options given to srun, and did not have access to all resources assigned
    to the job on the node by default. This change was equivalent to Slurm
    setting the --exclusive option by default on all job steps. Job steps
    desiring all resources on the node needed to explicitly request them
    through the new '--whole' option.
    In the 20.11.3 release, we have reverted to the 20.02 and older behavior
    of assigning all resources on a node to the job step by default.
    This reversion is a major behavioral change which we would not generally
    do on a maintenance release, but is being done in the interest of
    restoring compatibility with the large number of existing Open MPI (and
    other MPI flavors) and job scripts that exist in production, and to
    remove what has proven to be a significant hurdle in moving to the new
    Please note that one change to step launch remains - by default, in
    20.11 steps are no longer permitted to overlap on the resources they
    have been assigned. If that behavior is desired, all steps must
    explicitly opt-in through the newly added '--overlap' option.
    Further details and a full explanation of the issue can be found at:
  - Other changes from 20.11.03
    * Fix segfault when parsing bad "#SBATCH hetjob" directive.
    * Allow countless gpu:<typenode GRES specifications in slurm.conf.
    * PMIx - Don't set UCX_MEM_MMAP_RELOC for older version of UCX (pre 1.5).
    * Don't green-light any GPU validation when core conversion fails.
    * Allow updates to a reservation in the database that starts in the future.
    * Better check/handling of primary key collision in reservation table.
    * Improve reported error and logging in _build_node_list().
    * Fix uninitialized variable in _rpc_file_bcast() which could lead to an
      incorrect error return from sbcast / srun --bcast.
    * mpi/cray_shasta - fix use-after-free on error in _multi_prog_parse().
    * Cray - Handle setting correct prefix for cpuset cgroup with respects to
      expected_usage_in_bytes.  This fixes Cray's OOM killer.
    * mpi/pmix: Fix PMIx_Abort support.
    * Don't reject jobs allocating more cores than tasks with MaxMemPerCPU.
    * Fix false error message complaining about oversubscribe in cons_tres.
    * scrontab - fix parsing of empty lines.
    * Fix regression causing spank_process_option errors to be ignored.
    * Avoid making multiple interactive steps.
    * Fix corner case issues where step creation should fail.
    * Fix job rejection when --gres is less than --gpus.
    * Fix regression causing spank prolog/epilog not to be called unless the
      spank plugin was loaded in slurmd context.
    * Fix regression preventing SLURM_HINT=nomultithread from being used
      to set defaults for salloc->srun, sbatch->srun sequence.
    * Reject job credential if non-superuser sets the LAUNCH_NO_ALLOC flag.
    * Make it so srun --no-allocate works again.
    * jobacct_gather/linux - Don't count memory on tasks that have already
    * Fix 19.05/20.02 batch steps talking with a 20.11 slurmctld.
    * jobacct_gather/common - Do not process jobacct's with same taskid when
      calling prec_extra.
    * Cleanup all tracked jobacct tasks when extern step child process finishes.
    * slurmrestd/dbv0.0.36 - Correct structure of dbv0.0.36_tres_list.
    * Fix regression causing task/affinity and task/cgroup to be out of sync when
      configured ThreadsPerCore is different than the physical threads per core.
    * Fix situation when --gpus is given but not max nodes (-N1-1) in a job
    * Interactive step - ignore cpu bind and mem bind options, and do not set
      the associated environment variables which lead to unexpected behavior
      from srun commands launched within the interactive step.
    * Handle exit code from pipe when using UCX with PMIx.
* Fri Jan 08 2021 Egbert Eich <>
  - Fix fallout introduced by:
    "Replace  '%service_del_postun -n' with '%service_del_postun_without_restart'"
    for older Leap/SLE versions.
* Fri Jan 08 2021 Egbert Eich <>
  - Fix Provides:/Conflicts: for libnss_slurm (bsc#1180700).
* Tue Jan 05 2021 Ana Guerrero Lopez <>
  - Add support for configuration files from external plugins.
    While built-in plugins have their configuration added in slurm.conf,
    external SPANK plugins add their configuration to plugstack.conf
    To allow packaging easily spank plugins, their configuration files
    should be added independently at /etc/spack/plugstack.conf.d and
    plugstack.conf should be left with an oneliner including all the
    files under /etc/spack/plugstack.conf.d
* Mon Dec 28 2020 Ana Guerrero Lopez <>
  - Update to 20.11.02
    * Fix older versions of sacct not working with 20.11.
    * Fix slurmctld crash when using a pre-20.11 srun in a job allocation.
    * Correct logic problem in _validate_user_access.
    * Fix libpmi to initialize Slurm configuration correctly.
  - Update to 20.11.01
    * Fix spelling of "overcomited" to "overcomitted" in sreport's cluster
      utilization report.
    * Silence debug message about shutting down backup controllers if none are
    * Don't create interactive srun until PrologSlurmctld is done.
    * Fix fd symlink path resolution.
    * Fix slurmctld segfault on subnode reservation restore after node
      configuration change.
    * Fix resource allocation response message environment allocation size.
    * Ensure that details->env_sup is NULL terminated.
    * select/cray_aries - Correctly remove jobs/steps from blades using NPC.
    * cons_tres - Avoid max_node_gres when entire node is allocated with
    - -ntasks-per-gpu.
    * Allow NULL arg to data_get_type().
    * In sreport have usage for a reservation contain all jobs that ran in the
      reservation instead of just the ones that ran in the time specified. This
      matches the report for the reservation is not truncated for a time period.
    * Fix issue with sending wrong batch step id to a < 20.11 slurmd.
    * Add a job's alloc_node to lua for job modification and completion.
    * Fix regression getting a slurmdbd connection through the perl API.
    * Stop the extern step terminate monitor right after proctrack_g_wait().
    * Fix removing the normalized priority of assocs.
    * slurmrestd/v0.0.36 - Use correct name for partition field:
      "min nodes per job" -"min_nodes_per_job".
    * slurmrestd/v0.0.36 - Add node comment field.
    * Fix regression marking cloud nodes as "unexpectedly rebooted" after
      multiple boots.
    * Fix slurmctld segfault in _slurm_rpc_job_step_create().
    * slurmrestd/v0.0.36 - Filter node states against NODE_STATE_BASE to avoid
      the extended states all being reported as "invalid".
    * Fix race that can prevent the prolog for a requeued job from running.
    * cli_filter - add "type" to readily distinguish between the CLI command in
    * smail - reduce sleep before seff to 5 seconds.
    * Ensure SPANK prolog and epilog run without an explicit PlugStackConfig.
    * Disable MySQL automatic reconnection.
    * Fix allowing "b" after memory unit suffixes.
    * Fix slurmctld segfault with reservations without licenses.
    * Due to internal restructuring ahead of the 20.11 release, applications
      calling libslurm MUST call slurm_init(NULL) before any API calls.
      Otherwise the API call is likely to fail due to libslurm's internal
      configuration not being available.
    * slurm.spec - allow custom paths for PMIx and UCX install locations.
    * Use rpath if enabled when testing for Mellanox's UCX libraries.
    * slurmrestd/dbv0.0.36 - Change user query for associations to optional.
    * slurmrestd/dbv0.0.36 - Change account query for associations to optional.
    * mpi/pmix - change the error handler error message to be more useful.
    * Add missing connection in acct_storage_p_{clear_stats, reconfig, shutdown}.
    * Perl API - fix issue when running in configless mode.
    * nss_slurm - avoid deadlock when stray sockets are found.
    * Display correct value for ScronParameters in 'scontrol show config'
* Mon Nov 30 2020 Egbert Eich <>
  - Update to version 20.11.0
    Slurm 20.11 includes a number of new features including:
    * Overhaul of the job step management and launch code, alongside improved
      GPU task placement support.
    * A new "Interactive Step" mode of operation for salloc.
    * A new "scrontab" command that can be used to submit and manage
      periodically repeating jobs.
    * IPv6 support.
    * Changes to the reservation logic, with new options allowing users
      to delete reservations, allowing admins to skip the next occurance of a
      repeated reservation, and allowing for a job to be submitted and eligible
      to run within multiple reservations.
    * Dynamic Future Nodes - automatically associate a dynamically
      provisioned (or "cloud") node against a NodeName definition with matching
    * An experimental new RPC queuing mode for slurmctld to reduce thread
      contention on heavily loaded clusters.
    * SlurmDBD integration with the Slurm REST API.
    Also check
* Wed Nov 18 2020 Ana Guerrero Lopez <>
  - Updated to 20.02.6, addresses two security fixes:
    * PMIx - fix potential buffer overflows from use of unpackmem().
      CVE-2020-27745 (bsc#1178890)
    * X11 forwarding - fix potential leak of the magic cookie when sent as an
      argument to the xauth command. CVE-2020-27746 (bsc#1178891)
  - And many other bugfixes, full log and details available at:
* Tue Nov 03 2020 Franck Bui <>
  - Replace  '%service_del_postun -n' with '%service_del_postun_without_restart'
    '-n' is deprecated and will be removed in the future.
* Thu Oct 29 2020 Ana Guerrero Lopez <>
  - Updated to 20.02.5, changes:
    * Fix leak of TRESRunMins when job time is changed with --time-min
    * pam_slurm - explicitly initialize slurm config to support configless mode.
    * scontrol - Fix exit code when creating/updating reservations with wrong
    * When a GRES has a no_consume flag, report 0 for allocated.
    * Fix cgroup cleanup by jobacct_gather/cgroup.
    * When creating reservations/jobs don't allow counts on a feature unless
    using an XOR.
    * Improve number of boards discovery
    * Fix updating a reservation NodeCnt on a zero-count reservation.
    * slurmrestd - provide an explicit error messages when PSK auth fails.
    * cons_tres - fix job requesting single gres per-node getting two or more
    nodes with less CPUs than requested per-task.
    * cons_tres - fix calculation of cores when using gres and cpus-per-task.
    * cons_tres - fix job not getting access to socket without GPU or with less
    than --gpus-per-socket when not enough cpus available on required socket
    and not using --gres-flags=enforce binding.
    * Fix HDF5 type version build error.
    * Fix creation of CoreCnt only reservations when the first node isn't
    * Fix wrong DBD Agent queue size in sdiag when using accounting_storage/none.
    * Improve job constraints XOR option logic.
    * Fix preemption of hetjobs when needed nodes not in leader component.
    * Fix wrong bit_or() messing potential preemptor jobs node bitmap, causing
    bad node deallocations and even allocation of nodes from other partitions.
    * Fix double-deallocation of preempted non-leader hetjob components.
    * slurmdbd - prevent truncation of the step nodelists over 4095.
    * Fix nodes remaining in drain state state after rebooting with ASAP option.
    - changes from 20.02.4:
    * srun - suppress job step creation warning message when waiting on
    * slurmrestd - fix incorrect return values in data_list_for_each() functions.
    * mpi/pmix - fix issue where HetJobs could fail to launch.
    * slurmrestd - set content-type header in responses.
    * Fix cons_res GRES overallocation for --gres-flags=disable-binding.
    * Fix cons_res incorrectly filtering cores with respect to GRES locality for
    - -gres-flags=disable-binding requests.
    * Fix regression where a dependency on multiple jobs in a single array using
    underscores would only add the first job.
    * slurmrestd - fix corrupted output due to incorrect use of memcpy().
    * slurmrestd - address a number of minor Coverity warnings.
    * Handle retry failure when slurmstepd is communicating with srun correctly.
    * Fix jobacct_gather possibly duplicate stats when _is_a_lwp error shows up.
    * Fix tasks binding to GRES which are closest to the allocated CPUs.
    * Fix AMD GPU ROCM 3.5 support.
    * Fix handling of job arrays in sacct when querying specific steps.
    * slurmrestd - avoid fallback to local socket authentication if JWT
    authentication is ill-formed.
    * slurmrestd - restrict ability of requests to use different authentication
    * slurmrestd - unlink named unix sockets before closing.
    * slurmrestd - fix invalid formatting in openapi.json.
    * Fix batch jobs stuck in CF state on FrontEnd mode.
    * Add a separate explicit error message when rejecting changes to active node
    * cons_common/job_test - fix slurmctld SIGABRT due to double-free.
    * Fix updating reservations to set the duration correctly if updating the
    start time.
    * Fix update reservation to promiscuous mode.
    * Fix override of job tasks count to max when ntasks-per-node present.
    * Fix min CPUs per node not being at least CPUs per task requested.
    * Fix CPUs allocated to match CPUs requested when requesting GRES and
    threads per core equal to one.
    * Fix NodeName config parsing with Boards and without CPUs.
    * Ensure SLURM_JOB_USER and SLURM_JOB_UID are set in SrunProlog/Epilog.
    * Fix error messages for certain invalid salloc/sbatch/srun options.
    * pmi2 - clean up sockets at step termination.
    * Fix 'scontrol hold' to work with 'JobName'.
    * sbatch - handle --uid/--gid in #SBATCH directives properly.
    * Fix race condition in job termination on slurmd.
    * Print specific error messages if trying to run use certain
    priority/multifactor factors that cannot work without SlurmDBD.
    * Avoid partial GRES allocation when --gpus-per-job is not satisfied.
    * Cray - Avoid referencing a variable outside of it's correct scope when
    dealing with creating steps within a het job.
    * slurmrestd - correctly handle larger addresses from accept().
    * Avoid freeing wrong pointer with SlurmctldParameters=max_dbd_msg_action
    with another option after that.
    * Restore MCS label when suspended job is resumed.
    * Fix insufficient lock levels.
    * slurmrestd - use errno from job submission.
    * Fix "user" filter for sacctmgr show transactions.
    * Fix preemption logic.
    * Fix no_consume GRES for exclusive (whole node) requests.
    * Fix regression in 20.02 that caused an infinite loop in slurmctld when
    requesting --distribution=plane for the job.
    * Fix parsing of the --distribution option.
    * Add CONF READ_LOCK to _handle_fed_send_job_sync.
    * prep/script - always call slurmctld PrEp callback in _run_script().
    * Fix node estimation for jobs that use GPUs or --cpus-per-task.
    * Fix jobcomp, job_submit and cli_filter Lua implementation plugins causing
    slurmctld and/or job submission CLI tools segfaults due to bad return
    handling when the respective Lua script failed to load.
    * Fix propagation of gpu options through hetjob components.
    * Add SLURM_CLUSTERS environment variable to scancel.
    * Fix packing/unpacking of "unlinked" jobs.
    * Connect slurmstepd's stderr to srun for steps launched with --pty.
    * Handle MPS correctly when doing exclusive allocations.
    * slurmrestd - fix compiling against libhttpparser in a non-default path.
    * slurmrestd - avoid compilation issues with libhttpparser < 2.6.
    * Fix compile issues when compiling slurmrestd without --enable-debug.
    * Reset idle time on a reservation that is getting purged.
    * Fix reoccurring reservations that have Purge_comp= to keep correct
    duration if they are purged.
    * scontrol - changed the "PROMISCUOUS" flag to "MAGNETIC"
    * Early return from epilog_set_env in case of no_consume.
    * Fix cons_common/job_test start time discovery logic to prevent skewed
    results between "will run test" executions.
    * Ensure TRESRunMins limits are maintained during "scontrol reconfigure".
    * Improve error message when host lookup fails.
  - Refresh patch: pam_slurm-Initialize-arrays-and-pass-sizes.patch
* Tue Jul 07 2020 Egbert Eich <>
  - Add support for openPMIx also for Leap/SLE 15.0/1 (bsc#1173805).
  - Do not run %check on SLE-12-SP2: Some incompatibility in tcl
    makes this fail.
  - Remove unneeded build dependency to postgresql-devel.
  - Disable build on s390 (requires 64bit).
* Wed Jun 03 2020 Egbert Eich <>
  - Bring QA to the package build: add %%check stage.
  - Remove cruft that isn't needed any longer.
  - Add 'ghosted' run-file.
  - Add rpmlint filter to handle issues with library packages
    for Leap and enterprise upgrade versions.
* Fri May 22 2020 Christian Goll <>
  - Updated to 20.02.3 which fixes CVE-2020-12693 (bsc#1172004).
  - Other changes are:
    * Factor in ntasks-per-core=1 with cons_tres.
    * Fix formatting in error message in cons_tres.
    * Fix calling stat on a NULL variable.
    * Fix minor memory leak when using reservations with flags=first_cores.
    * Fix gpu bind issue when CPUs=Cores and ThreadsPerCore > 1 on a node.
    * Fix --mem-per-gpu for heterogenous --gres requests.
    * Fix slurmctld load order in load_all_part_state().
    * Fix race condition not finding jobacct gather task cgroup entry.
    * Suppress error message when selecting nodes on disjoint topologies.
    * Improve performance of _pack_default_job_details() with large number of job
    * arguments.
    * Fix archive loading previous to 17.11 jobs per-node req_mem.
    * Fix regresion validating that --gpus-per-socket requires --sockets-per-node
    * for steps. Should only validate allocation requests.
    * error() instead of fatal() when parsing an invalid hostlist.
    * nss_slurm - fix potential deadlock in slurmstepd on overloaded systems.
    * cons_tres - fix --gres-flags=enforce-binding and related --cpus-per-gres.
    * cons_tres - Allocate lowest numbered cores when filtering cores with gres.
    * Fix getting system counts for named GRES/TRES.
    * MySQL - Fix for handing typed GRES for association rollups.
    * Fix step allocations when tasks_per_core > 1.
    * Fix allocating more GRES than requested when asking for multiple GRES types.
* Wed May 06 2020 Egbert Eich <>
  - Treat libnss_slurm like any other package: add version string to
    upgrade package.
* Fri Mar 27 2020 Christian Goll <>
  - Updated to 20.02.1 with following changes"
    * Improve job state reason for jobs hitting partition_job_depth.
    * Speed up testing of singleton dependencies.
    * Fix negative loop bound in cons_tres.
    * srun - capture the MPI plugin return code from mpi_hook_client_fini() and
    use as final return code for step failure.
    * Fix segfault in cli_filter/lua.
    * Fix --gpu-bind=map_gpu reusability if tasks > elements.
    * Make sure config_flags on a gres are sent to the slurmctld on node
    * Prolog/Epilog - Fix missing GPU information.
    * Fix segfault when using config parser for expanded lines.
    * Fix bit overlap test function.
    * Don't accrue time if job begin time is in the future.
    * Remove accrue time when updating a job start/eligible time to the future.
    * Fix regression in 20.02.0 that broke --depend=expand.
    * Reset begin time on job release if it's not in the future.
    * Fix for recovering burst buffers when using high-availability.
    * Fix invalid read due to freeing an incorrectly allocated env array.
    * Update slurmctld -i message to warn about losing data.
    * Fix scontrol cancel_reboot so it clears the DRAIN flag and node reason for a
    pending ASAP reboot.
* Sun Mar 08 2020 Egbert Eich <>
  - Remove legacy_cray: with 20.02 the special treatment for
    cray-specific plugins on SLE version prior to 15SP2 is
    no longer required.
* Wed Mar 04 2020 Christian Goll <>
  - slurm-plugins will now also require pmix not only libpmix
* Fri Feb 28 2020 Egbert Eich <>
  - Removed autopatch as it doesn't work for the SLE-11-SP4 build.
* Thu Feb 27 2020 Kasimir _ <>
  - Disable %arm builds as this is no longer supported.
* Thu Feb 27 2020 Christian Goll <>
  - pmix searches now also for so that there is no dependency
    for devel package (bsc#1164386)
    * added patch file
    * reworded patch file Remove-rpath-from-build.patch to use %autopatch
* Wed Feb 26 2020 Egbert Eich <>
  - Update to version 20.02.0 (jsc#SLE-8491)
    * Fix minor memory leak in slurmd on reconfig.
    * Fix invalid ptr reference when rolling up data in the database.
    * Change to require python3 for RHEL8 support, and match
    * slurm.spec - override "hardening" linker flags to ensure RHEL8 builds
      in a usable manner.
    * Fix type mismatches in the perl API.
    * Prevent use of uninitialized slurmctld_diag_stats.
    * Fixed various Coverity issues.
    * Only show warning about root-less topology in daemons.
    * Fix accounting of jobs in IGNORE_JOBS reservations.
    * Fix issue with batch steps state not loading correctly when upgrading from
    * Deprecate max_depend_depth in SchedulerParameters and move it to
    * Silence erroneous error on slurmctld upgrade when loading federation state.
    * Break infinite loop in cons_tres dealing with incorrect tasks per tres
      request resulting in slurmctld hang.
    * Improve handling of --gpus-per-task to make sure appropriate number of GPUs
      is assigned to job.
    * Fix seg fault on cons_res when requesting --spread-job.
  - Move to python3 for everything but SLE-11-SP4
    * For SLE-11-SP4 add a workaround to handle a python3 script (python2.7
* Wed Feb 19 2020 Egbert Eich <>
  - Add explicit version dependency to libpmix as well.
    'slurm-devel' has a tight version dependency on libpmix -
    allowing multiple libpmix versions in one package repository
    is therefore essential.
* Thu Feb 13 2020 Egbert Eich <>
  - Update to version 20.02.0-rc1
    * sbatch - fix segfault when no newline at the end of a burst buffer file.
    * Change scancel to only check job's base state when matching -t options.
    * Save job dependency list in state files.
    * cons_tres - allow jobs to be run on systems with root-less topologies.
    * Restore pre-20.02pre1 PrologSlurmctld synchonization behavior to avoid
      various race conditions, and ensure proper batch job launch.
    * Add new slurmrestd command/daemon which implements the Slurm REST API.
* Tue Feb 11 2020 Christian Goll <>
  - Update to version 20.02.0-0pre1, highlights are
    * Exclusive behavior of a node includes all GRES on a node as well
    as the cpus.
    * Use python3 instead of python for internal build/test scripts.
    The slurm.spec file has been updated to depend on python3 as well.
    * Added new NodeSet configuration option to help simplify partition
    configuration sections for heterogeneous / condo*style clusters.
    * Added slurm.conf option MaxDBDMsgs to control how many messages will be
    stored in the slurmctld before throwing them away when the slurmdbd is down.
    * The checkpoint plugin interface and all associated API calls have been
    * slurm_init_job_desc_msg() initializes mail_type as uint16_t. This allows
    mail_type to be set to NONE with scontrol.
    * Add new slurm_spank_log() function to print messages back to the user from
    within a SPANK plugin without prepending "error: " from slurm_error().
    * Enforce having partition name and nodelist=ALL when creating reservations
    with flags=PART_NODES.
    * SPANK - removed never-implemented slurm_spank_slurmd_init() interface. This
    hook has always been accessible through slurm_spank_init() in the
    S_CTX_SLURMD context instead.
    * sbcast - add new BcastAddr option to NodeName lines to allow sbcast traffic
    to flow over an alternate network path.
    * Added auth/jwt plugin, and 'scontrol token' subcommand.  PMIx - improve
    * performance of proc map generation.  Deprecate kill_invalid_depend in
    * SchedulerParameters and move it to a new
    option called DependencyParameters.
    * Enable job dependencies for any job on any cluster in the same federation.
    * Allow clusters to be added automatically to db at startup of ctld.  Add
    * AccountingStorageExternalHost slurm.conf parameter.  The
    * "ConditionPathExists" condition in slurmd.service has been disabled by
    default to permit simpler installation of a "configless" Slurm cluster.
    * In SchedulerParameters remove deprecated max_job_bf and replace with
    * Disable sbatch, salloc, srun --reboot for non-admins.  SPANK - added support
    * for S_JOB_GID in the job script context with
    * Prolog/Epilog - add SLURM_JOB_GID environment variable.
    configuration file changes:
    * The mpi/openmpi plugin has been removed as it does nothing.
      MpiDefault=openmpi will be translated to the functionally-equivalent
    command changes (see man pages for details)
    * Display StepId=<jobid>.batch instead of StepId=<jobid>.4294967294 in output
    of "scontrol show step". (slurm_sprint_job_step_info())
    * MPMD in srun will now defer PATH resolution for the commands to launch to
    slurmstepd. Previously it would handle resolution client*side, but with
    a non*standard approach that walked PATH in reverse.
    * squeue - added "--me" option, equivalent to --user=$USER.
    * The LicensesUsed line has been removed from 'scontrol show config'.
    Please see the 'scontrol show licenses' command as an alternative.
    * sbatch - adjusted backoff times for "--wait" option to reduce load on
    slurmctld. This results in a steady*state delay of 32s between queries,
    instead of the prior 10s delay.
  - Removed following deprecated patches:
    * removed patch slurmctld-rerun-agent_init-when-backup-controller-takes-over.patch
    * removed patch split-xdaemon-in-xdaemon_init-and-xdaemon_finish-for.patch
    * removed patch slurmctld-uses-xdaemon_-for-systemd.patch
    * removed patch slurmd-uses-xdaemon_-for-systemd.patch
    * removed patch slurmdbd-uses-xdaemon_-for-systemd.patch
    * removed patch slurmsmwd-uses-xdaemon_-for-systemd.patch
    * removed patch removed-deprecated-xdaemon.patch
* Wed Feb 05 2020 Christian Goll <>
  - standard slurm.conf uses now also SlurmctldHost on all build
    targets (bsc#1162377)
* Mon Jan 27 2020 Egbert Eich <>
  - Fix a missed systemd_requires -> systemd_ordering conversion.
* Fri Jan 24 2020 Egbert Eich <>
  - Remove special OHPC compatibility macro: these settings should
    be applied univerally.
  - Add a Recommends for mariadb to slurm-slurmdbd: it is recommened
    to run the database on the same machine as the daemon.
* Fri Jan 24 2020 Dominique Leuenberger <>
  - BuildRequire pkgconfig(systemd) instead of systemd: allow OBS to
    shortcut through the -mini flavors.
  - Use systemd_ordering instead of systemd_requires: systemd is
    never a strict requirement; but in case the system is scheduled
    for installation together with systemd, we want systemd to be
    installed prior to slurm.
* Thu Jan 23 2020 Christian Goll <>
  - start slurmdbd after mariadb (bsc#1161716)
* Mon Jan 13 2020 Egbert Eich <>
  - Fix base_ver for SLE 15 SP2.
* Wed Jan 08 2020 Egbert Eich <>
  - Update to version 19.05.5 (jsc#SLE-8491)
    * Check %docdir/NEWS for details.
    * Includes security fixes CVE-2019-19727, CVE-2019-19728,
    * Disable i586 builds as this is no longer supported.
    * Create libnss_slurm package to support user and group resolution
      thru slurmstepd.
    * slurm-2.4.4-rpath.patch -> Remove-rpath-from-build.patch
    - pam_slurm_adopt-avoid-running-outside-of-the-sshd-PA.patch
    - pam_slurm_adopt-send_user_msg-don-t-copy-undefined-d.patch
    - pam_slurm_adopt-use-uid-to-determine-whether-root-is.patch
* Thu Jan 02 2020 Egbert Eich <>
  - Deprecate "ControlMachine" only for SLURM version upgrades and
    products newer than 1501. This ensures that the original setting
    is retained for the SLURM version shipped origianlly with SLE-15-SP1
    or Leap 15.1.



Generated by rpm2html 1.8.1

Fabrice Bellet, Sat Apr 1 23:57:32 2023