Release Notes v7.3.2

The BeeGFS 7.3.2 release includes some improvements to quota handling and the native cache mode as well as multiple other fixes and QoL improvements.

Warning

Before upgrading to this version from any version <7.3.1, please read the section about mandatory Authentication carefully. If you have not configured a connAuthFile, services will no longer start without configuration changes. For more background on why we make this change, please refer to our blog post on the topic.

General Changes/Improvements

  • The meta service can now enforce quota for file creations.

  • The native cache mode now supports the splice system call and other related operations that use ITER_PIPE. Support for splice in the buffered cache mode has also been re-added, which should fix some issues with NFS exports.

  • Changed EntryID locking in the metadata lock store to resolve an issue with rmdir. This change also leads to significantly improved stat and read performance in our testing.

  • Changed the behavior of beegfs-ctl --getquota --list to only list users or groups that have nonzero quota unless the --withzero option is supplied. This makes the behavior consistent with beegfs-ctl --getquota --all.

  • Added options to make connection timeouts for TCP and RDMA connections configurable. Note that this is an experimental feature and should only be used for testing. Do not change the timeouts in production environments unless rigorous testing has been done.

  • The parser for beegfs-mounts.conf can now recognize and ignore full line comments (lines starting with a #).

  • Lots of smaller improvements for our testing pipelines.

Fixes

  • Fixed an issue with quota enforcement on the meta servers (for chown/chgrp), where lists for users and groups that are over quota were not correctly updated.

  • Fixed a deadlock between mmap and read when both were operating on the same memory area. This should fix issues with multithreaded runs of fasterq-dump that have been reported by some users.

  • On new kernels (version >5.13), due to a change in the semantics of the enum iter_type in Linux’s uio.h, a check for a specific iterator type returned the wrong result, which lead to cache corruption in the native cache mode. The code has been adapted to correctly check the iterator type.

  • Added connDisableAuthentication configuration to client runtime config in procfs to fix an issue where beegfs-ctl with the --mount flag was not able to connect to other servers when connection authentication was disabled.

  • The client will no longer attempt to drop the link count on an inode if it is already 0.

  • Fixed an issue where the OFED_INCLUDE_PATH was not assigned early enough during DKMS client build, causing the feature detection to fail in some situations.

  • Some other smaller fixes to avoid warnings during compilation.

Known Issues and Limitations

  • The Metadata daemon does not work reliably on RHEL/CentOS 8 and SLES 15.1 and 15.2 due to a problem in the versions of glibc. The problem was fixed in RHEL/CentOS 8.1 and SLES 15.3.

  • The client module might hang if the IBV device(s) used are taken offline during operation.

  • The client module does not compile on SLES 15.2 with Mellanox OFED 5.2

Supported Linux Distributions and Kernels

Packages are provided for the x86_64 and aarch64 architecture and the following distributions:

  • RHEL 8 and 9 (packages can also be used on RockyLinux and Alma Linux)

  • SLES 15

  • Debian 10 and 11

  • Ubuntu 18.04, 20.04 and 22.04

The following Mellanox OFED driver versions are supported: 5.6, 5.5, 5.4, 5.3, 5.2, 5.1, 5.0, 4.9

The full integration test suite was run on Alma 9.0, Rocky 8.5, RHEL 8.5, Rocky 8.6, Alma 8.5, OpenSUSE 15 SP3, Debian 10, 11 and Ubuntu 20.04 and 22.04.

Client build testing:

  • RHEL 8.3: no OFED, OFED 4.9, 5.0, 5.1, 5.2, 5.3, 5.4

  • AlmaLinux 8.4: no OFED, OFED 5.3, 5.4

  • AlmaLinux 8.5: no OFED, OFED 5.3, 5.4, 5.5

  • AlmaLinux 9.0: no OFED, OFED 5.6, 5.7

  • Rocky Linux 8.4: no OFED, OFED 5.3, 5.4

  • Rocky Linux 8.5: no OFED, OFED 5.5

  • Rocky Linux 8.6: no OFED, OFED 5.6

  • SLES 15.1: no OFED, OFED 5.0

  • SLES 15.2: no OFED, OFED 5.1, 5.4

  • SLES 15.3: no OFED, OFED 5.4, 5.5, 5.6

  • SLES 15.4: OFED 5.6, 5.7

  • Debian 10: no OFED, OFED 5.2, 5.3, 5.4

  • Debian 11: no OFED, OFED 5.6

  • Ubuntu 18.04: no OFED

  • Ubuntu 20.04: no OFED, OFED 5.4

  • Ubuntu 22.04: no OFED, OFED 5.6, 5.7

Version Interoperability

BeeGFS v7.3.2 is compatible with BeeGFS v7.3.x.

Upgrading from Older Versions

To upgrade from an older version, please refer to the Upgrade Guide.