Mon Database Reference

This page contains a list of all the measurements stored in the beegfs-mon InfluxDB.

meta

Key	Data Type	Description
nodeID	string	ID of the node the point is related to.
nodeNumID	int	Unique numeric ID of the node the point is related to.
isResponding	bool	Node was responding when writing the point. If not, points are still written without data, and this is set to false.
indirectWorklistSize	int	# of queued indirect tasks.
directWorklistSize	int	# of queued direct tasks.
invalNumWatchers	int	# of clients currently subscribed for inode invalidation notifications. Only written when the metadata cache invalidation feature is enabled (sysRemoteInvalEnabled).
invalWatchNumInodes	int	# of inodes currently held in this meta’s invalidation watch cache. Only written when the metadata cache invalidation feature is enabled (sysRemoteInvalEnabled).

highResMeta

Key	Data Type	Description
nodeID	string	ID of the node the point is related to.
nodeNumID	int	Unique numeric ID of the node the point is related to.
workRequests	int	# of work requests processed during the measurement period.
queuedRequests	int	# of work requests queued during the measurement period.
netSendBytes	int	Bytes sent to other nodes.
netRecvBytes	int	Bytes received from other nodes.

metaTargets

Key	Data Type	Description
nodeID	string	ID of the node the related target is on.
nodeNumID	int	Unique numeric ID of the node the related target is on.
diskSpaceTotal	int	Total disk space on meta target in bytes.
diskSpaceFree	int	Free disk space on meta target in bytes.
inodesTotal	int	Total inodes on meta target.
inodesFree	int	Inodes available on meta target.
targetConsistencyState	string	Target consistency state. Is either GOOD, NEEDS_RESYNC, or BAD.

invalWatchPerClient

One point per client that is currently subscribed for inode invalidation notifications on the given meta server. Only written when the metadata cache invalidation feature is enabled (sysRemoteInvalEnabled). Cumulative counters in this measurement (e.g. numInvalidations) only ever increase. To turn such a counter into a rate, look at how much it grew over a time interval and divide by the length of that interval.

Key	Data Type	Description
nodeID	string	ID of the meta node the point is related to.
nodeNumID	int	Unique numeric ID of the meta node the point is related to.
clientId	int	Numeric node ID of the client the point relates to.
watchedInodeCount	int	# of inodes this client currently has subscribed for invalidation.
numInvalidations	int	Cumulative # of inode invalidations the meta has sent to this client since the watcher registered. Take its increase over a time interval (non-negative derivative) to get the invalidation rate.

storage

Key	Data Type	Description
nodeID	string	ID of the node the point is related to.
nodeNumID	int	Unique numeric ID of the node the point is related to.
isResponding	bool	Node was responding when writing the point. If not, points are still written without data, and this is set to false.
indirectWorklistSize	int	# of queued indirect tasks.
directWorklistSize	int	# of queued direct tasks.
diskSpaceTotal	int	Total disk space on all storage targets combined in bytes.
diskSpaceFree	int	Free disk space on all storage combined targets in bytes.

highResStorage

Key	Data Type	Description
nodeID	string	ID of the node the point is related to.
nodeNumID	int	Unique numeric ID of the node the point is related to.
workRequests	int	# of work requests processed during the measurement period.
queuedRequests	int	# of work requests queued during the measurement period.
netSendBytes	int	Bytes sent to other nodes.
netRecvBytes	int	Bytes received from other nodes.
diskWriteBytes	int	Bytes wrote to storage targets.
diskReadBytes	int	Bytes read from storage targets.

storageTargets

Key	Data Type	Description
nodeID	string	ID of the node the related target is on.
nodeNumID	int	Unique numeric ID of the node the related target is on.
storageTargetID	int	Unique numeric ID of the storage target the point is related to.
workRequests	int	# of work requests processed during the measurement period.
queuedRequests	int	# of work requests queued during the measurement period.
diskSpaceTotal	int	Total disk space on storage target in bytes.
diskSpaceFree	int	Free disk space on storage target in bytes.
inodesTotal	int	Total inodes on storage target.
inodesFree	int	Inodes available on storage target.
targetConsistencyState	string	HA target consistency state. Is either GOOD, NEEDS_RESYNC, or BAD.

clientOps

There are four measurements of the form (meta|storage)clientOpsBy(Node|User) which contain counters for most messages sent from the clients to the servers. Some of them correspond to actual system calls made on the VFS (like open, rename, …), others are more internal.

The tables ending with ByNode contain the counters grouped by client node (IP address) while the tables ending with ByUser contain the counters grouped by system user id.

Key	Data Type	Description
node	string	IP address of the client node the point relates to in dot notation. Only in the ByNode measurements.
user	string	Local user ID of the user who used the client node the point relates to. Only in the ByUser measurements.
*	int	# of syscalls on the beegfs client during measurement period. There is one key for each type of syscall, but only if there occurred at least one.

Listed below are the existing counters, grouped by meta and storage type.

List of meta client ops

System call related

These can be related to a corresponding system call on the VFS. However, the counters count the internal messages received on the servers, not the actual system calls made on the client.

Name	Description
close	# of CLOSE operations
getXA	# of GETXATTR operations
hardlnk	# of HARDLINK operations
listXA	# of LISTXATTR operations
mkdir	# of MKDIR operations
open	# of OPEN operations
rddir	# of READDIR operations
ren	# of RENAME operations
rmXA	# of REMOVEXATTR operations
rmdir	# of RMDIR operations
setXA	# of SETXATTR operations
stat	# of STAT operations
statfs	# of STATFS operations
symlnk	# of SYMLINK operations
trunc	# of TRUNCATE operations
unlnk	# of UNLINK operations

Internal

Name	Description
ack	# of acks
create	# of MKFILE operations
createLI	# of LOOKUPINTENT_CREATE operations
dirparent	# of UPDATEDIRPARENT operations
entInf	# of GETENTRYINFO operations
flckAp	# of FLOCKAPPEND operations
flckEn	# of FLOCKENTRY operations
flckRg	# of FLOCKRANGE operations
fndOwn	# of FINDOWNER operations
lookLI	# of LOOKUPINTENT_SIMPLE operations
mdsInf	# of REQUESTMETADATA operations
mirror	# of operations on secondary buddies.
mvDirIns	# of MOVINGDIRINSERT operations
mvFiIns	# of MOVINGFILEINSERT operations
openLI	# of LOOKUPINTENT_OPEN operations
refrEnt	# of REFRESHENTRYINFO operations
revalLI	# of LOOKUPINTENT_REVALIDATE operations
rmLnk	# of RMLINK operations
sAttr	# of SETATTR operations
sChDrct	# of SETCHANNELDIRECT operations
sDirPat	# of SETDIRPATTERN operations
statLI	# of LOOKUPINTENT_STAT operations
sum	# of all operations combined

List of storage client ops

Name	Description
B-rd	data read in bytes
B-wr	data written in bytes
ack	# of acks
close	# of CLOSELOCAL operations
fsync	# of FSYNCLOCAL operations
gendbg	# of GENERICDEBUG operations
getFSize	# of GETLOCALFILESIZE operations
hrtbeat	# of HEARTBEAT operations
ops-rd	# of read operations
ops-wr	# of write operations
remNode	# of REMOVENODE operations
sAttr	# of SETLOCALATTR operations
sChDrct	# of SETCHANNELDIRECT operations
statfs	# of STATSTORAGEPATH operations
storInf	# of REQUESTSTORAGEDATA operations
sum	# of all operations combined, excluding data read/written
trunc	# of TRUNCLOCALFILE operations
unlnk	# of UNLINK operations