Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

b/390177544 cart: Support dynamic mercury/libfabric loglevels (#15738) #16077

Merged
merged 2 commits into from
Mar 12, 2025

Conversation

mjmac
Copy link
Contributor

@mjmac mjmac commented Mar 11, 2025

Mercury and libfabric are much too spammy to enable at lower
than warning level by default. Mercury does support adjustment
of its log level and logged subsystems at runtime, so this
patch provides access to that functionality from the
existing dmg server set-logmasks tool.

This version of the patch adds support for writing DEBUG logs to
a separate file in order to avoid problems with log ingestion
pipelines that may be overwhelmed by the volume of DEBUG-level
logging. To enable a standalone debug log, set the environment
variable D_LOG_DEBUG_FILE to a path on disk where debug logs
will be written. The log size and rotation behavior set for
the main log file will be also applied to the debug log.

To enable debug logging for just the mercury/libfabric libraries:
dmg server set-logmasks -m EXTERNAL=DEBUG

To disable debug logging again:
dmg server set-logmasks -m EXTERNAL=ERR

Change-Id: I667ed105545f3da717cb79ca07ae904673121d4b
Signed-off-by: Michael MacDonald mjmac@google.com

Mercury and libfabric are much too spammy to enable at lower
than warning level by default. Mercury does support adjustment
of its log level and logged subsystems at runtime, so this
patch provides access to that functionality from the
existing `dmg server set-logmasks` tool.

This version of the patch adds support for writing DEBUG logs to
a separate file in order to avoid problems with log ingestion
pipelines that may be overwhelmed by the volume of DEBUG-level
logging. To enable a standalone debug log, set the environment
variable D_LOG_DEBUG_FILE to a path on disk where debug logs
will be written. The log size and rotation behavior set for
the main log file will be also applied to the debug log.

To enable debug logging for just the mercury/libfabric libraries:
  dmg server set-logmasks -m EXTERNAL=DEBUG

To disable debug logging again:
  dmg server set-logmasks -m EXTERNAL=ERR

Change-Id: I667ed105545f3da717cb79ca07ae904673121d4b
Signed-off-by: Michael MacDonald <mjmac@google.com>
Copy link

Errors are Ticket number prefix incorrect,PR title is malformatted. See https://daosio.atlassian.net/wiki/spaces/DC/pages/11133911069/Commit+Comments,Unable to load ticket data
https://daosio.atlassian.net/browse/b/390177544

jolivier23
jolivier23 previously approved these changes Mar 11, 2025
Signed-off-by: Michael MacDonald <mjmac@google.com>
@jolivier23 jolivier23 merged commit 17762ab into google/2.6 Mar 12, 2025
52 checks passed
@jolivier23 jolivier23 deleted the dev/mjmac/dbg-logging branch March 12, 2025 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants