Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DocDB] Add tool to parse results for Jepsen append workload failures #25537

Open
1 task done
es1024 opened this issue Jan 8, 2025 · 0 comments
Open
1 task done

[DocDB] Add tool to parse results for Jepsen append workload failures #25537

es1024 opened this issue Jan 8, 2025 · 0 comments
Assignees
Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue

Comments

@es1024
Copy link
Contributor

es1024 commented Jan 8, 2025

Jira Link: DB-14792

Description

The Jepsen append workload has two operations:

  • Append an integer to a key's value
  • Read value of a key

When the Jepsen test fails, it's typically by identifying cycles corresponding to anomalies, and the
set of transactions and all of their operations for each anomaly are dumped in the results. These
results are often difficult to read:

  • Read values are printed in full, including all the values appended by transactions well before the
    first transaction of the cycle. They're also printed one value per line, resulting in hundreds of
    lines of output per transaction.
  • Transaction IDs are not known to the Jepsen client, and thus not printed. It is typically
    necessary to identify each transaction in YB logs by dumping batches prepared/written and matching
    it against the operations reported by Jepsen.
  • Tests are performed against multi-node clusters, so logs for a single transaction will span
    multiple log files.

A tool to address the above issues should be added to help debug Jepsen issues.

Issue Type

kind/enhancement

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.
@es1024 es1024 added area/docdb YugabyteDB core features status/awaiting-triage Issue awaiting triage labels Jan 8, 2025
@es1024 es1024 self-assigned this Jan 8, 2025
@yugabyte-ci yugabyte-ci added kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue and removed status/awaiting-triage Issue awaiting triage labels Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue
Projects
None yet
Development

No branches or pull requests

2 participants