Skip to content

(Chore): Parse system out from test suites#1126

Merged
trunk-io[bot] merged 1 commit into
mainfrom
tyler/bazel-stdout-parsing
Jun 24, 2026
Merged

(Chore): Parse system out from test suites#1126
trunk-io[bot] merged 1 commit into
mainfrom
tyler/bazel-stdout-parsing

Conversation

@TylerJang27

Copy link
Copy Markdown
Collaborator

Bazel frequently outputs a JUnit like:

<?xml version="1.0" encoding="UTF-8"?>
<testsuites>
    <testsuite name="batch_bin_tests" tests="1" failures="0" errors="1">
        <testcase name="batch_bin_tests" status="run" duration="0" time="0">
            <error message="exited with error code 101"></error>
        </testcase>
        <system-out>running 2 tests...</system-out>
    </testsuite>
</testsuites>

Leading us to just output a pretty sparse and unhelpful error message. I updated our parsing so that if there's only one test case and it's nonsuccess, we will include the suite-level system out. Verified manually as well with an internal.bin

@trunk-io

trunk-io Bot commented Jun 24, 2026

Copy link
Copy Markdown

😎 Merged successfully - details.

@codecov-commenter

codecov-commenter commented Jun 24, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.74%. Comparing base (282d74d) to head (c8d54dd).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1126      +/-   ##
==========================================
+ Coverage   82.37%   82.74%   +0.36%     
==========================================
  Files          69       69              
  Lines       15381    15482     +101     
==========================================
+ Hits        12670    12810     +140     
+ Misses       2711     2672      -39     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@trunk-staging-io

trunk-staging-io Bot commented Jun 24, 2026

Copy link
Copy Markdown

Static BadgeStatic BadgeStatic BadgeStatic Badge

Failed Test Failure Summary Logs
variant_quarantine_test should be quarantined when run with variant A test expected the sum of 2 + 2 to be 5, but it was 4, indicating a failing assertion. Logs ↗︎

View Full Report ↗︎Docs

@trunk-io

trunk-io Bot commented Jun 24, 2026

Copy link
Copy Markdown

Static BadgeStatic BadgeStatic BadgeStatic Badge

View Full Report ↗︎Docs

@trunk-io trunk-io Bot merged commit aa668fd into main Jun 24, 2026
27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

3 participants