Remove screenshot test PR comment workflow; replace with inline CI error and retries#2863
Remove screenshot test PR comment workflow; replace with inline CI error and retries#2863Copilot wants to merge 6 commits into
Conversation
|
@copilot can you make screenshot tests retry up to 3 times if they fails before marking the workflow as failed? |
Done — the |
|
@copilot can you do the same for android tests? |
Done — the Android test script now retries the |
|
@copilot looks like something is wrong with the android task |
... Fixed — the root cause was that |
The
screenshot-test-comment.ymlworkflow (pull_request_target) always failed on first run for fork PRs because the workflow requires manual approval before running — meaning the screenshot test it was waiting on hadn't run yet.Changes
.github/workflows/screenshot-test-comment.yml— removes the fragile PR comment workflow entirelyReport Screenshot Test failurestep to theScreenshotTestsjob inmain.ymlusing the::error::workflow command, following the same pattern already used byJavadocDoclint:The error message preserves the key guidance from the old PR comment: how to download the report artifact, what to do for unintentional vs. intentional visual changes, and a link to the README.
main.yml) — the Gradle test task is retried up to 3 times before the job is marked as failed, reducing noise from transient failures.android-screenshot.yml) — theconnectedDebugAndroidTestGradle task is similarly retried up to 3 times, with anadb uninstallbefore each attempt to ensure a clean state. The job timeout was increased from 20 to 60 minutes to accommodate the retries.