ci: add preview smoke test for frontend PRs#7192
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #7192 +/- ##
=======================================
Coverage 98.35% 98.35%
=======================================
Files 1348 1348
Lines 50691 50691
=======================================
Hits 49859 49859
Misses 832 832 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
Adds a CI job that waits for Vercel preview deployments to complete, then curls /health, /config/project-overrides, and / to verify they return 200. This catches server-side failures (like the missing index.handlebars in #7178) that the existing E2E and unit tests don't cover because they don't exercise the Vercel serverless path. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Trivial comment to ensure Vercel deploys a preview so the new smoke test job can run against it. Will be removed before merging. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Temporary change to validate the workflow works. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
8281d0d to
d10f1e5
Compare
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
There was a problem hiding this comment.
Code review is billed via overage credits. To resume reviews, an organization admin can raise the monthly limit at claude.ai/admin-settings/claude-code.
Once credits are available, reopen this pull request to trigger a review.
Docker builds report
|
Playwright Test Results (oss - depot-ubuntu-latest-16)Details
Playwright Test Results (oss - depot-ubuntu-latest-arm-16)Details
Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)Details
Playwright Test Results (private-cloud - depot-ubuntu-latest-16)Details
|
Visual Regression16 screenshots compared. See report for details. |
docs/if required so people know about the feature.Changes
Contributes to #7178
After the Vercel preview returned 500 on a recent PR while all CI checks passed, this adds a simple smoke test to the PR workflow that validates Vercel preview deployments are healthy before merging.
What it does
Adds a
smoke-testjob tofrontend-pull-request.ymlthat:/health/config/project-overrides/(index page)Checks both preview environments (
flagsmith-frontend-previewandflagsmith-frontend-staging). Times out gracefully if a deployment doesn't appear within 10 minutes.Why this approach
This is intentionally simple — just HTTP status checks, no E2E or browser tests. The goal is to catch deployment failures (500s, build errors, broken Express server) that unit tests can't detect. If we want more coverage later, we can build on this.
What changed
.github/workflows/frontend-pull-request.yml— Addeddeployments: readpermission andsmoke-testjobHow did you test this code?
Triggered the workflow via
workflow_dispatchon this branch and verified the smoke test job runs against the Vercel preview URLs. Will validate on this PR once Vercel deploys the preview.