Bea Lindqvist
Tagging policy pedant, and the suite is faster for it.
Regular · 4,318 reputation · here since 15 Jan 2024
Asked (9)
analyze stopped at 8000 files and most of them were gitignored worktrees
sdods analyze . on our monorepo finishes but the checklist has scan-truncated on it, and the report is nonsense: no CI provider, two modules, no test-id attribute. We have 48…
asked by Bea Lindqvist4,318 ·Can I turn healing off for one scenario without touching the whole project?
We have one scenario whose entire job is to assert that the design system has not moved the primary action button. Healing makes it unfalsifiable — it heals to the role and…
asked by Bea Lindqvist4,318 ·Chaining a created id into a UI assertion: JSON path $.id is undefined in the last response
Trying to seed through the API and assert in the browser, which is the whole reason we picked this thing. The endpoint definitely returns an id, I checked with curl.
asked by Bea Lindqvist4,318 ·What should I actually look at in a proposal before running sdods proposals accept?
First week of using the generator role. sdods proposals show <id> gives me a diff and a manifest and I am reading it the way I read any PR, which I suspect is the wrong instinct…
asked by Bea Lindqvist4,318 ·Process "pr-chek" is not defined for project demo-shop — where do processes come from?
Typo, obviously. But the hint mentions two files — how do those two lists combine? We have pr-check in both.
asked by Bea Lindqvist4,318 ·Will SDODS download its own Chromium if I already have Playwright installed?
I already have a Playwright project on this machine with all three engines downloaded. I would rather not carry a second copy of everything just to try SDODS. Does it use the…
asked by Bea Lindqvist4,318 ·We renamed one button and 40 scenarios healed in the same run — now what?
Design renamed "Continue" to "Next" on the checkout stepper. Nothing failed. The nightly regression run is green and carries forty-one heal events, all with the same description,…
asked by Bea Lindqvist4,318 ·Why did my API scenario write posts.api.har and not posts.har?
Same tag, same command shape as the UI one, different filename. After recording: There is no posts.har. I assumed the extension was a typo somewhere until I went looking for the…
asked by Bea Lindqvist4,318 ·Does @data:orders load the dataset, or do I still need the Given step?
Tagged a scenario @data:orders on the assumption that it would put the columns in scope the way @user:standard puts an account in scope. The scenario runs, lint is clean, and the…
asked by Bea Lindqvist4,318 ·
Answered (16)
I quarantined a flaky scenario and it still reds the gate
Followed the flaky triage advice and quarantined the worst offender: It shows as quarantined on the dashboard. It also still fails the nightly, and the gate is still red, which…
asked by Renata Kohl608 ·--strict on sdods run did not turn warnings into failures like it does on sdods lint
We wanted the nightly to fail on lint warnings, so somebody moved the flag onto the run: It ran, it passed, and the eleven warnings we were trying to catch are still there. On…
asked by Paulo Mendes97 ·Lint passes but the run fails on a missing step — why is undefined-step checking opt-in?
Clean lint, then the run dies immediately on a step nobody wrote. Turning the flag on finds it: If it can find it, why is it not on by default? Feels like the most valuable check…
asked by Ingrid Solberg241 ·A renamed tag left our smoke job passing with zero tests for three weeks
Three weeks. The only trace, in a log nobody opens: I understand from an older thread here that an empty selection exits 0 on purpose so a matrix leg with nothing to do stays…
asked by Tanvi Bhatt126 ·Can one scenario belong to two modules? It touches cart and checkout
Our modules each declare a tag, and lint reminds me when a scenario is missing its module's tag: Fine. But the scenario adds an item to the cart and then completes checkout, and…
asked by Rasha Halabi572 ·Two Examples blocks, one @smoke and one @regression — lint says found @smoke @regression
I wanted one outline with a small set of rows in smoke and the long tail in regression: Both tables are tagged once. Is this rule just not aware of Examples-level tags?
asked by Koen Vermeulen309 ·@skip:safari rejected — how do I skip a scenario on Safari?
The scenario genuinely cannot pass on Safari. The error lists five names and none of them is safari. What am I meant to write?
asked by Sergio Alcaraz415 ·Node v20 is too old — can the installer sort that out itself?
Our runner image is pinned to an older Node and I do not own that image. Install stops here: Is there a way to get a new enough Node without rebuilding the image or asking the…
asked by Nikhil Sane487 ·--fix-tags added @ui everywhere but left every suite-tag error untouched
Inherited a project with about ninety scenarios and no tags at all. Ran: It rewrote the files and the layer errors are gone, which is great. But every tags/suite error is still…
asked by Anouk de Vries238 ·A typo in -t made CI green for three weeks — why does matching nothing exit 0?
Someone renamed our pull-request step and dropped a letter: Three weeks of green pull requests. Nothing ran. The output even says so if you scroll up: A green tick under a…
asked by Bruno Teixeira694 ·Does -t "@regression and not @mock" replace the layer filter or add to it?
I want the nightly regression minus anything that runs against mocked network, so: It ran fewer scenarios than -t @regression on the same layer, which is what I wanted, but I…
asked by Fiona McAllister159 ·Unknown module "api" for project demo-shop — but features/api/ exists
The directory is features/api/, so where does posts-api come from? -m cart works and that folder is features/cart/.
asked by Fiona McAllister159 ·Pipeline exits 3 and no test ran — the report is empty
Merged a branch this morning and the test job now ends in seconds: There is no HTML report and no failing scenario to look at, so my first instinct was that the runner is broken.…
asked by Renata Kohl608 ·Why is a completely made-up tag only a warning while @jira:demo12 fails the build?
Trying to understand the severity model, because it looks backwards to me. @foo:bar is total nonsense and it only warns. @jira:demo12 is an obvious typo of a real thing and it…
asked by Nikhil Sane487 ·Recorded spec is all .btn_primary and nth-child — fix the locators before or after converting?
Recorded a checkout. The spec is mostly this: Each of those came back with a // sdods:fragile comment above it, and the CLI finished with I would rather not convert this into a…
asked by Nikhil Sane487 ·CI has been green for a week and I do not think the suite ran at all
Someone renamed a tag and our pipeline step is: Exit code 0, green check, everyone happy. I only looked because a bug walked into production that we have a scenario for.…
asked by Karine Moreau655 ·