Anouk de Vries
Cares about the report more than the run.
Member · 238 reputation · here since 12 Sept 2024
Asked (11)
Can I just install the .deb without adding the apt repository?
One laptop, one install, and I would rather not add a third-party apt source to a machine that our security policy says should have as few as possible. Is the standalone package…
asked by Anouk de Vries238 ·Route keys like pageid-edit-components-section-palette — do I have to type these?
The generated routes: map is full of keys like and the navigate step takes the key: Nobody on my team is going to type that correctly twice. Can the key be something else?
asked by Anouk de Vries238 ·Catching broken configuration in the pull request instead of ten minutes into the suite
Twice this month a pull request that only touched an environment file went green on review and then took the nightly down. Both times it was something a schema check would have…
asked by Anouk de Vries238 ·Dataset uses type "db" but @sdods/db is not available — is the package optional or not?
We keep the test workspace deliberately thin — the runner and nothing else — because it is installed on machines that only ever execute suites. One scenario reads reference rows…
asked by Anouk de Vries238 ·The healer proposed a CSS locator when there is a perfectly good label — reject it?
Scenario broke, ran the healer, got a proposal. The patch swaps a page-object locator for a class chain: The input has a visible label reading "Promo code". So there is an…
asked by Anouk de Vries238 ·HEAL_FAILED: nothing scored above 0.6 and testId probed at 0.00
The context is: What I cannot work out is testid=0.00. It is the same test id the primary uses, so of course it found nothing — but then why probe it at all? And where does 0.42…
asked by Anouk de Vries238 ·perf.budgets validates and resolves, and a nine-second page still passes. What am I missing?
Project yaml: Environment override, and a process that asks for the gate: shows perf.budgets.pageLoadMs resolving from envs/staging.yaml, so the plumbing is clearly there. But a…
asked by Anouk de Vries238 ·Uninstalled SDODS and got almost no disk space back
Ran the uninstall and it reported success: It removed the install root and the command. But df barely moved. I was expecting most of a gigabyte.
asked by Anouk de Vries238 ·--fix-tags added @ui everywhere but left every suite-tag error untouched
Inherited a project with about ninety scenarios and no tags at all. Ran: It rewrote the files and the layer errors are gone, which is great. But every tags/suite error is still…
asked by Anouk de Vries238 ·Team-wide setup for keeping credentials out of the repo — what actually works day to day?
We are onboarding six more testers and the current answer is "ask someone in chat for the staging password". I would like to write down one way of doing this that survives…
asked by Anouk de Vries238 ·An admin approves what a standard user submitted — how do two roles fit in one scenario?
The flow we need to cover: a standard user submits an expense claim, an admin approves it, and the standard user sees it move to approved. @user:standard gives me one role. I…
asked by Anouk de Vries238 ·
Answered (9)
Lint passes but the run fails on a missing step — why is undefined-step checking opt-in?
Clean lint, then the run dies immediately on a step nobody wrote. Turning the flag on finds it: If it can find it, why is it not on by default? Feels like the most valuable check…
asked by Ingrid Solberg241 ·Getting the HTML report out of the Docker image we run the suite in
We run the suite inside ghcr.io/siri1410/sdods-server on a self-hosted agent. The run works and the exit code is right, then the container goes away and takes the report with it.…
asked by Ingrid Solberg241 ·Exactly which .env files get read, in which order, and how do I confirm it?
I have inherited a repo with .env, .env.local, .env.staging and .env.staging.local at the root and two more inside the project folder. Nobody remembers why. Before I delete any…
asked by Ingrid Solberg241 ·Insights say no runs, but we have a week of nightly runs on disk
Fine, so I ran compute: We have run this suite every night for a week and every run is sitting in .sdods/runs with its summary and its ndjson. Why does counting them need a…
asked by Rasha Halabi572 ·Getting run results onto a team dashboard without scraping the CLI
Management wants a pass-rate trend on the wall screen. Today somebody screenshots the console output on Monday morning. I would like to do this properly but I cannot tell which…
asked by Tanvi Bhatt126 ·sdods run refuses to start with LINT_FAILED — can I run anyway while I fix the tags?
Mid-refactor, half my tags are wrong, and I want to run the six scenarios that are fine to check a page object change. Instead: Nothing ran. The broken scenarios are not even in…
asked by Tanvi Bhatt126 ·What writes error-context.md next to a failure, and can I use it?
Poking through a failed run I found this: The markdown file starts with the headings Instructions, Test info, Error details and Page snapshot, and the page snapshot is a full…
asked by Fiona McAllister159 ·A typo in -t made CI green for three weeks — why does matching nothing exit 0?
Someone renamed our pull-request step and dropped a letter: Three weeks of green pull requests. Nothing ran. The output even says so if you scroll up: A green tick under a…
asked by Bruno Teixeira694 ·Every checkout scenario spends 40 seconds registering a user through the sign-up form first
Thirteen checkout scenarios, and each one starts by filling in the six-field registration form, confirming an email, and setting a password. That is about forty seconds before…
asked by Fiona McAllister159 ·