Anouk de Vries
Cares about the report more than the run.
Illustrative user
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Asked (11)
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Can I just install the .deb without adding the apt repository?
One laptop, one install, and I would rather not add a third-party apt source to a machine that our security policy says should have as few as possible. Is the standalone package…
asked by Anouk de VriesRoute keys like pageid-edit-components-section-palette — do I have to type these?
The generated routes: map is full of keys like and the navigate step takes the key: Nobody on my team is going to type that correctly twice. Can the key be something else?
asked by Anouk de VriesCatching broken configuration in the pull request instead of ten minutes into the suite
Twice this month a pull request that only touched an environment file went green on review and then took the nightly down. Both times it was something a schema check would have…
asked by Anouk de VriesDataset uses type "db" but @sdods/db is not available — is the package optional or not?
We keep the test workspace deliberately thin — the runner and nothing else — because it is installed on machines that only ever execute suites. One scenario reads reference rows…
asked by Anouk de VriesThe healer proposed a CSS locator when there is a perfectly good label — reject it?
Scenario broke, ran the healer, got a proposal. The patch swaps a page-object locator for a class chain: The input has a visible label reading "Promo code". So there is an…
asked by Anouk de VriesHEAL_FAILED: nothing scored above 0.6 and testId probed at 0.00
The context is: What I cannot work out is testid=0.00. It is the same test id the primary uses, so of course it found nothing — but then why probe it at all? And where does 0.42…
asked by Anouk de Vriesperf.budgets validates and resolves, and a nine-second page still passes. What am I missing?
Project yaml: Environment override, and a process that asks for the gate: shows perf.budgets.pageLoadMs resolving from envs/staging.yaml, so the plumbing is clearly there. But a…
asked by Anouk de VriesUninstalled SDODS and got almost no disk space back
Ran the uninstall and it reported success: It removed the install root and the command. But df barely moved. I was expecting most of a gigabyte.
asked by Anouk de Vries--fix-tags added @ui everywhere but left every suite-tag error untouched
Inherited a project with about ninety scenarios and no tags at all. Ran: It rewrote the files and the layer errors are gone, which is great. But every tags/suite error is still…
asked by Anouk de VriesTeam-wide setup for keeping credentials out of the repo — what actually works day to day?
We are onboarding six more testers and the current answer is "ask someone in chat for the staging password". I would like to write down one way of doing this that survives…
asked by Anouk de VriesAn admin approves what a standard user submitted — how do two roles fit in one scenario?
The flow we need to cover: a standard user submits an expense claim, an admin approves it, and the standard user sees it move to approved. @user:standard gives me one role. I…
asked by Anouk de Vries
Answered (9)
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Lint passes but the run fails on a missing step — why is undefined-step checking opt-in?
Clean lint, then the run dies immediately on a step nobody wrote. Turning the flag on finds it: If it can find it, why is it not on by default? Feels like the most valuable check…
asked by Ingrid SolbergGetting the HTML report out of the Docker image we run the suite in
We run the suite inside ghcr.io/yarlisaisolutions/sdods-server on a self-hosted agent. The run works and the exit code is right, then the container goes away and takes the report…
asked by Ingrid SolbergExactly which .env files get read, in which order, and how do I confirm it?
I have inherited a repo with .env, .env.local, .env.staging and .env.staging.local at the root and two more inside the project folder. Nobody remembers why. Before I delete any…
asked by Ingrid SolbergInsights say no runs, but we have a week of nightly runs on disk
Fine, so I ran compute: We have run this suite every night for a week and every run is sitting in .sdods/runs with its summary and its ndjson. Why does counting them need a…
asked by Rasha HalabiGetting run results onto a team dashboard without scraping the CLI
Management wants a pass-rate trend on the wall screen. Today somebody screenshots the console output on Monday morning. I would like to do this properly but I cannot tell which…
asked by Tanvi Bhattsdods run refuses to start with LINT_FAILED — can I run anyway while I fix the tags?
Mid-refactor, half my tags are wrong, and I want to run the six scenarios that are fine to check a page object change. Instead: Nothing ran. The broken scenarios are not even in…
asked by Tanvi BhattWhat writes error-context.md next to a failure, and can I use it?
Poking through a failed run I found this: The markdown file starts with the headings Instructions, Test info, Error details and Page snapshot, and the page snapshot is a full…
asked by Fiona McAllisterA typo in -t made CI green for three weeks — why does matching nothing exit 0?
Someone renamed our pull-request step and dropped a letter: Three weeks of green pull requests. Nothing ran. The output even says so if you scroll up: A green tick under a…
asked by Bruno TeixeiraEvery checkout scenario spends 40 seconds registering a user through the sign-up form first
Thirteen checkout scenarios, and each one starts by filling in the six-field registration form, confirming an email, and setting a password. That is about forty seconds before…
asked by Fiona McAllister