Sunita Kale
Platform team. Owns the runners.
Member · 982 reputation · here since 5 Sept 2022
Asked (6)
If I pass --process nightly-regression and -t @smoke, which one wins?
We have a nightly-regression process that pins the env, the layers, the browsers and a tag expression. Last night I wanted the same recipe but only the smoke scenarios, so I ran:…
asked by Sunita Kale982 ·Refusing to install as root — our build agent only has a root account
Trying to bake SDODS into our build image. The agent runs everything as root, and the installer stops: I understand why it does this on a laptop. On a throwaway agent there is no…
asked by Sunita Kale982 ·How do you actually decide between @smoke, @regression and @sanity?
Lint makes me pick exactly one, which is fine, but the three names do not tell me much and everyone on the team has a different theory. Right now roughly everything is…
asked by Sunita Kale982 ·record --user stops with: auth.strategy "custom" needs an auth export
Our login is bespoke, so the project yaml says: And every recording with a role stops immediately: The file is right there. What is it actually looking for?
asked by Sunita Kale982 ·Cannot parse YAML at envs/staging.yaml — all mapping items must start at the same column
Added a use: block to the staging file and now nothing runs: Line 12 looks identical to line 11 to me.
asked by Sunita Kale982 ·How do you assert on a row in a table without writing a CSS chain?
Orders table, and the scenario I want reads: What I have in the page object is this, which works until someone sorts the table or the row moves to page two: Is there a…
asked by Sunita Kale982 ·
Answered (14)
The UI says saved and no row is written — how do I assert on the database?
We keep getting the same class of bug: the form submits, the toast says saved, the UI shows the new item from local state, and nothing was persisted. It survives every UI…
asked by Hsu Wei-lin15,230 ·How do I fill a Stripe Elements card field from a feature file?
Checkout uses Elements, so the card number is inside an iframe. The obvious step does not find it: Which is fair enough — it is not in the main frame. I cannot find a frame step…
asked by Owen Brackley144 ·My @env:local scenarios ran against staging — does @env: actually skip anything?
The tags table says @env:<name> "restricts a scenario to one environment", and sdods lint is happy with the tag. But: ran all 41 of our @env:local scenarios against staging. Some…
asked by Lars Vinter276 ·295 API scenarios fail with QUOTA_EXCEEDED: Exceeded quota for verifying passwords
Ran the API and hybrid layers, single worker, one browser. 1,152 tests. 295 of the failures are this one message: The credentials are fine. If I run any one of those scenarios on…
asked by Ade Oyinlola419 ·Is there a --since? Every pull request runs the entire suite
A one-line change to a CSS file runs 900 scenarios. Other tools I have used take a diff and work out which tests could possibly be affected. I have read the flag list twice and I…
asked by Paulo Mendes97 ·Route keys like pageid-edit-components-section-palette — do I have to type these?
The generated routes: map is full of keys like and the navigate step takes the key: Nobody on my team is going to type that correctly twice. Can the key be something else?
asked by Anouk de Vries238 ·The generated env yaml points api at our copilot host instead of our API
envs/staging.yaml came out with: That is a different service entirely. The correct value is in the same .env.example file that analyze read: So it is not that it could not find…
asked by Nikhil Sane487 ·analyze put a URL out of my gitignored .env.local straight into the generated env yaml
Ran analyze on an app I had just been given, applied the proposal, opened the result and found this in projects/portal/envs/local.yaml: That value is not in any tracked file. It…
asked by Helle Borg352 ·Job shows exit 130 — did the suite fail or not?
Evaluating SDODS against two other tools, so forgive the basic question. A nightly ended with exit code 130 and there is no failing scenario in the report — 212 passed, 0 failed,…
asked by Devon Marsh183 ·--project-matrix or three -b flags? What is the difference in practice?
Our nightly says -b chromium -b firefox -b webkit. I noticed --project-matrix in the flag list and it looks like it does the same thing. Is one of them preferred, and what…
asked by Sergio Alcaraz415 ·Some browsers are not installed. — fresh agent, first run of the day
New pool of agents. The first thing the job does is a preflight: Exits 1. I can obviously run the suggested command, but adding a browser download to every job feels wrong when…
asked by Bruno Teixeira694 ·--headed on the build agent just sits there until the job times out
Someone copied their local command into the pipeline, including --headed, and the job now hangs and is killed at the 60-minute timeout. Removing the flag fixes it, so the…
asked by Fiona McAllister159 ·How many workers on a two-core build box, and can I stop at the first failure?
Two questions from the same afternoon of tuning. Our agents have two cores. I have seen -w 8 in examples, which on our box makes the UI run slower and adds timeouts. What is the…
asked by Lars Vinter276 ·Three shards, three HTML reports — how do I get one report out of a matrix build?
The nightly runs on three machines: Every machine mints its own run id, so I get three artefact directories, three HTML reports and three rows in the dashboard for what is one…
asked by Vikram Rajagopal1,240 ·