Questions tagged config
sdods.project.yaml, envs/*.yaml, .env files and the order they resolve in.
101 questions
Does colorScheme from the env use: block reach a recording, or only the runner?
envs/staging.yaml has: sdods run -l ui respects all three. A recording started with comes up in light mode for me, while the locale and the timezone are clearly applied — the…
asked by Zeynep Arslan64 ·Locator fragility table is empty in insights but heal report has plenty of rows
gives me eleven rows, two of them with double-digit occurrences. prints suite health and the scenario table, and the locators section is empty. Runs are being ingested — there is…
asked by Paulo Mendes97 ·Audit wants proof the agents cannot write to our repo — what do I actually show them?
Internal audit has heard the words "AI writes our tests" and wants a control, not a paragraph. Saying that agents only write proposals is exactly the kind of claim they will ask…
asked by Zeynep Arslan64 ·Can --explain show the values a layer lost with, not just the winner?
The provenance table gives one row per leaf with the winning layer. Passing --headed shows runtime.headed cli; exporting SDODS_HEADED=1 instead shows processEnv; with both it…
asked by Koen Vermeulen309 ·Six locales times dark and light means twelve env files — is there a per-scenario way?
We ship in six locales and both colour schemes. As far as I can tell the locale and the colour scheme are properties of the environment, so covering the matrix means twelve…
asked by Paulo Mendes97 ·sdods doctor says "demo-shop/staging vars — 0 var(s) resolved" and passes. Is that right?
Green tick, zero variables. The staging environment definitely has a ${...} in it, so I expected at least one. Is the check finding nothing, or finding nothing to complain about?
asked by Zeynep Arslan64 ·Scenarios for a feature flag that is on in staging and off in production
Our new checkout is behind a build-time flag. On staging it is on, on the production build it is off, and the flag is baked into the bundle at build time so there is nothing to…
asked by Zeynep Arslan64 ·Local model loops on agent generate, calling the same tool until it hits max turns
It calls feature_list, reads the result, calls feature_list again with the same arguments, and keeps going until the turn budget stops it. No proposal. It is not confused about…
asked by Paulo Mendes97 ·12k rows of reference data: commit the CSV or import it into a db dataset?
Our pricing rules are about twelve thousand rows and they change roughly weekly, on a schedule that has nothing to do with our release schedule. Today they are a committed CSV,…
asked by Paulo Mendes97 ·Adding Allure without losing the SDODS dashboard and the ndjson
Our QA lead wants Allure because that is what the other teams publish. I am happy to produce it, but the last time I touched a reporter list in another tool I lost everything…
asked by Paulo Mendes97 ·My @env:local scenarios ran against staging — does @env: actually skip anything?
The tags table says @env:<name> "restricts a scenario to one environment", and sdods lint is happy with the tag. But: ran all 41 of our @env:local scenarios against staging. Some…
asked by Lars Vinter276 ·sdods doctor lists six credential rows for agents — which one do I actually need?
New to this. sdods doctor gives me a tidy screen and then a token section that lists what looks like six different ways to pay for the same thing. ANTHROPIC_API_KEY, a claude CLI…
asked by Paulo Mendes97 ·No projects found when running inside a container, works fine on the host
Same repo, mounted into the image at /srv/app. On the host every command is fine. Inside: And naming one explicitly gives a slightly different message: The directory is…
asked by Paulo Mendes97 ·token strategy authenticates my API calls but the browser is signed out
auth.strategy: token with a working token. All the @api scenarios are green. Every @ui scenario starts at the login page. I assumed the token would be placed into the browser…
asked by Devon Marsh183 ·Pool leased an account whose username is the literal ${TEST_MEMBER_EMAIL} and auth rejected it
Local runs only. CI has been green throughout, which is why this took a day. projects/mybotbox/data/staging/users.csv: The failure is not from SDODS. It is from the auth…
asked by Ingrid Solberg241 ·strategy: sso gives me no session and no error — every scenario lands on /login
We are behind an identity provider, so: Every @ui scenario now fails, but not with an auth error — with a pile of locator timeouts, because the page is /login and none of the…
asked by Fiona McAllister159 ·probeTimeoutMs of 1500 is too short on our staging box — every candidate scores 0
Locally everything heals. On staging the same locators fail with HEAL_FAILED and every candidate in the hint reads 0.00, including ones I know match, because I can open the page…
asked by Rasha Halabi572 ·I use no authentication still sends the bearer token — my 401 assertion gets a 200
Deny-direction scenario, as plain as it gets: The endpoint does deny anonymous callers — I checked with curl. Our envs/staging.yaml has: and if I remove that block the scenario…
asked by Gio Castellano521 ·Should each tester run sdods mcp locally, or should we host one server for the team?
Eight testers, one repo, one staging environment. Right now everybody has stdio in their editor and their own checkout. It works, but nobody can ask about a run somebody else…
asked by Ingrid Solberg241 ·Route keys like pageid-edit-components-section-palette — do I have to type these?
The generated routes: map is full of keys like and the navigate step takes the key: Nobody on my team is going to type that correctly twice. Can the key be something else?
asked by Anouk de Vries238 ·Exactly which .env files get read, in which order, and how do I confirm it?
I have inherited a repo with .env, .env.local, .env.staging and .env.staging.local at the root and two more inside the project folder. Nobody remembers why. Before I delete any…
asked by Ingrid Solberg241 ·analyze gave me modules called deploy, execute and status instead of workflows
Thirty modules on the proposal and twelve of them are verbs: status, delete, export, send, run, update, upload, download, stats, validate, versions, introspect. They are all…
asked by Tanvi Bhatt126 ·Quarantined scenarios still run in our release gate and still fail it
We quarantine flaky scenarios in the web UI while somebody fixes them. The dashboard shows them as quarantined, so I assumed that was the end of it. The release gate disagrees.…
asked by Ingrid Solberg241 ·Every generated API scenario hits the UI origin — ui and api baseUrl came out identical
Fresh project from analyze. The starter @api features all fail with HTML where JSON should be, and the reason is in the env file: Our API is at /api on the same origin. I…
asked by Yusuf Demir201 ·The generated env yaml points api at our copilot host instead of our API
envs/staging.yaml came out with: That is a different service entirely. The correct value is in the same .env.example file that analyze read: So it is not that it could not find…
asked by Nikhil Sane487 ·
Earlier (76)
- analyze put a URL out of my gitignored .env.local straight into the generated env yaml3 answers · 2026
- analyze stopped at 8000 files and most of them were gitignored worktrees2 answers✓ · 2026
- Can I turn healing off for one scenario without touching the whole project?2 answers✓ · 2026
- Catching broken configuration in the pull request instead of ten minutes into the suite2 answers✓ · 2026
- sdods analyze invented 18 page routes out of directories that happen to be called pages2 answers✓ · 2026
- auth.strategy "custom" needs an auth export in steps/auth.ts, and I wrote one1 answer✓ · 2025
- SDODS_UI_BASE_URL in the build image overrides -e staging and there seems to be no flag to beat it0 answers · 2025
- users.poolSize is 4 and now a row that exists in the CSV is not in the pool3 answers✓ · 2025
- Every scenario passed and the release gate still failed the job2 answers✓ · 2025
- What does --write-history actually change about future heals?1 answer✓ · 2025
- How do I give the team coding agents read-only access to our SDODS server?4 answers✓ · 2025
- Does ${VAR} in a CSV dataset resolve from .env.staging, or only from the shell?3 answers✓ · 2025
- Can one scenario belong to two modules? It touches cart and checkout3 answers✓ · 2025
- Docs say null clears a key and undefined is skipped — where does that apply, exactly?1 answer✓ · 2025
- My mcp.servers block is ignored when the agent runs with the openai adapter2 answers · 2025
- Where do the generated spec files live? Git does not see them and neither do I2 answers · 2025
- products.json must contain an array of rows (or { rows: [...] }) — mine is keyed by sku2 answers · 2025
- Three projects with nearly identical settings — how much can actually be shared?4 answers✓ · 2025
- Local model writes out the tool call as text instead of actually calling it3 answers✓ · 2025
- Project references workspace "payments" which is not declared in sdods.workspace.yaml3 answers✓ · 2025
- Runs are 900MB of PNGs — can I keep the baseline check and stop capturing every step?2 answers✓ · 2025
- Several projects found; pass --project <slug> — it used to work without one1 answer✓ · 2025
- CONFIG_INVALID: Project demo-shop has no data.userPool configured, but data.sources.users exists2 answers✓ · 2025
- browsers: [chromium] in envs/local.yaml does nothing and raises no error2 answers✓ · 2024
- Dataset uses type "db" but @sdods/db is not available — is the package optional or not?0 answers · 2024
- perf.budgets validates and resolves, and a nine-second page still passes. What am I missing?2 answers✓ · 2024
- Team-wide setup for keeping credentials out of the repo — what actually works day to day?4 answers · 2024
- What should minScore be? 0.6 feels arbitrary2 answers · 2024
- Invalid shard "1-3", expected "<current>/<total>" like 1/31 answer✓ · 2024
- Process "pr-chek" is not defined for project demo-shop — where do processes come from?2 answers✓ · 2024
- caps core,agent gives Unknown capability "agent" and I cannot find the real list1 answer✓ · 2024
- Unknown module "api" for project demo-shop — but features/api/ exists2 answers✓ · 2024
- Can two projects share one page object, or do we copy the file and live with it?2 answers✓ · 2024
- sdods mcp --http exits immediately with HTTP mode needs a bearer token2 answers✓ · 2024
- Repo-root .env and a project .env both set the same name — which one is used?1 answer✓ · 2024
- Four environments, same app — how should base URLs be laid out so nobody copies the wrong one?3 answers · 2023
- Dataset table needs env.db in envs/staging.yaml — which database is it asking for?1 answer✓ · 2023
- Is it safe to leave self-healing enabled in CI, or is that cheating?2 answers✓ · 2023
- Does every scenario log in separately, or is there one place the login state comes from?3 answers✓ · 2023
- Environment "qa" has no file at projects/demo-shop/envs/qa.yaml2 answers✓ · 2023
- testIdAttribute is data-test, so why does the heal suggestion say getByTestId?2 answers✓ · 2023
- Which key names does the secret check actually match? tokenUrl is fine but standardPassword is not3 answers✓ · 2023
- CI job exits 2 with no test results and an empty report — what is code 2?2 answers✓ · 2023
- auth list says the cached state is fresh but the recording opens logged out3 answers✓ · 2023
- How do I keep a "last updated" timestamp out of a visual baseline?1 answer✓ · 2023
- config show --explain says envYaml for a value that came out of .env.staging3 answers · 2023
- Should HAR files go into git? Ours are nearly a megabyte each3 answers✓ · 2023
- How do people keep real passwords out of a users.csv that has to be committed?2 answers✓ · 2023
- @env:qa rejected with "is not in envs.available (local, staging)" — we do have a qa env2 answers✓ · 2023
- Invalid configuration in envs/staging.yaml with a bullet list — how do I read the paths?3 answers✓ · 2023
- What does ${DEMO_SHOP_PASSWORD:-secret_sauce} mean, and how does it get past the secret check?1 answer✓ · 2022
- Factory "user" not found, hint says Known factories: (none), but the file exports it2 answers✓ · 2022
- If I pass --process nightly-regression and -t @smoke, which one wins?1 answer✓ · 2022
- How long should we keep .sdods/runs around? It is 40 GB now2 answers✓ · 2022
- record --user stops with: auth.strategy "custom" needs an auth export2 answers✓ · 2022
- Cannot parse YAML at envs/staging.yaml — all mapping items must start at the same column2 answers✓ · 2022
- Guide says baselines live under __screenshots__/<browser>/ — mine are in demo-shop--ui--chromium/darwin/3 answers✓ · 2022
- Project slug "demo-shop" does not match its directory "demoshop" after a rename2 answers✓ · 2022
- Added one mask selector in the env file and the other three disappeared3 answers✓ · 2022
- Can one HAR recording cover staging and prod, or is it per environment?1 answer✓ · 2022
- "@user:admin is not a declared role (standard, locked_out)" — where is that list?2 answers✓ · 2022
- Everyone on the team runs a slightly different command. Can I name one?2 answers✓ · 2022
- Warning: "Feature is not under a declared module directory" — but the file runs fine2 answers✓ · 2022
- Value in .env.staging is ignored, an old exported variable keeps winning2 answers✓ · 2022
- Unknown route "checkuot" for project demo-shop — where does that list come from?1 answer✓ · 2022
- New folder under projects/ is ignored completely — no error, just not there2 answers✓ · 2021
- I do not want healing to rescue a broken locator — I want the test to fail4 answers✓ · 2021
- USER_POOL_EXHAUSTED: No users with role "admin" in dataset "users" (env staging)2 answers✓ · 2021
- Project yaml, env yaml, .env, an exported variable and a flag all set the same thing — which one wins?4 answers✓ · 2021
- Layer "ui" is not enabled for project demo-shop — but the features are right there1 answer✓ · 2021
- Environment "qa" is not in envs.available [local, staging] — I created envs/qa.yaml already3 answers✓ · 2021
- No data file for "data/{env}/users.csv" in env "staging" when the common file exists2 answers✓ · 2021
- Unknown project "demo-shp" — how do I list the slugs it actually knows about?2 answers✓ · 2021
- Secret literal at "env.vars.password" — I want the password in the env file, why is that refused?2 answers✓ · 2020
- DATASET_NOT_FOUND says my dataset is not declared, but the CSV is right there2 answers✓ · 2020
- Unresolved variable ${API_TOKEN} at "env.api.auth.token" — where is it supposed to look?2 answers✓ · 2020