Devon Marsh
Evaluating this against two competitors.
Member · 183 reputation · here since 6 Nov 2025
Asked (10)
har record printed no scrub line and the Cookie header is still sitting in the file
We only have one project registered, so I have got into the habit of leaving -p off and letting it pick. Recorded fine, scenario replays. But there was no line like this at the…
asked by Devon Marsh183 ·Where does the Docker image keep its data, and what happens without the volume?
The documented run command has -v sdods-data:/data in it. I dropped it to try the UI quickly, created a couple of things, and after a restart they were gone. I assume that is the…
asked by Devon Marsh183 ·token strategy authenticates my API calls but the browser is signed out
auth.strategy: token with a working token. All the @api scenarios are green. Every @ui scenario starts at the login page. I assumed the token would be placed into the browser…
asked by Devon Marsh183 ·proposals accept --branch fails with Could not switch to branch and no reason why
That is the whole message. Nothing applied, which I am glad about, but git's own reason is nowhere — not on stdout, not with --json. Am I supposed to guess?
asked by Devon Marsh183 ·Healing picked the wrong one of three matching elements and the test still passed
Product grid, several cards, each with an "Add" button. The context on our add-to-basket locator is: The primary broke after a class rename. The healer found three matching…
asked by Devon Marsh183 ·auth.strategy "custom" needs an auth export in steps/auth.ts, and I wrote one
Our login is a two-step form — email, continue, then password on the next screen — so the four selectors in auth.form do not cover it. Set the strategy to custom and wrote the…
asked by Devon Marsh183 ·sdods agent heal ends with Agent job ... failed: unknown and I cannot find a log
Nothing under proposals/. sdods agent jobs lists the job with the same empty error. Adding --events prints the turns up to about turn eleven and then just stops, mid tool call,…
asked by Devon Marsh183 ·@har:checkout warns that no recorded file exists — is there a way to declare it up front?
Writing the scenario before recording the traffic, which I thought was the intended order: It is only a warning and I understand why — the file genuinely is not there yet. But we…
asked by Devon Marsh183 ·Job shows exit 130 — did the suite fail or not?
Evaluating SDODS against two other tools, so forgive the basic question. A nightly ended with exit code 130 and there is no failing scenario in the report — 212 passed, 0 failed,…
asked by Devon Marsh183 ·SDODS_UI_BASE_URL in the build image overrides -e staging and there seems to be no flag to beat it
Our agent image exports SDODS_UI_BASE_URL=http://localhost:3000 for an unrelated tool. Runs pick the staging environment correctly — the API side goes to the staging API — but…
asked by Devon Marsh183 ·
Answered (6)
Audit wants proof the agents cannot write to our repo — what do I actually show them?
Internal audit has heard the words "AI writes our tests" and wants a control, not a paragraph. Saying that agents only write proposals is exactly the kind of claim they will ask…
asked by Zeynep Arslan64 ·Local model loops on agent generate, calling the same tool until it hits max turns
It calls feature_list, reads the result, calls feature_list again with the same arguments, and keeps going until the turn budget stops it. No proposal. It is not confused about…
asked by Paulo Mendes97 ·sdods doctor lists six credential rows for agents — which one do I actually need?
New to this. sdods doctor gives me a tidy screen and then a token section that lists what looks like six different ways to pay for the same thing. ANTHROPIC_API_KEY, a claude CLI…
asked by Paulo Mendes97 ·Should each tester run sdods mcp locally, or should we host one server for the team?
Eight testers, one repo, one staging environment. Right now everybody has stdio in their editor and their own checkout. It works, but nobody can ask about a run somebody else…
asked by Ingrid Solberg241 ·users.poolSize is 4 and now a row that exists in the CSV is not in the pool
envs/staging.yaml has: data/staging/users.csv has five rows. Row five is visual_user, role standard. The name is in the file, spelled the same, and the role exists. Raising…
asked by Rasha Halabi572 ·Does ${VAR} in a CSV dataset resolve from .env.staging, or only from the shell?
Our data/common/users.csv has a password column holding ${TEST_MEMBER_PASSWORD} so the value is not in the repo. It works on my machine, where the variable is exported. On a…
asked by Rasha Halabi572 ·