Questions tagged api
Scenarios that talk to an HTTP API and never open a page.
23 questions
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Our streaming endpoint returns 200 and then dies mid-stream, and nothing catches it
The API steps assert on a completed response, which is fine until the response is a stream. Ours opens with a 200, sends a few events and then fails halfway — and is perfectly…
asked by Kostya PetrovA cleanup DELETE returned 404 and the scenario still passed — is that intended?
We register cleanups the way the guide shows: The records are not being deleted. Looking at the run detail, the cleanup ran and the request 404'd, and the scenario is green. Two…
asked by Zeynep Arslansdods har list leaves glob and recorded blank even though the sidecar exists
Cosmetic, but it made me think the recording was broken. The sidecar is right there next to the recording and it has the timestamp in it: The replay works. Why does the listing…
asked by Zeynep Arslan295 API scenarios fail with QUOTA_EXCEEDED: Exceeded quota for verifying passwords
Ran the API and hybrid layers, single worker, one browser. 1,152 tests. 295 of the failures are this one message: The credentials are fine. If I run any one of those scenarios on…
asked by Ade Oyinlolatoken strategy authenticates my API calls but the browser is signed out
auth.strategy: token with a working token. All the @api scenarios are green. Every @ui scenario starts at the login page. I assumed the token would be placed into the browser…
asked by Devon MarshI use no authentication still sends the bearer token — my 401 assertion gets a 200
Deny-direction scenario, as plain as it gets: The endpoint does deny anonymous callers — I checked with curl. Our envs/staging.yaml has: and if I remove that block the scenario…
asked by Gio CastellanoLint passes but the run fails on a missing step — why is undefined-step checking opt-in?
Clean lint, then the run dies immediately on a step nobody wrote. Turning the flag on finds it: If it can find it, why is it not on by default? Feels like the most valuable check…
asked by Ingrid SolbergWhy one fixture set for ui, api and hybrid, and which of the fixtures are worker-scoped?
Reading steps/fixtures.ts in the project I inherited and trying to work out what I am extending. Two things I cannot find a straight answer to. Why is there one test rather than…
asked by Ingrid SolbergEvery generated API scenario hits the UI origin — ui and api baseUrl came out identical
Fresh project from analyze. The starter @api features all fail with HTML where JSON should be, and the reason is in the env file: Our API is at /api on the same origin. I…
asked by Yusuf DemirThe generated env yaml points api at our copilot host instead of our API
envs/staging.yaml came out with: That is a different service entirely. The correct value is in the same .env.example file that analyze read: So it is not that it could not find…
asked by Nikhil SaneMigrating a Cucumber suite: what replaces the World object we keep scenario state in?
Our Cucumber suite keeps everything on the World: the id of the record the last step created, the current user, a couple of counters, and a response object that three later steps…
asked by Rasha HalabiWhy does the HAR strict failure have no code, hint or docs link like every other error?
Small thing, but it broke a script. Every failure I have seen so far comes out shaped like this, and our CI wrapper parses the code out of it: A strict HAR miss comes out shaped…
asked by Koen VermeulenGET replays fine, the POST in the same scenario misses on every run
Recorded, committed, replays fine for a day, then the POST starts failing and never recovers. The GET against the same endpoint keeps working. The entry is in the file. I opened…
asked by Tanvi BhattChaining a created id into a UI assertion: JSON path $.id is undefined in the last response
Trying to seed through the API and assert in the browser, which is the whole reason we picked this thing. The endpoint definitely returns an id, I checked with curl.
asked by Bea LindqvistThe API added a field — how do I re-record so the old entries stop coming back?
Backend renamed a field. I re-recorded: The scenario passes now, but the file grew instead of being replaced, and the old response with the old field name is still sitting in…
asked by Nikhil SaneEvery checkout scenario spends 40 seconds registering a user through the sign-up form first
Thirteen checkout scenarios, and each one starts by filling in the six-field registration form, confirming an email, and setting a password. That is about forty seconds before…
asked by Fiona McAllisterWhy did my API scenario write posts.api.har and not posts.har?
Same tag, same command shape as the UI one, different filename. After recording: There is no posts.har. I assumed the extension was a typo somewhere until I went looking for the…
asked by Bea LindqvistGreen on my machine, red on the runner — it was replaying a HAR the whole time
Spent most of a day on this so I am writing it down. A colleague recorded @har:posts a fortnight ago. Since then my local runs have been passing against a payload that no longer…
asked by Yusuf DemirEvery API scenario fails at once with a connection error — where do I start?
All 34 API scenarios, same run, same message, no exceptions: Yesterday they passed. I have not touched the features. Do I start bisecting the suite or is this something else?
asked by Chandra PillaiWhat is the accepted way to delete the records a scenario created?
Our regression suite has left about nine hundred posts behind in the sandbox and the list endpoint is getting slow. Right now the deletes are in an after-hook in our own step…
asked by Thom Vasseur@env:qa rejected with "is not in envs.available (local, staging)" — we do have a qa env
We added projects/shop/envs/qa.yaml last week and it works — sdods run -p shop -e qa -l api runs against it. But the moment I pin a scenario to it: The file exists. What else is…
asked by Ade Oyinlolasdods run -l api finished in under two seconds — did it actually run anything?
I pointed the CLI at staging and asked for the API layer only: It printed nine passing scenarios and was finished before I had read the command back. No browser window, no window…
asked by Dinuka PereraUnresolved variable ${API_TOKEN} at "env.api.auth.token" — where is it supposed to look?
Added bearer auth to the staging environment file: Then: It dies before a single request goes out: The value is in a file next to the project yaml called env.staging. What am I…
asked by Dinuka Perera