Rasha Halabi
Release engineering. Gates are her problem.
Member · 572 reputation · here since 11 Aug 2025
Asked (14)
Installed with brew and there is no SDODS in my Applications folder
I wanted the desktop app and installed with brew because that is how I install everything: It succeeded, and sdods --version works, but there is nothing in Applications and no…
asked by Rasha Halabi572 ·probeTimeoutMs of 1500 is too short on our staging box — every candidate scores 0
Locally everything heals. On staging the same locators fail with HEAL_FAILED and every candidate in the hint reads 0.00, including ones I know match, because I can open the page…
asked by Rasha Halabi572 ·One viewer account, twelve read-only scenarios, and the suite behaves as if -w 1
A partner gives us exactly one viewer account and will not create more — it is their system, their policy, and no amount of asking has moved it. Twelve scenarios carry…
asked by Rasha Halabi572 ·Insights say no runs, but we have a week of nightly runs on disk
Fine, so I ran compute: We have run this suite every night for a week and every run is sitting in .sdods/runs with its summary and its ndjson. Why does counting them need a…
asked by Rasha Halabi572 ·users.poolSize is 4 and now a row that exists in the CSV is not in the pool
envs/staging.yaml has: data/staging/users.csv has five rows. Row five is visual_user, role standard. The name is in the file, spelled the same, and the role exists. Raising…
asked by Rasha Halabi572 ·Running the smoke suite on a plane — what do I need so nothing touches the network?
Long flight, and separately we are being asked to prove the suite runs on an air-gapped runner. Same problem twice, so I would like to get it right once. Everything is tagged…
asked by Rasha Halabi572 ·Install has been sitting on the dependency step for twenty minutes — stuck or slow?
On the VPN, laptop otherwise idle. The installer printed the dependency install step and has produced nothing since. No error, no progress, cursor still blinking. I re-ran it…
asked by Rasha Halabi572 ·Migrating a Cucumber suite: what replaces the World object we keep scenario state in?
Our Cucumber suite keeps everything on the World: the id of the record the last step created, the current user, a couple of counters, and a response object that three later steps…
asked by Rasha Halabi572 ·What does --write-history actually change about future heals?
The docs say it biases future heals towards strategies that worked. Before I put it in the nightly I would like to know how much bias, and whether running it is reversible.
asked by Rasha Halabi572 ·How do I give the team coding agents read-only access to our SDODS server?
We host one SDODS server for the QA group. Everyone wants to point their editor at /mcp so they can ask about runs and coverage without a checkout. What I do not want is…
asked by Rasha Halabi572 ·Cart got redesigned — re-record the flow from scratch, or patch the old spec?
The cart page was redesigned. Same flow, different markup. We have checkout.spec.ts from March and a feature that came out of it back then. Do I re-record from scratch or patch…
asked by Rasha Halabi572 ·Does ${VAR} in a CSV dataset resolve from .env.staging, or only from the shell?
Our data/common/users.csv has a password column holding ${TEST_MEMBER_PASSWORD} so the value is not in the repo. It works on my machine, where the variable is exported. On a…
asked by Rasha Halabi572 ·Can one scenario belong to two modules? It touches cart and checkout
Our modules each declare a tag, and lint reminds me when a scenario is missing its module's tag: Fine. But the scenario adds an item to the cart and then completes checkout, and…
asked by Rasha Halabi572 ·Two documentation pages say opposite things about @a11y. Which one should I believe?
Not a bug report, a request for a ruling, because I have to tell a client which it is. The guide describes a hook that runs an accessibility pass after each UI step, violations…
asked by Rasha Halabi572 ·
Answered (11)
Scenarios for a feature flag that is on in staging and off in production
Our new checkout is behind a build-time flag. On staging it is on, on the production build it is off, and the flag is baked into the bundle at build time so there is nothing to…
asked by Zeynep Arslan64 ·No step for downloads — how do I assert that an export produced a real CSV?
We have about a dozen export buttons. The most I can assert from a feature file today is that a toast appeared, which passed happily for two weeks while the export was returning…
asked by Karine Moreau655 ·295 API scenarios fail with QUOTA_EXCEEDED: Exceeded quota for verifying passwords
Ran the API and hybrid layers, single worker, one browser. 1,152 tests. 295 of the failures are this one message: The credentials are fine. If I run any one of those scenarios on…
asked by Ade Oyinlola419 ·token strategy authenticates my API calls but the browser is signed out
auth.strategy: token with a working token. All the @api scenarios are green. Every @ui scenario starts at the login page. I assumed the token would be placed into the browser…
asked by Devon Marsh183 ·analyze gave me modules called deploy, execute and status instead of workflows
Thirty modules on the proposal and twelve of them are verbs: status, delete, export, send, run, update, upload, download, stats, validate, versions, introspect. They are all…
asked by Tanvi Bhatt126 ·Quarantined scenarios still run in our release gate and still fail it
We quarantine flaky scenarios in the web UI while somebody fixes them. The dashboard shows them as quarantined, so I assumed that was the end of it. The release gate disagrees.…
asked by Ingrid Solberg241 ·analyze put a URL out of my gitignored .env.local straight into the generated env yaml
Ran analyze on an app I had just been given, applied the proposal, opened the result and found this in projects/portal/envs/local.yaml: That value is not in any tracked file. It…
asked by Helle Borg352 ·A renamed tag left our smoke job passing with zero tests for three weeks
Three weeks. The only trace, in a log nobody opens: I understand from an older thread here that an empty selection exits 0 on purpose so a matrix leg with nothing to do stays…
asked by Tanvi Bhatt126 ·Job shows exit 130 — did the suite fail or not?
Evaluating SDODS against two other tools, so forgive the basic question. A nightly ended with exit code 130 and there is no failing scenario in the report — 212 passed, 0 failed,…
asked by Devon Marsh183 ·Every scenario passed and the release gate still failed the job
Nothing failed. Zero. And the job is red, so the release is blocked and I am the one holding it. I can see the two flaky scenarios in the report and they both ended up passing.…
asked by Koen Vermeulen309 ·--project-matrix or three -b flags? What is the difference in practice?
Our nightly says -b chromium -b firefox -b webkit. I noticed --project-matrix in the flag list and it looks like it does the same thing. Is one of them preferred, and what…
asked by Sergio Alcaraz415 ·