Vikram Rajagopal
Runs the nightly and reads the report every morning.
Member · 1,240 reputation · here since 2 Jul 2021
Asked (6)
Unsupported architecture: i686 — is 32-bit Linux out entirely?
We still have a small fleet of older 32-bit boxes doing one specific job, and I was hoping to run a few API scenarios on them rather than provisioning something new. The…
asked by Vikram Rajagopal1,240 ·OAuth consent opens a popup and my steps keep talking to the first tab
Clicking "Connect account" opens the provider's consent screen in a new tab. Everything after that in my scenario runs against the original tab, which is still sitting on the…
asked by Vikram Rajagopal1,240 ·I do not want healing to rescue a broken locator — I want the test to fail
Possibly an unpopular opinion, but: if a developer renames a button and my test still passes, my test did not test anything. Yesterday a whole feature shipped with the wrong…
asked by Vikram Rajagopal1,240 ·Can a scenario be tagged @ui and @api at once? Lint says "found @hybrid @ui @api"
The scenario seeds a record over the API and then checks it renders in the browser, so it genuinely is both. I tagged it as both and got: Three? I only wrote two. The @hybrid is…
asked by Vikram Rajagopal1,240 ·Three shards, three HTML reports — how do I get one report out of a matrix build?
The nightly runs on three machines: Every machine mints its own run id, so I get three artefact directories, three HTML reports and three rows in the dashboard for what is one…
asked by Vikram Rajagopal1,240 ·Project yaml, env yaml, .env, an exported variable and a flag all set the same thing — which one wins?
We have base URLs in envs/staging.yaml, an old SDODS_UI_BASE_URL exported in the build image, and someone has started passing flags on the command line. Nobody can predict what a…
asked by Vikram Rajagopal1,240 ·
Answered (7)
Getting run results onto a team dashboard without scraping the CLI
Management wants a pass-rate trend on the wall screen. Today somebody screenshots the console output on Monday morning. I would like to do this properly but I cannot tell which…
asked by Tanvi Bhatt126 ·Pipeline exits 3 and no test ran — the report is empty
Merged a branch this morning and the test job now ends in seconds: There is no HTML report and no failing scenario to look at, so my first instinct was that the runner is broken.…
asked by Renata Kohl608 ·config show --explain says envYaml for a value that came out of .env.staging
The documented layer names include dotenv, but standardPassword is only in the yaml as a ${VAR} and its actual value comes from .env.staging. Why does the row say envYaml and not…
asked by Renata Kohl608 ·How do I prove the checkout scenario is flaky instead of arguing about it?
One scenario fails maybe one run in six. Every time I raise it I am told it passed locally, and every time I run it locally it passes, so I am the person crying wolf about the…
asked by Owen Brackley144 ·How long should we keep .sdods/runs around? It is 40 GB now
Nobody set a retention policy when we turned this on and the build agent is now 40 GB of .sdods/runs, almost all of it step screenshots. I do not want to rm -rf blindly because…
asked by Owen Brackley144 ·What should a pull request run, and what should wait for the nightly?
We have about 400 scenarios and currently every pull request runs all of them on three browsers. It takes 35 minutes and people merge without waiting, which makes the whole thing…
asked by Elsa Nyman333 ·sdods report prints (missing) for the html report after a CI run
Our CI job runs the suite and archives the run, someone downloads the archive and opens it locally. Locally, straight after a run, everything is there. On the downloaded copy: So…
asked by Tobi Schrader97 ·