Questions tagged lint
What `sdods lint` rejects and why, including the tag rules.
30 questions
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Linting only the staged feature files in a pre-commit hook — is --json stable enough?
Trying to keep the hook under a second on a repo with about four hundred feature files, so linting the whole project every commit is out. This is what I have: Two things I cannot…
asked by Ingrid Solberg--strict on sdods run did not turn warnings into failures like it does on sdods lint
We wanted the nightly to fail on lint warnings, so somebody moved the flag onto the run: It ran, it passed, and the eleven warnings we were trying to catch are still there. On…
asked by Paulo MendesLint passes but the run fails on a missing step — why is undefined-step checking opt-in?
Clean lint, then the run dies immediately on a step nobody wrote. Turning the flag on finds it: If it can find it, why is it not on by default? Feels like the most valuable check…
asked by Ingrid Solberg@har:checkout warns that no recorded file exists — is there a way to declare it up front?
Writing the scenario before recording the traffic, which I thought was the intended order: It is only a warning and I understand why — the file genuinely is not there yet. But we…
asked by Devon MarshCan one scenario belong to two modules? It touches cart and checkout
Our modules each declare a tag, and lint reminds me when a scenario is missing its module's tag: Fine. But the scenario adds an item to the cart and then completes checkout, and…
asked by Rasha HalabiTwo Examples blocks, one @smoke and one @regression — lint says found @smoke @regression
I wanted one outline with a small set of rows in smoke and the long tail in regression: Both tables are tagged once. Is this rule just not aware of Examples-level tags?
sdods run refuses to start with LINT_FAILED — can I run anyway while I fix the tags?
Mid-refactor, half my tags are wrong, and I want to run the six scenarios that are fine to check a page object change. Instead: Nothing ran. The broken scenarios are not even in…
asked by Tanvi Bhatt@skip:safari rejected — how do I skip a scenario on Safari?
The scenario genuinely cannot pass on Safari. The error lists five names and none of them is safari. What am I meant to write?
asked by Sergio AlcarazHow do I check whether a step already exists before I write another one?
Third proposal in a row bounced with "this step already exists in a different phrasing". Fair enough, but I am clearly missing whatever everyone else is looking at, because I did…
asked by Sergio Alcaraz@data:users errors with "is not a declared dataset (logins, posts)" after a rename
We renamed the dataset from users to logins in the yaml and updated the steps. Lint now fails on the tags we forgot: Easy enough to fix, but it raises a question — the scenario…
asked by Tobi Schrader--fix-tags added @ui everywhere but left every suite-tag error untouched
Inherited a project with about ninety scenarios and no tags at all. Ran: It rewrote the files and the layer errors are gone, which is great. But every tags/suite error is still…
asked by Anouk de VriesWhat should I actually look at in a proposal before running sdods proposals accept?
First week of using the generator role. sdods proposals show <id> gives me a diff and a manifest and I am reading it the way I read any PR, which I suspect is the wrong instinct…
asked by Bea LindqvistDoes -t "@regression and not @mock" replace the layer filter or add to it?
I want the nightly regression minus anything that runs against mocked network, so: It ran fewer scenarios than -t @regression on the same layer, which is what I wanted, but I…
asked by Fiona McAllisterPipeline exits 3 and no test ran — the report is empty
Merged a branch this morning and the test job now ends in seconds: There is no HTML report and no failing scenario to look at, so my first instinct was that the runner is broken.…
asked by Renata KohlWhy is a completely made-up tag only a warning while @jira:demo12 fails the build?
Trying to understand the severity model, because it looks backwards to me. @foo:bar is total nonsense and it only warns. @jira:demo12 is an obvious typo of a real thing and it…
asked by Nikhil SaneDoes @data:orders load the dataset, or do I still need the Given step?
Tagged a scenario @data:orders on the assumption that it would put the columns in scope the way @user:standard puts an account in scope. The scenario runs, lint is clean, and the…
asked by Bea LindqvistLint says the accessibility step is undefined, but the step library reference lists it
Copied the scenario straight out of Accessibility and performance budgets: The phrasing is identical to the table in the step library reference, down to the quotes. What am I…
asked by Chandra Pillai@jira:demo12 must look like PROJ-123 — what patterns do the issue tags accept?
Two errors from the same commit: I get that the second one wants a number. What is wrong with demo12? Our board key really is lowercase in the URL.
asked by Helle BorgWhere exactly does the "# title-format:" comment go? Lint still warns after I added one
Trying to clear this: I added the comment and the warning did not move. My file: Does it have to be in a particular place?
asked by Chandra PillaiDuplicate scenario title error but the two titles are not identical
Line 12 is Scenario: Add an item to the cart and line 41 is Scenario: add an item to the cart . Different capital letter, and the second one has a trailing space. I would not…
asked by Yusuf Demir@env:qa rejected with "is not in envs.available (local, staging)" — we do have a qa env
We added projects/shop/envs/qa.yaml last week and it works — sdods run -p shop -e qa -l api runs against it. But the moment I pin a scenario to it: The file exists. What else is…
asked by Ade OyinlolaHow do you actually decide between @smoke, @regression and @sanity?
Lint makes me pick exactly one, which is fine, but the three names do not tell me much and everyone on the team has a different theory. Right now roughly everything is…
asked by Sunita Kale"@user:admin is not a declared role (standard, locked_out)" — where is that list?
Added an admin-only scenario: We do have an admin account in the users CSV, with role set to admin. So why does lint not see it?
asked by Sam OrbisonWarning: "Feature is not under a declared module directory" — but the file runs fine
I put a new file at features/smoke-checks.feature, straight under features/. It runs, it passes, but every lint gives me: It is only a warning so nothing is blocked, but it is…
asked by Gio CastellanoCan a scenario be tagged @ui and @api at once? Lint says "found @hybrid @ui @api"
The scenario seeds a record over the API and then checks it renders in the browser, so it genuinely is both. I tagged it as both and got: Three? I only wrote two. The @hybrid is…
asked by Vikram RajagopalOur CI step passes even when lint fails — checking for exit code 1 was wrong?
Someone wrote our pipeline step defensively: A branch went in last week with two scenarios missing their suite tag and the step was green. Running it by hand I can see the…
asked by Rafa GarridoLint says "found @smoke @regression" — why can a scenario not be in both suites?
I tagged our happy-path checkout scenario with both suite tags because I want it in the pull-request smoke run and in the nightly regression run. Lint disagrees: Surely wanting a…
asked by Annika Solheimlint says Undefined step: Given I am on the checkout page, but the method is right there
The class has it: Spelling matches character for character, I diffed it. The file is pages/CheckoutPage.ts. What else is there to check?
asked by Hsu Wei-linSecret literal at "env.vars.password" — I want the password in the env file, why is that refused?
Put the login password straight into projects/demo-shop/envs/staging.yaml so the data-driven login scenarios can pick it up: Every command now refuses to start: This is a…
asked by Hsu Wei-linsdods lint: "Scenario must carry exactly one layer tag" on every scenario I have
Ported a feature file over from our old cucumber project and lint rejects all of it. The Gherkin is valid — it parses, the steps exist. What is a "layer tag", and does it belong…
asked by Marijn Kuiper