Nadia Belkacem
Visual baselines, and why yours differ between a laptop and a runner.
Illustrative user
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Asked (3)
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
How do you test a node-graph editor — blocks, edges and connection handles?
Half our product is a workflow builder: a canvas with about 190 block types, edges between them, and connection handles on each node. None of it is text or roles — the nodes…
asked by Nadia BelkacemAdded one mask selector in the env file and the other three disappeared
Project file masks three elements for screenshots. Staging has a clock widget that also needs masking, so I added it to envs/staging.yaml: Now the three from the project file are…
asked by Nadia BelkacemA header widget appears on six pages — one page object per page, or something else?
Our header carries the cart badge, the account menu and a search box, and it is on six pages. Right now the cart badge locator is copy-pasted into six page objects, which was…
asked by Nadia Belkacem
Answered (9)
Example threads. These questions and answers were written by the SDODS team to document real problems and how to fix them. The people named are illustrative, not real users. Questions asked on this site are marked new.
Where do I actually look at expected vs actual after a @visual failure on CI?
The nightly went red on a baseline scenario. I can see the scenario failed and I can read the pixel count in the log, which tells me nothing about whether somebody changed a…
asked by Ingrid SolbergRuns are 900MB of PNGs — can I keep the baseline check and stop capturing every step?
Nightly regression writes a before and an after image for every UI step, which is wonderful when something fails and enormous every other night. The artefact bucket is the…
asked by Sergio AlcarazDo you commit baseline PNGs into the repo, or is this what git-lfs is for?
We are about to turn @visual on for real — currently one scenario, about to be fifteen, on two browsers, and eventually two platforms once CI has its own baselines. Before I…
asked by Fiona McAllisterIs my baseline being recorded at 2x because the laptop screen is retina?
Trying to work out in advance why a macOS baseline will not match a Linux one, before I spend a day on it. My assumption was device pixel ratio: the Mac renders at 2x, the runner…
asked by Nikhil SaneDiff flaps between clean and 2% on a page with a fade-in, but animations are disabled
About one run in four: The rest of the time it is clean. The only thing on that page that moves is a card that fades in when the summary request comes back. My understanding was…
asked by Yusuf DemirHow do I keep a "last updated" timestamp out of a visual baseline?
The dashboard we are baselining has a "last updated HH:MM:SS" line in the header. Every single run differs by that strip of pixels, so the baseline is red forever and the diff is…
asked by Ade OyinlolaGuide says baselines live under __screenshots__/<browser>/ — mine are in demo-shop--ui--chromium/darwin/
Screenshots and visual testing says: What is actually on disk after a run: Two extra segments and neither of them is just the browser. I want to write a cleanup script that…
asked by Gio CastellanoAll 4 user(s) with role "standard" are leased — passes locally, four failures in CI
Suite is green on my machine and fails in CI, and the difference is the worker count. Local: CI runs the same thing with -w 8. Four scenarios pass, four sit there for what looks…
asked by Owen Brackley@visual is green locally and reported flaky on CI — attempt 1 fails, attempt 2 passes
Same commit, same command, two machines. On my laptop: Green, every time. On the CI job (Ubuntu runner, project has retries: { ci: 2 }) the scenario is reported flaky. Attempt 1:…
asked by Sam Orbison