Questions tagged visual
Screenshot baselines and how they differ per platform.
10 questions
Where do I actually look at expected vs actual after a @visual failure on CI?
The nightly went red on a baseline scenario. I can see the scenario failed and I can read the pixel count in the log, which tells me nothing about whether somebody changed a…
asked by Ingrid Solberg241 ·Runs are 900MB of PNGs — can I keep the baseline check and stop capturing every step?
Nightly regression writes a before and an after image for every UI step, which is wonderful when something fails and enormous every other night. The artefact bucket is the…
asked by Sergio Alcaraz415 ·Do you commit baseline PNGs into the repo, or is this what git-lfs is for?
We are about to turn @visual on for real — currently one scenario, about to be fifteen, on two browsers, and eventually two platforms once CI has its own baselines. Before I…
asked by Fiona McAllister159 ·Is my baseline being recorded at 2x because the laptop screen is retina?
Trying to work out in advance why a macOS baseline will not match a Linux one, before I spend a day on it. My assumption was device pixel ratio: the Mac renders at 2x, the runner…
asked by Nikhil Sane487 ·Diff flaps between clean and 2% on a page with a fade-in, but animations are disabled
About one run in four: The rest of the time it is clean. The only thing on that page that moves is a card that fades in when the summary request comes back. My understanding was…
asked by Yusuf Demir201 ·How do I keep a "last updated" timestamp out of a visual baseline?
The dashboard we are baselining has a "last updated HH:MM:SS" line in the header. Every single run differs by that strip of pixels, so the baseline is red forever and the diff is…
asked by Ade Oyinlola419 ·Guide says baselines live under __screenshots__/<browser>/ — mine are in demo-shop--ui--chromium/darwin/
Screenshots and visual testing says: What is actually on disk after a run: Two extra segments and neither of them is just the browser. I want to write a cleanup script that…
asked by Gio Castellano521 ·@visual is green locally and reported flaky on CI — attempt 1 fails, attempt 2 passes
Same commit, same command, two machines. On my laptop: Green, every time. On the CI job (Ubuntu runner, project has retries: { ci: 2 }) the scenario is reported flaky. Attempt 1:…
asked by Sam Orbison9,420 ·Added one mask selector in the env file and the other three disappeared
Project file masks three elements for screenshots. Staging has a clock widget that also needs masking, so I added it to envs/staging.yaml: Now the three from the project file are…
asked by Nadia Belkacem8,611 ·First @visual run fails with "A snapshot doesn't exist" and then passes. Bug?
Copied the baseline example out of the guide more or less verbatim: It fails: The PNG is sitting there afterwards and the second run is green. So am I supposed to run it twice on…
asked by Elsa Nyman333 ·