Fixed query set
Save representative queries with expected results and check them again after each relevant change.
Glossary
Search Regression Test
A search Regression Test checks that a change does not inadvertently deteriorate existing strong queries, exact matches and other critical scenarios.
Critical matches
SKUs, brands, top queries and commercially important search scenarios deserve explicit regression protection.
Make it comparable
Use the same data, ratings and measurement method so that differences can be linked to the change.
Purpose
Prevent a local improvement from causing greater damage elsewhere.