How we test our Search Spell Correction

How we test our Search Spell Correction

Magento Tools & Frameworks

We are constantly improving our Magento Advanced Search Extensions and every week an updated version for at least one extension is released with improved functionality.

Search Spell-Correction Magento Extension is updated fortnightly, new algorithms are added and current ones are improved. Each change in the search algorithm of the correct words has a definite goal: improving productivity, improving relevance, and search for new forms of corrections.

But after every change there is a risk that the words / phrases that previously were corrected properly, in the new version will not work.

To keep tracking the quality of new versions corrections, we use a simple but effective way to compare the results – test phrases.

We form a spreadsheet:

Target phrase Error phrase
samsung simsung
samsung samsing
samsung asmsung
samsung samsng
samsung samung
samsung sansung
samsung samsg
camera case digital cameracasedigital
camera case digital camera casedigital
camera case digital cameracase digital
camera case digital camra case digial
camera case digital camera caedigital
camera case digital camer cise digutal
apple applee
apple aplle

In general, the table consists of about 500 different combination which are entered incorrectly. Then our programmers simply run php script that displays a summary comparative spreadsheet:

Target phrase Error phrase Found phrase Similarity of the source phrase to the target phrase (%) Similarity of the found phrase  to the target phrase (%) Time (ms) Result
samsung simsung samsung 86 < 100 12.1
samsung samsing samsung 86 < 100 10.3
samsung asmsung samsung 86 < 100 10
samsung samsng samsung 85 < 100 3.6
samsung samung samsung 85 < 100 3.6
samsung sansung samsung 86 < 100 10.1
samsung samsg samsung 67 < 100 3.4
canon canun canon 80 < 100 3.4
canon canin canon 80 < 100 3.4
canon cnon canon 78 < 100 3.3
canon canmon canon 82 < 100 3.6
canon cenun census 60 > 27 3.4 !!!
camera Canon cameta Canon camera canon 92 < 100 6.9
camera Canon camera Canun camera canon 92 < 100 6.9
camera Canon camera Cinon camera canon 92 < 100 7
camera Canon camira Cinon camera canon 83 < 100 7
camera Canon camera Cann camera canon 91 < 100 6.8
camera Canon cameraCanon camera canon 91 < 100 43.8
camera Canon cameraCano camera canon 82 < 100 29.3
camera Canon camerCano camera canon 71 < 100 22.6
diamond diamand diamond 86 < 100 22.6
diamond dimond diamond 85 < 100 3.5
diamond diamant diamond 71 < 100 9.7
samsung phone samsungphone samsung phone 92 < 100 63.2
samsung phone samsungphine samsung phone 84 < 100 63.4
samsung phone samsingphine samsung phone 76 < 100 63.6
samsung phone simsungphine samsung phone 76 < 100 63.2
samsung phone ssamsugnphone samsung phone 77 < 100 90.8
samsung phone smsungphne samsung phone 74 < 100 29.9
camera case digital cameracasedigital camera case digital 89 < 100 350.4
camera case digital camera casedigital camera case digital 95 < 100 46.4
camera case digital cameracase digital camera case digital 95 < 100 40.1
camera case digital camra case digial camera case digital 89 < 100 10.2
camera case digital camera caedigital camera card digital 89 = 89 33.4 !!!
camera case digital camer cise digutal camera case digital 84 < 100 16.7
case digital casedigital case digital 91 < 100 42.6
case digital casedigutal case digital 83 < 100 42.5
case digital cise digutal case digital 83 < 100 12.8
diamond phone diamondphone diamond phone 92 < 100 63.1
diamond phone diamantphone diamond phone 76 < 100 63.8
htc diamond phone htc diamondphone htc diamond phone 94 < 100 63.5
htc diamond phone htcdiamondphone diamond phone 87 > 73 109.4 !!!
sony siny sony 75 < 100 3.3
sony sona sony 75 < 100 3.1
apple applee apple 82 < 100 3.6
apple aplle apple 80 < 100 3.4

According to the spreadsheet there are 3 errors, and you can see that in these three cases 4th column is bigger than 5th column. In this way we are constantly checking and improving Search Spell-Correction Magento Advanced Search extension.

You can always try out the latest version of Search Spell-Correction at http://demo.mirasvit.com/spell_correction/ if you have any suggestions of test phrases, let us know in comments.

Enjoyed the Read?

Don’t miss our next article!