I have to echo Ken's response about regression testing--it
IS difficult to cover everything in even a simple application.
Let me give a short explanation of software testing to those that are scratching their heads right now.
There are two types of testing performed during development of any software package: unit testing and regression testing.
In unit testing you test the component you are developing for operational errors but it is not tested for compatibility with the entire software package. The component (or unit) can work perfectly in a stand alone fashion but still fail when integrated into the application.
Regression testing takes the entire application with the new (or modified) unit and runs an exhaustive set of tests on the entire application to make sure the new code doesn't break any old code.
It is extremely difficult to identify every possible combination of events that the application can perform and test those events. This is why it is imperative that everyone report not only bugs/errors, but the exact steps taken to produce the error. It is also very helpful to the programmers to have a copy of the cabinet that generated the error.
With this information the regression testing software can then be configured to always test that combination of events when a full test is performed on new or modified program code in the application.
Building up this configuration is much like building your library of seed cabinets--if you happen to have maybe 25,000 cabinets in the library. If you make a global change that affects every cabinet in the library you need to verify that each cabinet is still what you expected it to be. This is your regression test.
If you make a change to only one cabinet and verify only that cabinet, that is unit testing. What if the change you make to one cabinet were to affect the entire library and you did not test all cabinets in the library? You would probably make a lot of firewood in the process.
My earlier response made the blind assumption that Thermwood's development staff is also the testing staff. In a situation like this your development staff can easily get overwhelmed with fixes and testing, then you add new development to the mix and...
To be honest I didn't even give any thought to Thermwood's use of a software test suite even though I use one myself in the small amount of development I still do. My last job in the computer industry was in an IT department of about 600 and I simply failed to recognize that Thermwood uses the same tools we did. Sorry Ken, I didn't mean any disrespect to your IT department there.
I will say that for the size company, Thermwood turns out amazing software. Testing that software without a software test suite would be impossible and getting all of the parameters needed for accurate regression testing is a time consuming task.
We, the users, have to provide as much information as we can to improve the test configuration so that Thermwood can give us software that is worry-free.