How to measure the quality of unit tests? Code coverage is not necessarily a good indicator to answer this question. What other options do we have? Do we need tests to test the quality of our tests? In some way, yes we do. In this session, I will introduce you to the concept of mutation-based testing and how this technique can be used to improve the quality of your test suite.


Comments are closed.

Luke Chambers at 19:54 on 8 Jul 2020

A great introduction to mutation-based testing with easy to understand examples and explanations. The infection log examples were especially helpful in understanding how mutations can be turned into further tests to cover missing scenarios.

Really enjoyed the talk and I will certainly be looking to introduce mutation-based testing into my projects.

Ben Lumley at 19:55 on 8 Jul 2020

Really good - not something I'd come across before. Clearly explained what mutation testing is and the benefits and then worked through in more detail.

A bit less on managing the performance and more examples would improve things in my opinion.

I really like the talk. I'm still quite new to mutation tests so it contained something that I already knew, but of course, also learned something new.

Especially the part about the ignore part was new to me, I would try to avoid it, but can be quite helpful.

Thanks for your talk.

Mike Lehan at 20:03 on 8 Jul 2020

A good talk explaining the concept and usage of mutation testing in PHP. It would definitely have been interesting to delve more into how this is used in a larger application, or areas like integration tests that can tests interfaces with things like databases, as that's often where I find test coverage ends up accidentally incomplete.

Dan Ackroyd at 20:16 on 8 Jul 2020

I think you could focus on putting a bit more 'energy' into your talk.

Maybe consider standing up to give your talks. That would alter your speech patterns and make it easier to put more emphasis into what you're saying, rather than it being all a bit too relaxed which makes it slightly hard to follow.