Stay updated with breaking news from Metamorphic Testing. Get real-time updates on events, politics, business, and more. Visit us for reliable news and exclusive interviews.
Mutation testing and property-based testing are two relatively niche technologies in the Java tester's toolkit. Broad adoption is not recommended: they can make well-tested code even more robust but are a waste of time in projects with poor test maturity.
In this paper, we consider the testing of software whose input involves a data stream, such as in video analysis applications. To address the oracle problem in testing this kind of software, existing metamorphic testing (MT) and metamorphic exploration (ME) techniques typically generate both source and follow-up input streams. In contrast, we propose a different strategy: an inplace method. Instead of examining relations among multiple input streams, our method works on a finer granularity by investigating relations among the data frames within a single input stream - such as the relations amo...
Named entity recognition (NER) is a widely used natural language processing technique; it plays a key role in information extraction from sentences. To be able to test the correctness of NER systems is important, but it is expensive because an automated test oracle is normally unavailable. To address the oracle problem, this study proposes to apply metamorphic testing (MT). The authors conduct a case study with Litigant, an industrial NER system of the Ant Group, and show that MT can effectively detect real-life bugs in the absence of an ideal oracle. The authors further investigate the causes...
Metamorphic testing (MT) is recognized as an important quality assurance paradigm for complex systems. MT’s growing popularity is due not only to its effectiveness in alleviating the test oracle and test case generation problems but also to its unique perspective on software testing. The identification of effective metamorphic relations is vital to metamorphic testing. In addition, a testing platform that allows researchers and testers to automate the process of implementing metamorphic relations can broaden the audience for practical application of metamorphic testing. By adopting the conce...
Advanced Driver-Assistance Systems (ADASs) have become increasingly popular. To ensure safety, simulation testing is essential. In this research, we conducted a case study to investigate the fault-detection effectiveness of existing ADAS testing standards: We tested the Lane Keeping Assist System (LKAS), which is a prebuilt ADAS module of MATLAB and Simulink. We first tested LKAS using the European New Car Assessment Programme (Euro NCAP), which contains 40 prebuilt driving scenarios in MATLAB. Our results show that none of the 40 scenarios detected any failure. We then continued the tests by ...