Validate clustering results on validation data: select a clustering on the discovery data and check whether it stays stable on the validation data with respect to cluster membership, internal properties, external associations, visual patterns, and so forth. Here, the two clusterings look somewhat similar: a smaller cluster on the top left and a larger cluster on the bottom right.
Abstract
Cluster analysis refers to a wide range of data analytic techniques for class discovery and is popular in many application fields. To assess the quality of a clustering result, different cluster validation procedures have been proposed in the literature. While there is extensive work on classical validation techniques, such as internal and external validation, less attention has been given to validating and replicating a clustering result using a validation dataset. Such a dataset may be part of the original dataset, which is separated before analysis begins, or it could be an independently collected dataset. We present a systematic, structured review of the existing literature about this topic. For this purpose, we outline a formal framework that covers most existing approaches for validating clustering results on validation data. In particular, we review classical validation techniques such as internal and external validation, stability analysis, and visual validation, and show how they can be interpreted in terms of our framework. We define and formalize different types of validation of clustering results on a validation dataset, and give examples of how clustering studies from the applied literature that used a validation dataset can be seen as instances of our framework.
This article is categorized under: Technologies > Structure Discovery and Clustering Algorithmic Development > Statistics Technologies > Machine Learning