association-scalar-clusters-tutorial-1

‡‡‡Association and Scalar Clusters Tutorial – Part 1: Back Mapping Term Clusters to Documents Dr. E. Garcia admin@miislita.com First Published: January 18, 2008. Last Modified: March 9, 2008. Copyright ? Dr. E. Garcia, 2008. All Rights Reserved. http://www.miislita.com Abstract In this tutorial you will learn how to extract association and scalar clusters from a term-document matrix. A “reaction” equation approach is used to break down the classification problem to a sequence of steps. From the initial matrix, two similarity matrices are constructed, and from these association and scalar clusters are identified. A back mapping technique is then used to classify documents based on their degree of pertinence to the clusters. Matched documents are treated as distributions over topics. Applications to topic discovery, term disambiguation, and document classification are discussed. Keywords: association, scalar, clusters, back mapping, topic discovery, similarity matrix, document classification Background This tutorial is based on the Association and Scalar Clusters lecture given to graduate students enrolled in Web Mining, Search Engines, and Business Intelligence (http://irthoughts.wordpress.com/category/web-mining-course/), Polytechnic University of Puerto Rico (http://www.pupr.edu). Some portions are taken from a test given to the students and from the January issue of IR Watch – The Newsletter (1, 2008). Linear algebra ...