Advanced Topics (Course II)

1. Advanced Data Preprocessing. This unit will cover advanced data reduction methods.
   1. Advanced data reduction methods: (1) dimensionality reduction (feature or attribute subset reduction), (2) numerosity reduction (regression, histogram, clustering, sampling, singular value decomposition (SVD), and discretization), and (3) data compression (lossless versus lossy compression, Fourier and wavelet transformation, and principal component analysis).

2. Data Warehousing, OLAP, and Data Generalization: This unit covers advanced material in data warehousing, OLAP, and data generalization
   1. The multidimensional data model

   2. Implementations of data warehouses: data integration, indexing OLAP data (bitmap index), efficient processing of OLAP queries, metadata repository, data warehouse back-end tools and utilities.

   3. Efficient computation of data cubes: categorization of measures: distributive, algebraic, and holistic measures, cube computation methods, iceberg cubes, top-down and bottom-up computation, computing closed and approximate data cubes.

   4. Other data generalization approaches: Attribute-oriented induction, mining class comparisons: discriminating between different classes.

   5. Exploration of data warehouse and data mining: Discovery-driven exploration of data cubes, complex aggregation at multiple granularity, cube gradient analysis, from on-line analytical processing to on-line analytical mining.

3. Advanced association, correlation, and frequent pattern analysis.
   1. Advanced frequent pattern mining methods: (1) vertical format mining, (2) pattern-growth algorithm, (3) mining closed patterns and max-patterns

   2. Constraint-based association mining: (1) rule- and query-guided association mining, (2) anti-monotonicity, monotonicity, succinctness in constrained mining, (3) convertible constraints.

   3. Extensions and applications of frequent pattern mining: (1) iceberg cube computation, (2) fascicles and semantic data compression, (3) frequent pattern-based classification and cluster analysis

4. Advanced Classification.
   1. Bayesian belief networks: methods for (advanced) choosing BBN structure and training Bayesian belief networks

   2. Advanced decision tree construction: (1) enhancements to basic classification tree induction, (2) scalable algorithms for classification tree induction, (3) integrating data warehousing techniques and classification tree induction, (4) classification with partially labeled data

   3. Neural network approach for classification: (1) a multi-layer feed-forward neural network, (2) defining a network topology, (3) back-propagation, (4) interpretability of classification results.

   4. Kernel methods: (1) kernel logistic regression, (2) kernel discriminant analysis, (3) advanced SVM kernel methods.

   5. Introduction to learning theory: PAC-learnability, empirical, true and structural risk, VC-theory.

   6. Ensemble construction: Weighted voting, bagging, weak learner, boosting, AdaBoost

   7. Other classification methods: (1) case-based reasoning, (2) genetic algorithms, (3) rough set approach, (4) fuzzy set approach

5. Advanced cluster analysis.
   1. Grid-based clustering: A statistical information grid approach, clustering by wavelet analysis, clustering high-dimensional space.

   2. Clustering high-dimensional data: Subspace clustering, frequent pattern-based clustering, clustering by wavelet analysis.

   3. Advanced outlier analysis: Statistical-based outlier detection, distance-based outlier detection, deviation-based outlier detection, analysis of local outliers.

   4. Collaborative filtering:

6. Advanced Time-Series and Sequential Data Mining. This unit covers the advanced techniques for mining sequential data, including the following topics.
   1. Similarity search in time-series analysis:

   2. Hidden Markov models

   3. Periodicity analysis: Transformation-based approach, mining partial periodicity.

   4. Sequence segmentation: Hidden Markov model and Variable Markov model for sequence segmentation.

   5. Sequence classification and clustering: (1) $q$-gram based methods, keyword-based methods; (2) (high order) Markov chain, hidden Markov model; (3) suffix tree, probabilistic suffix tree, and probabilistic automata.

7. Mining Data Streams: This unit covers the techniques for mining stream data, including the following topics.
   1. What is stream data?

   2. Basic tools: Chernoff bounds, reservoir sampling

   3. Stream sample counting and frequent pattern analysis

   4. Classification of data streams

   5. Clustering data streams

   6. Online sensor data analysis

8. Mining Spatial, Spatiotemporal, and Multimedia data. This unit covers the techniques for mining spatial, spatiotemporal, and multimedia data, including the following topics.
   1. Mining spatial and spatiotemporal databases: (1) Spatial data cube construction and spatial OLAP, (2) spatial association and co-location analysis, (3) spatial clustering methods, (4) spatial classification and spatial trend analysis, (5) spatiotemporal data miming, (6) mining moving objects and trajectories.

   2. Mining multimedia databases: (1) multidimensional analysis of multimedia data, (2) similarity search in multimedia data, (3) classification and regression analysis of multimedia data, (4) mining association and correlation in multimedia data, (5) clustering multimedia data

   3. Mining object databases: (1) multidimensional analysis of complex objects, (2) generalization on complex structured and semi-structured data, (3) methodology for mining complex object databases: aggregation, approximation, and progressive refinement.

9. Mining Biological Data: This unit covers the techniques for mining biological data, including the following topics.
   1. Mining DNA, RNA, and proteins: (1) Mining motif patterns, (2) searching homology in large databases, (3) phylogenetic and functional prediction.

   2. Mining gene expression data: (1) clustering gene expression, e.g., for gene regulatory networks, (2) classifying gene expression, e.g., for disease-sensitive gene discovery.

   3. Mining mass spectrometry data

   4. Mining and integrating knowledge from biomedical literature

   5. Mining inter-domain associations

10. Text mining. This module will cover work that applies known mining techniques to the text media, emphasizing the new issues which arise.
    1. Text representation: Set-of-words, bag-of-words, vector-space model; the issue of large raw dimensionality

    2. Dimensionality reduction: PCA, SVD, latent semantic indexing

    3. Text clustering: agglomerative, $k$-means, EM; effect of a large number of noise dimensions, partial supervision

    4. Feature selection in high dimensions

    5. Naive Bayes classification: Poor density estimates, small-degree Bayesian belief network induction

    6. Discriminative learning: maximum entropy, logistic regression, and support vector learning

    7. Shallow linguistics: Phrase detection, part-of-speech tagging, named entity extraction, word sense disambiguation

11. Hypertext and Web mining. This module will cover work that is specific to analyzing hypermedia, i.e., involving hierarchical tagging languages and hyperlinks in conjunction with text.
    1. Web modeling: The Web as an evolving, collaborative, populist social network: aggregate graph-structure of the Web, preferential attachment linking models and experimental validation

    2. Link mining and social network analysis: Links as endorsement: PageRank and HITS algorithms to identify authoritative Web pages; connections with bibliometry

    3. The PageRank algorithm: Integrating page content and page layout with link structure; topic-sensitive PageRanks; Google

    4. Mining by exploiting text and links: Exploiting text and links for better clustering and classification; unified probabilistic models for text and links

    5. Structured data extraction: Information extraction, exploiting markup structure to extract structured data from pages meant for human consumption

    6. Multidimensional Web databases: Automatic construction of multilayered Web information base; discovering entities and relations on the Web (WebKB)

    7. Exploration and resource discovery on the Web: reinforcement learning, other approaches

    8. Web usage mining and adaptive Web sites: Reorganizing Web sites by mining log data

12. Data Mining Languages, Standards, and System Architectures. This unit covers the issues related to data mining languages, standards, and system architectures, including the following topics.
    1. Data mining primitives: what defines a data mining task? task-relevant data, the kind of knowledge to be mined, background knowledge: concept hierarchies, user-specified constraints, interestingness measures, presentation of discovered patterns

    2. Data mining languages, user interfaces, and standardization efforts

    3. Architectures of data mining systems

13. Data Mining Applications. This unit covers the issues related to domain-specific data mining applications, including the following topics. (Note: Some of these themes, if concrete and good materials are available, should go into the Foundations part as case studies.)
    1. Data mining for financial data analysis

    2. Data mining for the retail industry

    3. Data mining for the telecommunication industry

    4. Data mining for intrusion detection

    5. Data mining in scientific and statistical applications

    6. Data mining in software engineering and computer system analysis

14. Data Mining and Society. This unit covers the issues related to social impacts of data mining, including the following topics.
    1. Social impacts of data mining

    2. Data mining vs. data security and privacy

    3. Privacy-preserving data mining

15. Trends in Data Mining. This unit covers the major trends in data mining, including the following topics.
    1. Setting solid theoretical foundations for data mining

    2. Mining deep in specific applications

    3. Ubiquitous and invisible data mining

    4. Integrated data and information systems