Leveraging Topological Structure of Data for Applications of Deep Learning
Topological data analysis and deep learning are fields which have widely growing interest and rapid research developments, each in their own right. However, at the intersection of these fields, there is an opportunity to leverage the topological structure of data, incorporating the additional information into deep learning algorithms and methods applied to deep learning tasks. The design of deep learning architectures for various tasks on the domain of topological objects has seen quick progress, fueled by the desire to model higher-order interactions that are often naturally occurring in data.The first focus area of this dissertation is an extension of pooling layers to simplicial complex input data. For deep learning problems on graph-structured data, pooling layers are important for down sampling, reducing computational cost, and to minimize overfitting in the model. We define a pooling layer, NervePool, for data structured as simplicial complexes, which are generalizations of graphs that include higher-dimensional simplices beyond vertices and edges; this structure allows for greater flexibility in modeling higher-order relationships. The proposed simplicial coarsening scheme is built upon partitions of vertices, which allow us to generate hierarchical representations of simplicial complexes, collapsing information in a learned fashion. NervePool builds on the learned vertex cluster assignments and extends to coarsening of higher dimensional simplices in a deterministic fashion. While in practice, the pooling operations are computed via a series of matrix operations, the topological motivation is a set-theoretic construction based on unions of stars of simplices and the nerve complex.The second focus of this dissertation is another input data type with topological structure, the Euler Characteristic Transform (ECT). The ECT provides a summary of the topological shape of data which is both simple to define and simple to compute for many different input data types, including images, graphs, and embedded simplicial complexes. In contrast to alternative directional transform methods in topological data analysis, the ECT is easier to compute and represent in a format well-suited for machine learning tasks. To leverage the inherent structure of ECT data on a cylinder for our input data types, we employ a particular choice of convolutional neural network (CNN) architecture for the classification of ECT data. We prove that our ECT-CNN pipeline produces equivariant representations of input data, which allows for the use of un-aligned input data. We apply the ECT-CNN to two different leaf shape datasets and compare the model performance against traditionally used methods which require data to be prealigned, and in doing so we exhibit its efficacy in shape classification tasks.
Read
- In Collections
-
Electronic Theses & Dissertations
- Copyright Status
- Attribution 4.0 International
- Material Type
-
Theses
- Authors
-
McGuire, Sarah
- Thesis Advisors
-
Munch, Elizabeth
- Committee Members
-
Gerhardt, Teena
Boddeti, Vishnu
Chitwood, Daniel
- Date Published
-
2024
- Subjects
-
Mathematics
- Degree Level
-
Doctoral
- Language
-
English
- Pages
- 127 pages
- Permalink
- https://doi.org/doi:10.25335/3yz8-g940