Date of Award
Summer 2023
Document Type
Open Access Dissertation
Department
Computer Science and Engineering
First Advisor
Jianjun Hu
Abstract
The usage of graph to represent one's data in machine learning has grown in popularity in both academia and the industry due to its inherent benefits. With its flexible nature and immediate translation to real life observed objects, graph representation had a considerable contribution in advancing the state-of-the-art performance of machine learning in materials.
In this dissertation proposal, we discuss how machines can learn from graph encoded data and provide excellent results through graph neural networks (GNN). Notably, we focus our adaptation of graph neural networks on three tasks: predicting crystal materials properties, nullifying the negative impact of inferior graph node points when learning, and generating crystal structures from material formula.
In the first topic, we propose and evaluate a molecule-appropriate adaptation of the original graph-attention (GAT) model for materials property prediction. With the changes of including the encoded bonds formed by atomic elements and adding a final global-attention layer, our experiments show that our approach (GATGNN) achieves great performance and provides interpretable explanation of each atom.
For the second topic, we analyze the learning process of various well-known GNNs and identify a common issue of propagating noisy information. Aiming to reduce the spread of particularly harmful information, we propose a simple, memory-efficient, and highly scalable method called NODE-SELECT. Our results demonstrate that the combination of hard attention coefficients, binary learnable selection parameter, and parallel arrangement of the layers significantly reduce the negative impact of noise data propagation within a GNN.
In the third topic, we extend the development of our GATGNN method and apply it to simulate electrodes reaction for predicting voltages.
Finally, we propose a generative approach for generating crystal structures. In this approach, we employ both GNN, variational autoencoder (VAE), and transformers to learn 3-dimentional space positioning of the elements within a unit-vector. This technique shows promising results based on the technique’s proof of concept and early results.
Rights
© 2023, Steph-Yves Mike Louis
Recommended Citation
Louis, S. M.(2023). Extending the Convolution in Graph Neural Networks to Solve Materials Science and Node Classification Problems. (Doctoral dissertation). Retrieved from https://scholarcommons.sc.edu/etd/7450