Robust task-specific adaption of drug-target interaction models
Sprache des Titels:
International Conference on Machine Learning (ICML 2022), 3rd Women in Machine Learning Un-Workshop
With the rise of new diseases, the fast discovery of drugs decreases the harm done to individuals. To this end, computational methods must be efficiently adaptable to new tasks, e.g. drug targets. HyperNetworks have been established as an effective technique to quickly adapt the parameters of neural networks. Notably, HyperNetwork-based parameter adaption has improved multi-task generalization in various domains, such as personalized federated learning and neural architecture search. In the drug discovery domain, drug-target interaction (DTI) models must be adapted to new drug targets, such as proteins, which constitute descriptions of prediction tasks. Current state-of-the-art Deep Learning architectures apply a few fully-connected layers to concatenated, learned embeddings of the description of the drug target and the molecule. However, these architectures do not have a specific mechanism to adapt the parameters to new targets. In this work, we develop a HyperNetwork approach to adapt the parameters of DTI models. On an established benchmark, our HyperNetwork approach improves the predictive performance of current architectures in several categories. Furthermore, we extend our approach to learn all parameters of a graph neural network as the molecular encoder using a particular weight initialization scheme. The proposed HyperNetwork approach renders DTI models more robust to new tasks and improves predictive performance in low data settings.