Subject: Deep learning, intelligent system, hyperparameters selection, DL architecture selection, multi-label classification
Year: 2021
Type: Journal Article
Title: Data-Driven Intelligence System for General Recommendations of Deep Learning Architectures
Author: Mishev, Kostadin
Author: Noveski, Gjorgji
Author: Eftimov, Tome
Author: Simjanoska, Monika
Abstract: Choosing optimal Deep Learning (DL) architecture and hyperparameters for a particular problem is still not a trivial task among researchers. The most common approach relies on popular architectures proven to work on specific problem domains led on the same experiment environment and setup. However, this limits the opportunity to choose or invent novel DL networks that could lead to better results. This paper proposes a novel approach for providing general recommendations of an appropriate DL architecture and its hyperparameters based on different configurations presented in thousands of published research papers that examine various problem domains. This architecture can further serve as a starting point of investigating DL architecture for a concrete data set. Natural language processing (NLP) methods are used to create structured data from unstructured scientific papers upon which intelligent models are learned to propose optimal DL architecture, layer type, and activation functions. The advantage of the proposed methodology is multifold. The first is the ability to eventually use the knowledge and experience from thousands of DL papers published through the years. The second is the contribution to the forthcoming novel researches by aiding the process of choosing optimal DL setup based on the particular problem to be analyzed. The third advantage is the scalability and flexibility of the model, meaning that it can be easily retrained as new papers are published in the future, and therefore to be constantly improved.
Publisher: IEEE
Relation: IEEE Access
Identifier: oai:repository.ukim.mk:20.500.12188/17694
Identifier: http://hdl.handle.net/20.500.12188/17694