著者

Tomu Katsumata Muneki Yasuda

出版者

The Institute of Electronics, Information and Communication Engineers

雑誌

Nonlinear Theory and Its Applications, IEICE (ISSN:21854106)

巻号頁・発行日

vol.12, no.3, pp.377-390, 2021 (Released:2021-07-01)

参考文献数

29

被引用文献数

2

---

A deep Boltzmann machine (DBM) is a probabilistic deep learning model; DBM learning consists pretraining and fine-tuning stages. This study focuses on the fine-tuning stage, and it develops a new and effective fine-tuning method based on spatial Monte Carlo integration (SMCI), which is an extension of the standard Monte Carlo integration (MCI). It has been proved that SMCI is statistically more accurate than the standard MCI. Fine-tuning methods based on first-order and semi-second-order SMCI methods are formulated. The numerical experiments demonstrate that the proposed fine-tuning methods are superior to the conventional method in terms of both training and generalization errors.