著者

Yuki Saito Kohei Yatabe Shogun

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

pp.e23.67, (Released:2023-12-02)

参考文献数

11

---

Understanding of gameplay can enhance the experience and entertainment of video game. In this study, we propose to utilize the sound generated by a controller for analyzing the information of gameplay. Controller sound is a user-friendly feature related to gameplay because it can be very easily recorded. As a first step of the research, we performed identification of characters of Super Smash Bros. Ultimate only from controller sound as an example task for examining whether controller sound contains valuable information. The results showed that our model achieved 79% accuracy for identification of five characters only using the controller sound.

著者

Yoshiki Masuyama Tsubasa Kusano Kohei Yatabe Yasuhiro Oikawa

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.40, no.3, pp.186-197, 2019-05-01 (Released:2019-05-01)

参考文献数

29

被引用文献数

3

---

For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

著者

Kohei Yatabe Yoshiki Masuyama Tsubasa Kusano Yasuhiro Oikawa

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.40, no.3, pp.170-177, 2019-05-01 (Released:2019-05-01)

参考文献数

48

被引用文献数

21

---

As importance of the phase of complex spectrogram has been recognized widely, many techniques have been proposed for handling it. However, several definitions and terminologies for the same concept can be found in the literature, which has confused beginners. In this paper, two major definitions of the short-time Fourier transform and their phase conventions are summarized to alleviate such complication. A phase-aware signal-processing scheme based on phase conversion is also introduced with a set of executable MATLAB functions (https://doi.org/10/c3qb).

著者

Atsuto Inoue Yusuke Ikeda Kohei Yatabe Yasuhiro Oikawa

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.40, no.1, pp.1-11, 2019-01-01 (Released:2019-01-01)

参考文献数

28

被引用文献数

2 16

---

For the visualization of a sound field, a widely used method is the superimposition of the sound information onto a camera view. Although it effectively enables the understanding the relationship between space and sound, a planar display cannot resolve depth information in a straightforward manner. In contrast, a see-through head-mounted display (STHMD) is capable of representing three-dimensional (3D) vision and natural augmented reality (AR) or mixed reality (MR). In this paper, we propose a system for the measurement and visualization of a sound field with an STHMD. We created two visualization systems using different types of STHMDs and technologies for realizing AR/MR and a measurement system for a 3D sound intensity map, which can be used together with the visualization system. Through three visualization experiments, we empirically found that the stereoscopic viewing and the convenient viewpoint movement associated with the STHMD enables understanding of the sound field in a short time.

著者

Hideki Kawahara Kohei Yatabe

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.43, no.3, pp.209-212, 2022-05-01 (Released:2022-05-01)

参考文献数

2

被引用文献数

2

著者

Daiki Takeuchi Kohei Yatabe Yuma Koizumi Yasuhiro Oikawa Noboru Harada

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.41, no.5, pp.769-775, 2020-09-01 (Released:2020-09-01)

参考文献数

39

被引用文献数

6

---

In recent single-channel speech enhancement, deep neural network (DNN) has played a quite important role for achieving high performance. One standard use of DNN is to construct a mask-generating function for time-frequency (T-F) masking. For applying a mask in T-F domain, the short-time Fourier transform (STFT) is usually utilized because of its well-understood and invertible nature. While the mask-generating regression function has been studied for a long time, there is less research on T-F transform from the viewpoint of speech enhancement. Since the performance of speech enhancement depends on both the T-F mask estimator and T-F transform, investigating T-F transform should be beneficial for designing a better enhancement system. In this paper, as a step toward optimal T-F transform in terms of speech enhancement, we experimentally investigated the effect of parameter settings of STFT on a DNN-based mask estimator. We conducted the experiments using three types of DNN architectures with three types of loss functions, and the results suggested that U-Net is robust to the parameter setting while that is not the case for fully connected and BLSTM networks.

著者

Tsubasa Kusano Kohei Yatabe Yasuhiro Oikawa

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.39, no.3, pp.215-225, 2018-05-01 (Released:2018-05-01)

参考文献数

47

被引用文献数

2

---

In marine seismic surveys to explore seafloor resources, the structure below the seafloor is estimated from the obtained sound waves, which are emitted by a marine seismic sound source and reflected or refracted between the layers below the seafloor. In order to estimate the structure below the seafloor from returned waves, information of the sound source position and the sound speed are needed. Marine seismic vibrators, which are one of the marine seismic sound sources, have some advantages such as high controllability of the frequency and phase of the sound, and oscillation at a high depth. However, when the sound source position is far from the sea surface, it becomes difficult to specify the exact position. In this paper, we propose a method to estimate the position of a marine seismic vibrator and the sound speed from obtained seismic data by formulating an optimization problem via hyperbolic Radon transform. Numerical simulations confirmed that the proposed method almost achieves theoretical lower bounds for the variances of the estimations.

著者

Kenji Kobayashi Yoshiki Masuyama Kohei Yatabe Yasuhiro Oikawa

出版者

ACOUSTICAL SOCIETY OF JAPAN

雑誌

Acoustical Science and Technology (ISSN:13463969)

巻号頁・発行日

vol.42, no.5, pp.261-269, 2021-09-01 (Released:2021-09-01)

参考文献数

42

被引用文献数

1

---

Phase recovery is a methodology of estimating a phase spectrogram that is reasonable for a given amplitude spectrogram. For enhancing the signals obtained from the processed amplitude spectrograms, it has been applied to several audio applications such as harmonic/percussive source separation (HPSS). Because HPSS is often utilized as preprocessing of other processes, its phase recovery should be simple. Therefore, practically effective methods without requiring much computational cost, such as phase unwrapping (PU), have been considered in HPSS. However, PU often results in a phase that is completely different from the true phase because (1) it does not consider the observed phase and (2) estimation error is accumulated with time. To circumvent this problem, we propose a phase-recovery method for HPSS using the observed phase information. Instead of accumulating the phase as in PU, we formulate a local optimization model based on the observed phase so that the estimated phase remains similar to the observed phase. The analytic solution to the proposed optimization model is provided to keep the computational cost cheap. In addition, iterative refinement of phase in the existing methods is applied for further improving the result. From the experiments, it was confirmed that the proposed method outperformed PU.