Game design to determine the balance and difficulty of the game based on the synesthesia

An automated note generation system has been designed that improves the disadvantages of creating notes in music using BMS programs. In this paper, using FFT algorithm, the sound scale was extracted through frequency analysis of audio file and converted to color information. This was used to create automatic notes and balance the game in the rhythm game. In the case of non-complexed music such as children's songs, sound extraction was possible, but music such as K-pop, which had complex voices mixed, lacked accuracy. In this paper, the existing research on the relationship between pitch and color was objectively quantified and the system was designed to determine the balance and difficulty of the game based on the synesthesia felt by human.