Music can be turned on or off by clicking the Settings button in the game as shown in the screenshot below.