If you have a newer Apple TV remote (also known as the "Siri remote"), you may have experienced some difficulty using the in-game menu. There are two ways to use your new Apple remote to navigate: swiping, or clicking the buttons on the outer ring (which are also mapped to left, up, etc). When some of the Party Packs were designed, the Apple remote only supported swiping and it was not possible to map navigation to buttons as well. Therefore, you will need to utilize the swipe function to navigate.
If you have an iPhone or iPad you can try the Apple TV Remote App.