That's true, but Apple already has a rich and successful game ecosystem on iPhones which are roughly the same hardware as the Apple TV. They have all the ingredients, and they've even made a visible attempt by offering Apple Arcade on the Apple TV. Wireless console controllers also work on Apple TV. It's just clear that the resources and effort haven't been made to get their Arcade developers to do the extra work to really make their titles work well on big TVs with console controllers.
I had an Apple TV 4K and a couple of compatible gamepads, and I loved some of the early tvOS games! Rayman, Icycle (!!), Alto's Adventure, Badlands...
Then I tried Apple Arcade and it's just terrible. First, performance for all the 3D-heavy games is exactly what you would expect on a 4K screen with an iPhone 7 GPU. The iPhone XR GPU won't solve that.
But I'm also convinced that Apple fundamentally doesn't get games. A lot of the content was just interactive storytelling. With a few notable exceptions, I felt like a suit who never owned a console or Steam account had picked games for me based purely on the marketing materials.