Q&A in Sports Videos: A New Challenge

Ever wondered how AI understands sports videos well enough to answer questions about them? It's a tough task, especially since there haven't been many datasets to help train these systems. Most video question-answering datasets focus on everyday videos, not sports where the actions are complex and precise. That's why a new dataset called Sports-QA was created. It includes questions about what happens, when it happens, why it happens, and even what might have happened differently. This dataset covers multiple sports and has a wide range of question types.

To tackle this, scientists designed a new type of AI called Auto-Focus Transformer. This AI can zoom in on specific parts of a video to find the answers. They tested this AI on Sports-QA and found that it does a great job, better than other methods.

Actions