Yes, it’s a dumb question that creates bias and other problems in the hiring process. On the other hand, when you need a job, you need a job. If mentioning something in response to the “outside of work” question creates an interest or connection with the interviewer, it’s to your advantage to do it. 

College football is maybe the most white, upper-middle-class version of that. There are others. (Travel, outdoor activities, etc.) We should live in a world where all employers are working to remove this kind of bias from hiring, but we do not live in that world. The one we live in grants an advantage to the job seeker who can find a common interest with the interviewer. You might as well do some research on the people you’re going to be meeting with and turn this bias to your advantage if you can.