Neighbours Tanya Parsons and Joanne Sutcliffe, of Brow Wood Road, said they are angry a group of men continue to play five-a-side football on Batley Sports Centre, which is shut to the public.
People across the UK are staying in self-isolation until further notice in order to stop the spread of Covid-19, but Ms Parsons said the number of men playing sports has reached 20 at a time.
She said: “While residents are sticking to the rules we’re unable to visit loved ones and family members.
“These groups are clearly not observing social distancing and potentially putting lives at risk.
“It’s so infuriating to hear the shouts and cheers from the The Sports Centre of players while residents are confined to homes.
“Coronavirus is impacting everyone and we need to be united to minimise the impact and keep the lockdown period to a minimum.
“This mindless action needs to stop.”
With the sports centre effectively shut, the group are also illegally breaking into the grounds.
“Neighbours who have tried to reason with the players have been met with verbal abuse,” said Ms Parsons.
“In these difficult times we don’t need the aggravation this is causing.
“Over the fortnight there has just been just one patrol car attend despite dozens of reports.”
Police confirmed they are investigating reports of breaking and entering on the sports centre.