Tottenham Hotspur have shown the depths of their frustration over Gareth Bale's controversial absence from the Olympic Games by describing the criticism he and they have received as "wholly unacceptable and unjustified."

Bale was forced to withdraw from contention for selection by Team GB after he aggravated a back injury as he worked on his fitness ahead of the Games, in which he intended to participate.

Tottenham say the scan results were sent to the Football Association's medical team and it was collectively agreed, to Bale's disappointment, that he would not be fit to feature for Stuart Pearce's team in what stood to be an intensive tournament.

But the controversy was ignited when Bale, having made a quicker than expected recovery, played for Tottenham against Los Angeles Galaxy in Tuesday's friendly on the club's pre-season tour of the United States. He was the game's outstanding performer and scored in the 1-1 draw.

Sepp Blatter, the Fifa president, was prominent among the critics when he said Bale could face a ban from playing while the Games were on-going if the FA wanted to make a complaint. The governing body did not.

Tottenham's statement read: "The club considers the recent comment and accusations regarding Gareth Bale's fitness relating to his non-selection for Team GB's men's football team to be wholly unacceptable and unjustified. For the avoidance of any doubt and on a point of absolute clarity and transparency – Gareth sustained an injury as he built up his fitness ahead of joining up with Stuart Pearce's side. MRI scan reports were sent to the FA medical team on 29 June [2012].

"He was subsequently not selected on the basis of this injury and the inability to predict recovery time. This decision was not taken lightly and made only after consultation with Team GB's medical team, who were in agreement after seeing the medical reports. At no time was Gareth made unavailable for selection. Indeed, Gareth made clear publicly on numerous occasions his desire to compete for Team GB and was extremely disappointed on hearing the news he would not be fit to participate.

"He is now focused on and determined to get fit for the season ahead and to this end we have brought out an additional member of our medical team on tour, dedicated to Gareth's recovery. We are dismayed that some have sought to make wrongful assumptions about Gareth's particular situation and that such positive news surrounding his recovery is being highlighted in this manner."

The statement went on to note, pointedly, that Tottenham had been happy to release four other members of their first-team squad. "We look forward to following the progress of our other players in the Games – Danny Rose and Steven Caulker, along with Sandro and Giovani dos Santos."