Tim Sherwood accepts that he risks being ousted as Tottenham Hotspur manager this summer but warned that Southampton's Mauricio Pochettino, who has been mentioned as one potential replacement, would find life at White Hart Lane much tougher than his current job at St Mary's.

Pochettino has become a much admired coach during his 12 months on the south coast and his future was plunged into uncertainty this week when the man who hired him at Southampton, Nicola Cortese, resigned. It was initially feared that the Argentinian would step down in solidarity with a key ally but he has committed to remain at the club until the summer at least. Reports have claimed that a switch to Tottenham might then materialise.

"I didn't know that. Am I being linked with Southampton?" Sherwood joked, before adding more seriously: "The expectation at this club is far greater than they have at Southampton. We were talking about that last week on the development side and used [Andros] Townsend as an example. If he was at Southampton he would not have had nine loans – he would have had his development through the leagues there, League One and so on, like [Alex] Oxlade-Chamberlain and Theo [Walcott]. That is the market they are in."

Sherwood has impressed since replacing André Villas-Boas a month ago and has since signed an 18-month contract but he knows that the club's craving for success means his job security is minimal. He takes his side to Swansea City on Sunday.

"I am realistic enough to know the ambitions of this club are very, very high and the demands are high," Sherwood says. "I knew that before I took the job and I am just hoping I can do enough to keep the job in the long term. If the results meet the expectation of the club, I will still be here. If they don't, I won't be. At the moment it is going all right, especially in the league. Long may that continue and, if it does, it will be hard for somebody to come in here and push me out of the seat."

Pochettino is not the only other manager who has been linked with Tottenham, as there have also been claims that Louis van Gaal could defect to White Hart Lane after leading his native Holland at the World Cup. Sherwood suggests that the fashionable appeal of foreign managers makes him feel as if he is flying the flag not just for himself but also for other young English managers.

"Recent history suggests there is a tendency to go for foreign names," he says. "There are a lot of English coaches – young English coaches – hoping I do well. A lot of well-wishers who hope it will open up the door for them to have an opportunity. It is unfair but I am happy that it is unfair because I have got an opportunity. It is only about results because when you win everything is good and when you don't everything is crap. That is where we are at in this game."