Prisk’s departure is part of a wider cabinet reshuffle with both the Conservative’s and the Liberal Democrat’s making a number of changes.
The ex minister took to Twitter to express his disappointment at being asked to step down.
Prisk tweeted: “Been asked to step aside from Housing for a younger generation.
“Disappointing but it’s been a great eleven years on [the frontbench].”
Grainia Long, chief executive of the Chartered Institute of Housing, praised Prisk for his focus on the delivery of new homes.
Long said: “Mark Prisk's tenure as housing minister has been marked by a commendable focus on delivery.
"Although progress on numbers of new homes has been disappointingly slow it is clear that the minister has been working hard to explore different delivery options and taking a personal interest in work to unlock stalled sites.
"He also brought a good deal of personal integrity to the role and a careful and thoughtful approach informed by a real understanding of the housing system and housing markets reflecting his background as a property professional.
"His personal style was highly non-partisan demonstrating a willingness to search for solutions rather than a desire to play politics with something as important to peoples’ lives as housing.”
The Hertford and Stortford MP took up the role of housing and local government minister in September 2012.
A DCLG spokeman confimed that Number 10 will confirm the new housing minister's identity tomorrow.