Consumers also have low expectations that the Parliamentary inquiry into banking standards will lead to change, with only a quarter of people (26%) confident that it will lead to positive improvements in UK banks.
Since the start of the financial crisis consumers have been bearing the brunt of the recession with the Which? latest wellbeing survey showing that nearly half are worried about mortgage rates (45%) and the level of their household debt (42%).
At the same time consumers have been hit by a series of bank scandals which have further exposed the broken culture and mismanagement in UK banking.
These include the mis-selling of Payment Protection Insurance which is now on course to be the biggest financial scandal of all time, Libor interest rate rigging, and IT system failures at Natwest and Nationwide.
Which? is calling for the banking inquiry to produce tough new proposals to force banks to work better for consumers by tackling the lack of culture and competition in banking.
The consumer watchdog's research also found 84% of people think that the banks have not done enough to change the banking industry to ensure another credit crunch does not happen again - an increase from 76% in September 2011.
Some 50% of people think that the government’s handling of the banking industry has also got worse and 80% think there is a deeper problem with the culture in banks than just a few individuals making bad decisions.
Which? chief executive Peter Vicary-Smith said: “Five years on from the beginning of the financial crisis, public confidence in the banking industry is at an all time low, with a series of scandals exposing mis-management and corruption at the very heart of the banking system that have cost UK consumers dear.
"The parliamentary banking inquiry must produce proposals for fundamental change to the culture and practices of the banks and put the best interests of consumers back at the centre of reforms. Nothing should be off the table if the Government is to rebuild consumer confidence in this essential service.”
Which? wants the inquiry to focus on the needs of consumers and to make recommendations for handing power back to bank customers and transforming the culture and level of competition in the banking sector to achieve this.