The Local Government Association said many signs were needed or required by law but some had already been removed.
Mr Pickles has accused what he calls over-zealous councils of wasting taxpayers' money on signs that blight the local environment.
He and Transport Secretary Philip Hammond have written to council leaders calling on them to remove the clutter.
The government is urging the public to get involved by carrying out street audits and lobbying their councils.
The Department for Transport is reviewing the policy on traffic signs and will issue new advice on how to cut down on the clutter later this year.
In one example of the issue, the department said there were 63 bollards in a car park for 53 cars in Salisbury.
On the other hand, it said that changes that had been made in Kensington High Street in west London had reduced accidents by up to 47%.
'Obstacle course'
Mr Pickles said: "Our streets are losing their English character. We are being overrun by scruffy signs, bossy bollards, patchwork paving and railed off roads, wasting taxpayers' money that could be better spent on fixing potholes or keeping council tax down. We need to 'cut the clutter'.
"Too many overly-cautious town hall officials are citing safety regulations as the reason for cluttering up our streets with an obstacle course when the truth is very little is dictated by law.
"Common sense tells us uncluttered streets have a fresher, freer authentic feel, which are safer and easier to maintain."
Mr Hammond said unnecessary street furniture left areas "looking more like scrap yards than public spaces".

