The town centre needs to develop more of a caf culture, according to The New Swindon Company.
Rosemary Wells, the director of business development at the company, which is responsible for urban regeneration in the town, says there are enough "drinking warehouses."
She said: "We would like to see more of a caf culture in the area places where people can sit outside and watch the world go by."
Last year, The New Swindon Company asked residents, employers, community groups and schools for ideas on how to create a vibrant, exciting town centre.
Mrs Wells said: "The results of our consultation showed people think there are enough pubs. There is a demand for more places to socialise for people of all ages, such as restaurants, cafes and wine bars."
This is a far cry from the present scene in Fleet Street, which is awash with pubs and theme bars.
But this could change in future. Swindon Council has already received a planning application for permission to convert a shop into a restaurant and takeaway.
Freddy Chang and his wife, Vivian, currently run The Herbal Shop, a Chinese medicine business, in the street.
They want to turn the premises into a Chinese restaurant.
Mrs Chang, 29, said: "This is more an area for socialising than shopping, so we think a restaurant could be popular."
The window of their shop was broken by revellers flooding out of the pubs over Christmas.
She said: "At night it can be very bad. People get drunk and there is fighting."
Walkabout, the Australian theme bar, is the latest pub to open in Fleet Street. The bar opened last month and relief manager Deon Scheepers says business is booming.
He said: "We can hold 700 people and are packed, especially at the weekend."
Walkabout also serves a range of Australian specialities, including crocodile and kangaroo.
Mr Scheepers said: "All our tables are taken at lunchtime. People enjoy the atmosphere and adventurous food."
Not everyone thinks the area has caf culture potential.
Accounts worker Kerry Arkell, 27, from Penhill, said: "During the day the pubs are more like cafes because you can sit down and have a quiet drink and bite to eat. Most town centres are heaving at night. You can't escape it."
Project manager Andy Minton, 29, from Rodbourne Cheney, thinks Swindon is years behind cities like Bristol, Bath or Cardiff.
He said: "This area doesn't lend itself to caf culture. There is no waterfront and the theme bars make it quite rough at night. For a quiet drink I go to Old Town."
vtagg@newswilts.co.uk
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules hereComments are closed on this article