This isn't a bad idea, and there are a lot of factories, farms and mines that I just can't see anyone spending the money and power to build in their town. I can give a short list, and put more thought into it, but I think maybe a new thread should be started to involve more town owners. Off the top of my head, I would give the axe to:
Mines - All mines except gold mines. No one would drain 24 power a day to get some redstone or coal. I can see the remote possibility someone would use an iron mine, but I doubt it.
Quarries - All quarries except Quartz quarry. Maybe spongeworks and ice, but i doubt people will build the ice one when alchemists can make ice or just silk touch it. Again 24 power a day is a LOT to spend on running a quarry to make dirt, cobble, gravel, sand, and even mossy cobble.
Farms - All farms except Carrot and maybe wheat. This may be becuase I haven't expereinced a T4 town yet, but most of what you need is sugar cane which you can make a non towny cane farm for, wheat and carrots. If you're not filling your farm slots with carrot farms and the occasional wheat farm, then you're doing it for fun? Tree farms aren't worth the 24 power a day loss due to the fact you can just bone meal some saplings and chop chop chop.
Factories - All factories except maybe TNT factory and Bread factory. I can't see a reason to drain town power to make sticks, stone axes, stone picks, flint or to fill a bucket of water when you can just make an infinite water source inside your chalets. I can see people who would want arrow factories, even tho the only class who really uses a bow (ranger) should have no arrow problems, or a pearl factory even tho pearls are largely useless since you cant use them inside a town. Packed ice, maybe, for the same reason for the ice quarry.
Power structures - I'm not sure power cage and power cell are relevant right now, aside from the fact they're possibly the reason towns have broken. I can't ever see towns needing more than 850 power (assuming a T3 town). Maybe a new tribe with no buidlings, but your power should be a daily struggle if you want to maximize your town. The rest of the power buildings are really preferential, except maybe the armory which consumes iron axes and is thus strictly worse than all the others.
Town Infrastructure - Pretty much everything except warehouse. The graveyard is expensive, but seems useful. The teleporter is cool, but limited because only town members can use it, and I have no idea what the Ward crystal does.
I can't see getting rid of anything else.
Again this is just my opinion, maybe a new thread involving other town owners should be made. Some come to mind -
@Beau_Nearh,
@SoHighFive ,
@ShadowRavynn ,
@Pearl2492 ,
@lukevillani ,
@devotedworker ,
@Naxet91 ,
@Osmodian