I share similar sentiments. I've only been on one 'travel agent organised' holiday in my life, and whilst the package put together was nice and it was good to have so many things organised and you just provided a voucher on the day (which also let you budget things better as most things were already paid for), at the end of the day, every other trip I've ever done, I've been able to plan things myself and get them far cheaper than anything a travel agent has offered me - which then offset any sweeteners or incentives they could offer like free breakfast (in some cases, I've rung the hotel and asked if they would comp it because that's what the competitor was offering, and they just did, so hardly a TA exclusive deal).
I don't want to start a TA bashing discussion - and clearly one or more respondents are favourable to travel agents, or possibly are travel agents - so let me make it clear, there are benefits to using an agent - those are usually convenience, budgeting in advance to do the things you want to do, and not having to stress or worry about the details. However, and this is just for me and my own opinion, if your primary concern is cost, then you can save more by doing your own legwork - especially since most travel agents work on a commission - so at the very least you can save that much, if not more.
I will usually contact 1 or 2 agents when I'm planning a trip, and ask them to put together a few quotes for options on what they'd recommend. Invariably, I can get closer to what I'm looking for, for a cheaper price. The day a travel agent can offer a better deal than I can get myself, i'll book with them - but as I said - I've only been on one in my life (and I wasn't the one paying the bill).