I must admit I was somewhat wary of CF for all the reasons that are regularly stated, particularly the supposed propensity for sudden rather than gradual failure. My otherwise traditional steel fixie came with a CF fork which is surely the most critical component of all. Now I'm used to it, I'd not worry about a whole bike of CF if it was otherwise suitable - and I think maybe only Hewitt do a sensible drop-handler light tourer / audax stylee bike with pannier rack and mudguards.
Apparently it's possible to engineer in whatever stiffness / springiness (even in different directions for the same part) with carbon, so there's a lot going for it quite apart from weight. Critical parts should be made very strong indeed, so there really shouldn't be an issue for a properly made bike. I'd maybe be less happy for a no-name import frame, though you can't really be sure a proper brand is sourcing them properly.
A tig welded steel, titanium or ali bike could well have poor welds, even if they look OK. Welding thin tubes is a tricky job. My 10 evening classes mig welding 3mm mild steel showed it's not trivial using a more forgiving process on the easier to weld thicker material
I'm guessing it'd be be harder to do a bad braze (that still looked OK), unless you'd deliberately hidden a too short tube