Those handbrake cable mounting ferrules are a bit of a pain - as per other comments if they've not been apart in the past, they'll likely be a pain.
I carefully cut mine with a Dremel, but it was a little bit tedious (and took a while). All done and working well now, though.
