You said you were casting at a pylon? Try using the smallest sinker possible maybe try a size 0 or size 1 sinker, and a light leader around 6lb mark it will make a huge difference, bream dont like feeling weight when running off with the bait, so the lighter the sinker and the lighter you can get away with a leader, should help you in some sort of way!
Tight lines