Change back/forward to three-finger swipe. Problem solved.

It should be that way by default, hopefully that changes in an upcoming patch or 10.8.