Don't use a panhard bar with a leaf spring suspension. Leafs have a lot of travel, and a panhard will try to make the rear move from side to side. The end result will be a binding rear suspension, so number one, something WILL break, and number two, the binding will reduce travel, which is what makes a leaf suspension work.
About all you can do is use aluminum bushings.