This paper investigates transmit beamforming optimization problem with per-cell power constraints for multi-cell downlink systems. A uplink-downlink duality under per-cell power constraints is established, based on the second-order statistics of the channel coefficients instead of instantaneous channel state information. And with the aid of this duality, a effective algorithm is proposed for the beamforming problem with per-cell power constraints.