My passive speakers sound oddly diffuse, although the distance between the speakers and my listening position is the same.

This phenomenon occurs when the right and left channels are reversed. Make sure that the right channel of the amplifier is connected to the right speaker and the left channel to the left speaker. On some amplifiers, the left and right connections are reversed when viewed from the back and correspond to the other side.