In my opinion, even an iMac with an SSD is not absolutely silent, because it still has fans for ventilation.
And an iMac with a Fusion Drive will probably be a bit louder, because it has a classic hard drive inside that spins.
In my experience, however, neither model is very loud during normal use.