Thanks @Todd for helping. Since it is a wireless subwoofer, I thought the noise might come from the wireless transmitter. I unplug the power of the transmitter, the noise didn't change. I also tried to wired connect the subwoofer to the receiver, not sure, sounds like the noise got lower, but...