Speaker noises when playing sound on low volume. topic

I noticed that when I'm sitting in a completely quiet room, when I play a video and set the volume to 1 bar, the sound is so bad you can hear literally only buzzing and other wierd noises. It's absolutely fine at higher volume levels, I guess the noises just don't get louder. And I'm wondering, because I have this phone for like four months, and I'm not sure if this got worse than it was at the beginning. May it be due to cleaning the dust with compressed air? Should I remove the cover and check if everything is ok?
Also, it can be heard better if you're holding the phone right by your ear, please check if it's the same for you.