By default, the volume buttons on the side change the “system volume”, which affects things like music and video playback. But the volume of your ringer volume, which controls the ringer and notifications, stays the same unless you change it from the settings.
Source: How-To Geek