In order to adjust the volume by speech command using Google Assistant, face the smart speaker and speak aloud the percentage you want to set the volume to (0 - 100), followed by "percent".
For example, if you want to set the volume to "5", tell Google Assistant "volume 5 percent".