There are two cases of seeing the 'Online text - Magnifier' button even if there are no submitted assignments by students themselves.

In case of students have clicked on an assignment to access the assignments page

In case of the instructor has clicked the student's [Grade] button to access the individual grade input page