Does an degree make me a graduate student?

No, an undergraduate degree makes you a graduate *of* the undergraduate program. To be a graduate student, you must be enrolled in a graduate program (master's, doctoral, etc.) working towards a graduate degree.