Can you take undergrad courses even if you are a grad student?

Yes, you can do that. However, they might not count towards your overall GPA, especially if they aren't related to your field.