Is saying my bad rude?
It can be said to mean "Sorry I bumped into you" or it can also be said "Please get out of my way," or with a more aggressive tone, "Get out of my way now!" The tone is what makes the expression polite or impolite, not the words themselves. "My bad" can sound sincere or insincere, polite or impolite...