It’s not as colourful as the idioms with the fish, horse, wax and other balls, “it’s beside the point” is a common phrase that means that a statement or issue is unimportant or irrelevant to the topic being discussed.

I know that thinking that you have learned something from your teacher is a mistake! Did you see what I just did?