It’s possible it evolved out of the phrase “caught my gaze”, where it’s assumed you’re using both eyes to gaze, or “caught my attention” and over time “gaze” or “attention” become “eye”, but someone more educated in the history of these terms would have to verify this.