It's more that describing a letter as being a vowel or consonant is fundamentally misleading. Those are types of sounds, and letters are not sounds - they're lines on paper or symbols on a screen. One letter can represent several sounds (as is the case with English 'y'), and sometimes multiple letters represent one sound - e.g. the word "hitch" has two consonants; they are written 'h' and 'tch'.