Ok, after some creative googling, I found some functions which will tell me what I need to know:

GetFontUnicodeRanges

and

GetGlyphIndices

will both tell you whether a font supports a specific character or not.