Java submission test includes a failing test for -2147483647, which should not be prime, and my function does not mark it prime as far as I can tell. If I write this condition into the tests manually it succeeds.

I like this. It doesn't lean on Data.Char, doesn't redirect to additional functions (like my first attempt), and each line is crystal clear what it's doing. You could reverse engineer the plain English spec from this code.