Some thoughts:
- Reverse speech has the non tonal afterbreath placed first, making it sound like whisper.
- Reverse speech is generally incomprehensible and sounds alien, so ends up in the general category of "fear of the unknown".
- The reversed natural trail builds up momentary suspense. That applies to the reversing of most naturally fading sounds.
- The reverse build up creates a sense of something closing in on you.
- Genre convention
Add those points up and you get something scary ;-)