For some good swishes, us a thin dowel rod and pretend it's a sward, swish it around in front of the mic (careful don't hit it.) - You might want to record with a flat EQ and and maybe think about using a higher bit rate to get as much range as possible.
For booms, you can't beat a good trash can (well that's exactly what I would do) and I think you were on the right track with the kick drum, maybe see if you can find a concert bass, or a marching band drum, that will give you a different sound.
some other crazy sounds, if you have a access to a bow and arrows, set your mic near where you release and reverse the sound.
Also if you can fire a gun off, something with a low resonance, set the mic at a distance. You'll want to in post edit out the initial firing, but then use the percussion shock off of it, try reversing that too, or even slowing it down by about 25% that's a pretty wicked effect.