I use a variety of sources although I'm definitely a fan of going beyond the ordinary. I like having sounds that people find hard to recognize but still gets the job done. Most sounds wouldn't be used raw or unprocessed at all so quality shouldn't be a concern unless poor quality is referring to noise that you don't want like hissing, crackles, etc, on top of your source material.
I do record "strange sounds" for my work and synthesize lots more with software like Pure Data, Super Collider, etc. Mostly because some sounds are just easier, better, and more controlled by generating it by software or glitching. Sometimes they are only possible that way.
I believe that there is a use for every sound and it just depends on the nature of your work. To be accurate and realistic, or to create a work of art.