I believe the word's etymology derives from the concept of religious or mystical attribution to an object. Such items are themselves called fetishes. Zuni being one particular tribe's mystic artwork.

Our use of the word, we add the adjective "sexual" to differentiate.