Should we be able to vote against wishlist items?

Not voting for something may not be weighted as heavily as actively voting against something, but it does have the danger of a vocal minority shouting down a passive majority that didn’t vote, or didn’t even know vote.