For our turkey bowling pins, we made paper feathers. If you have feathers on hand, you can simply use those.
First, cut the paper into a rectangle. The length will be the height of the feather which you'll glue onto your bottle. So you might want to size it up against your bottle.
Then, fold the paper in half and cut out half of a feather shape so that you have a feather when you open the fold.