The best way to get your ponytail in instead of trying to fight with all the hair at the back is lean forward and brush all your hair down to your face. Bring all of the hair from the back forward. Once you have done this then you can gather all of your hair in one bunch and apply the holder that you are going to be using.
You can do other variations with your ponytail look as well. Perhaps if you do not want it at the back you can have your ponytail to the side. This way what you need to do is turn your head to the side to gather all your hair at this time.