I just figured it out... Log out of the connection that you have setup, then log back in with the same email address associated with your page. It gives you an option to select the user channel or the page channel. I selected the page and the email address changed. It now is uploading to my Page channel.
If you want to publish anything in your page then you have to be admin for that page. As well as the email address does not matter with publishing anything. Just be admin on any page then publish anything you want to.