This is something we heard from a number of users. We're currently working on a solution to display folders to non-logged in users in alphabetical order. Unfortunately, until we ship that work there is no way to change the default sort order for viewers. It won't be too long before we make these updates.
Thank you for your feedback and please continue to share your feedback with us!