The sorting only works on the "show all songs" page for the artist. Because playlists do not contain the play count information, it will not function there.
UPDATE: A new feature called "AUTO SORT" has been added. When you click on an artist. It will automatically select "show all," and then sort.