My shipping “on time” is set to “NO” on many orders I shipped on time. This is extremely frustrating, And annoying, especially since I ship every order on time.
@AToasttoHappiness: Are you basing this on the CSV file from your Star Seller page? Is the "Tracking/label date" the same or earlier than the "Ship by" date? If not, and you are shipping on time, are you marking the order as complete on or before the scheduled ship by date? The "Tracking/label date" is essentially the date you marked the order as complete. When looking at the file keep in mind that the dates / times are in UTC not your local time zone.
If you shipped on time (or earlier) but don't have a tracking number, Etsy marks those order 'late' on the CSV file. In other places they will be marked shipped on time but with no tracking.