Go with your usual pant size.
Don't know your size? Measure the circumference (all the way around) of your waist/hips where the top of the waistband of your shorts typically hits. Alternatively, you can measure the circumference of your favorite fitting pair of shorts. Compare those stats to the chart below to find your size.