Covered riding whip with PVC handle