Casual workers average weekly hours are rising, while others are falling