Celebrity Big Brother fans were left fuming as the show started at 10pm, an hour after its usual 9pm time slot.