A Danville man is under arrest after police said he was caught with a gun he wasn't allowed to have.