People living in the Elm Hill area of Norwich have objected to plans for the Courtyard Cafe to serve alcoholic drinks into the evening.