Start by trying a mild cleaner ... can stain the composite material or damage its texture. To avoid ruining the deck boards while removing rust, stay away from WD-40, toilet cleaners, and bleach.