A popular visitor attraction in Kinver has been forced to cancel its Halloween event in the "interests of safety".