Years ago when I was heavily into black powder I would have a couple hundred pounds of the stuff around at times. The local fire department found out about it and told me they wouldn't be able to enter my house if I had a fire, so I cut way back. Black powder could be a problem in that quantity I suppose, but smokeless wouldn't present much danger, especially in loaded rounds.