Neighbors say the man was shooting off fireworks outside his home in Baldwin Harbor around 10:30 p.m. Sunday.
When police got to his home, the man barricaded himself inside his toolshed.
Neighbors in surrounding homes were evacuated around 1 a.m. as a precaution.
Police were finally able to get the man out of the shed around 4:30 a.m.
Richard Erickson, 43, is charged with 10 countes of criminal possession of a weapon, menacing, obstruction and storing explosives.
Detectives obtained a search warrant for the residence and detached garage and recovered a unloaded Voltran Model 2004 ARAS compact .09-mm handgun with magazine, a switchblade knife with a 2-inch blade, a highpoint 9mm model C9, a Smith and Wesson .38 caliber revolver, a defaced Lorcin .380 semi-automatic handgun and several magazines and ammunition.