WASHINGTON—An armed man was arrested near Supreme Court Justice Brett Kavanaugh’s home early Wednesday and charged with attempted murder after making threats against the justice, authorities said.

Nicholas John Roske, 26 years old, of Simi Valley, Calif., was allegedly carrying a pistol with two magazines and ammunition, a knife, pepper spray, zip ties and various household tools at the time he was arrested, according to the Justice Department.