Marvel's with Avengers: Endgame in the MCU, Captain America often finds himself in a battle involving the Infinity Stones - and he's even destroyed them (but forgot his actions immediately after).
In New Avengers #3, Captain America finds himself entangled with the group known as the Illuminati. Comprised of his fellow heroes like Iron Man, Doctor Strange, Black Panther, Reed Richards, Namor, Beast (Charles Xavier was once part of the group but had died before this story began) and Black Bolt, the Illuminati are a shadowy group who each represent a part of the superhero community. All of the are geniuses, kings, or both. Captain America is recruited to help stop an incursion: an instance in which one universe intersects another, potentially dooming one or both.
Thanks to a vault that Charles Xavier left to Beast in his will, the Illuminati now have all the Infinity Stones (still called "gems" in this continuity). Captain America has a plan to reassemble the Infinity Gauntlet and use the gems to push one universe out of the way of the other. When he does so, the cosmic beings of the universe - Galactus, the Watcher, and Thanos - notice. Phenomenal power builds in Cap's hand when he wields the Gauntlet. "So much...power. I can control the heavens...I can control the Earth!" With a mighty burst of will, Steve sends the universe back - but vibrational shatters all the gems (except the Time gem, which is simply "gone").
The others are astounded - Namor in particular is furious - that Steve, inadvertently or otherwise, destroyed the Illuminati's best weapon against the incursions. Steve is adamant that the Illuminati not betray their principals in the name of "the greater good", because in his mind, that's how people throughout history eventually justify their atrocities. But everyone is in agreement that one's principles should be compromised, and Doctor Strange reluctantly casts a spell that wipes Steve's memory of the entire affair.
Unbeknownst to Captain America, the Illuminati's entire purpose is to make the hard decisions that others wouldn't even think of making. It was the group's doing, after all, that launched the Hulk into space, far away from the Civil War event. Captain America may have destroyed the Infinity Stones, but thanks to Doctor Strange and the ends-justifies-the-means approach of the Illuminati, he will never know.