EDIT - removing old answer bc question changed.
That conical spacer presses against the upper bearing assembly. If you take it out you'll need some way to pre-load the bearings. Unless you can find another part to replace the function of the conical spacer you cannot remove it.
Why do you want to remove it? Are you trying to slam your stem?
Here is an article about an appropriately named product that might get you where you want to go: Slam that Stem.