The figure you drew looks like a big tetrahedron, where you bisected each edge to cut off a smaller tetrahedron at each original edge, leaving the octahedron in the center.
This approach could be generalized to higher dimensions, and would not result in cross polytopes but in 4d leads to something with 10 cells, 5 of them octahedra and 5 tetrahedra, unless I'm mistaken.
That subdivision doesn't directly lead to a tiling of the space, however, unless you allow for filler polytopes of infinitely many different sizes, so you can combine larger simplices and then fill gaps between these again.