This approach is called _Block Coordinate Descent_. Simple coordinate descent methods work with a single variable at a time- in block coordinate descent the optimization is done with groups of variables. It is not obvious in general that block coordinate descent will converge to an optimal solution. This has been the topic of a lot of research in recent years.