Linearization is basically just a first order Taylor polynomial of that function. But usually you perform a linearization around an equilibrium point, since you usually diverge rather quickly from non equilibrium points, so the linearization would become a bad approximation rather quickly as well. So you want,
$$ f(x^*,u^*) = 0, $$
$$ A = \left.\frac{\partial f(x,u)}{\partial x}\right|_{\begin{matrix}x=x^*\\\u=u^*\end{matrix}}, $$
$$ B = \left.\frac{\partial f(x,u)}{\partial u}\right|_{\begin{matrix}x=x^*\\\u=u^*\end{matrix}}, $$
$$ C = \left.\frac{\partial h(x,u)}{\partial x}\right|_{\begin{matrix}x=x^*\\\u=u^*\end{matrix}}, $$
$$ D = \left.\frac{\partial h(x,u)}{\partial u}\right|_{\begin{matrix}x=x^*\\\u=u^*\end{matrix}}, $$
$$ \left\\{\begin{align} \dot{x} & \approx A\, (x - x^*) + B\, (u - u^*) \\\ y & \approx h(x^*,u^*) + C\, (x - x^*) + D\, (u - u^*) \end{align}\right. $$
when $x$ and $u$ are close to $x^*$ and $u^*$ respectively.