Yes, the instantaneous rate of change is $4$.
To see this (even) more explicitly, remember that the derivative $f'(x)$ is defined as $\lim_{h\to 0} \frac{f(x+h)-f(x)}{h}$, so $$\frac{d}{dx} (ax+b) = \lim_{x\to 0}\frac{(a(x+h) + b) - (ax+b)}{h} = \lim_{h\to0} \frac{ah}{h} = a$$