It is not important how much swap is ussed unless it is full. It is more important how much swap in swap out operations per second you have. Swapin/swapout can be monitored with `vmstat`, `sar` or `dstat`.
If swap is full and swapin/swapout operations are very low, you can just add more swap.