Yes, the curve may have cusps: If you release the pendulum in a state of rest, the resulting motion can be mirrored in time to obtain a trajectory on which the pendulum retraces its path, which thus "ends" at the point at which the pendulum was released. Here the time derivative is zero and changes sign, thus satisfying the definition of a cusp.