I've gotten bursts up to well over 1000ms... hard resetting my modem and router does not appear to have done much, if anything (althought it seems like I am only getting spikes up to 500ms now).
Heck, when I ping comcast.net I get a whole bunch of normal pings (although varying quite wildly) with the occasional spike up to 500, and even a few timeouts...