Just clicked through from the MT Forums– I don’t know if there’s any way to change MTEntryNext/Prev, but there are a couple ways to go through only a category’s MTNext/Prev.
A PHP Script Method via ScriptyGoddess
and Brad Choate’s MTCatx Plugin.