It 100% happens repeatedly to me (my car has the little "tell you the speed limit" feature). It'll suddenly say the limit is 30 because the GPS thinks I'm on the feeder road nearby.
To account for such errors the limiter should probably set the limit to the highest of any road within ~50 m, with a possible exception for school zones that aren't immediately adjacent to highways.
