Usually, the other insurance company wouldn't pay until your PIP limits have been exhausted. And since the idea of insurance is to be made "whole" you should return any duplicate settlement money. This will also help in keeping the cost of insurance down.

You can go here for information on coverages.