Given the lapping tool that most use is only $35, it may be worth giving it a try. And many smiths only charge about the same to lap. But be careful, as if the lapping compound get's off the face and into the receiver to barrel extension area you will be increasing slop, not decreasing. IE: Don't lap the inside, just the face)
That said, the receivers you hear about that are noticeably off (several degrees) I'd worry about for other reasons. IE: If the forging and subsequent cleanup was that out of spec, then what else is wrong?
Likewise, some of the smith measuring tricks are only measuring variance of the face to the rail or other external parts of the receiver. When what matters is how perpendicular the inside of the receiver is.
And some smiths have reached a point that they use the lap tool as a gauge with feeler gauges. If the gap is over a certain amount, then it's the receiver that's out of spec. You can decide whether to lap or just get a different receiver.
Sometimes you hear about free float hand guards with barrel off center. Which many presume to be a barrel/receiver misalignment. But depending on how the handguard attaches, it's far more likely that the handguard is mounted incorrectly.
Remember how the receiver to barrel extension/barrel works. My observation is that in a good, in spec receiver more alignment comes from that "fit" than the flange & face. There may be something to be said about equalizing force between the barrel flange, etc. Potential impact on harmonics. But I've not seen any verifiable information on this pro or con.
You are using high end components. Which should be in spec. I would not accept a VLTOR or MEGA billet receiver that had to be lapped to get a perpendicular face. But if you want to be sure, the tool is cheap. I'd just get a read from your receiver mfg if that would in any way invalidate warranty.
But all of this is just my opinion based on what I've been able to research. And I'm not a smith or high end mfg. There are others on the forum who may have a better or at least different opinion on it's real world impact on accuracy.