"...then it has no affect on safety or accuracy..."
Correct for safety, accuracy could be degraded.
Otherwise, how much chambering pressure you are comfortable with and are willing to accept is yours to determine. When it gets to be more than you want, FL size.
And trim the cases if they are too long but, actually, that's rarely a problem.