add_files retry logic

[MrDerecho]

Feature Request / Improvement

Is it possible to include support for retry logic upon exception due to "commit failed"? The situation is that I have multiple processes using add_files to write to a table concurrently- however, by including something like "tenacity retry" outside of the method itself, add_files is required to rerun the _parquet_files_to_data_files method before retrying the operation, if the method supported retrying the commit without needing to rebuild the DataFile objects it would allow for many more concurrent operations, and/or much larger commits without the added overhead of re-running _parquet_files_to_data_files repeatedly. Let me know if this is possible.

[ForeverAngry]

@Fokko could you assign me to this?

[jayceslesar]

related/can be rolled into #269