[Feature Request] Add Trino Docker Compose for Integration Testing

[dingo4dev]

Feature Request / Improvement

I would like to propose adding a Trino Docker Compose configuration to the development environment for testing purposes.

Inspired from #2002. I've noticed our integration tests rely heavily on Spark. In my case, I use PyIceberg for writes and Trino/Athena for queries. I'm wondering if we could add a Trino setup to our dev environment to help test this common interaction and ensure compatibility. I would consider separating the pytest marker integration and adding new marker integration-trino for the testcases related to Trino.

Benefits

• More diverse testing ecosystem beyond Spark

• Validate py-iceberg's write and update operations against a popular query engine like Trino

• Make it easier to reproduce and debug issues that might be specific to the Trino/Iceberg integration

• I'm happy to contribute

Does anyone have thoughts on this, or perhaps suggestions on the best way to implement it? Any information or guidance would be highly appreciated!

[Fokko]

Thanks for working on this @dingo4dev. Diversifying integration tests is a great idea, but both Spark and Trino use the same Java SDK, so I would expect the difference to be minimal.