[Feature]: Using xcframework instead of using dylib

[sableangle]

Background & Description

I noticed that the LLama.cpp has compiled the xcframework library for all Apple devices/platforms, by using the xcframework will brings those benefits:

• Currently the only support Apple devices/platforms is macOS, the xcframework will add the support of iOS, visionOS, tvOS etc.
• Using the .dylib in macOS, since the library is not signed, the OS will block the library loading, which is annoying
• The cross-platform .Net solutions such as MAUI, Unity3D, will be easily to integration

API & Usage

No response

How to implement

No response

[martindevans]

Sounds good, are you interested in putting together a PR for this?

The first steps would be:

1. Modify the build script to produce the correct files (here). We're using the llama.cpp cmake, so you would probably just need to adjust some compiler flags.
2. Modify the file uploads (here) to the correct extension
3. Package the new files (here)

[sableangle]

I found that the llama.cpp project using a custom shell script to build xcframework, so it may need more time to complete the migration.

I'll try and see what can I do for this project.

[github-actions]

This issue has been automatically marked as stale due to inactivity. If no further activity occurs, it will be closed in 7 days.