-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or requestjulesAssigned to Google JulesAssigned to Google Jules
Description
Context
The current Android build uses a "Logic Engine" (mock) because ort (ONNX Runtime) failed to compile for aarch64-linux-android due to missing precompiled binaries/pkg-config issues.
Task
Enable real local inference on Android.
Options
- Fix ORT: Configure
ortto download/compile correctly for Android NDK. - Switch to Candle: Use Hugging Face's
candlecrate which is pure Rust and easier to compile for Android. - Switch to Llama.cpp: Use
llama.cppbindings.
Requirements
- Must run
Phi-3-miniorGemma-2b(quantized). - Must not crash the app on load.
- Must stream tokens to the UI.
Reference
crates/synapse-cognition/src/lib.rsapps/desktop/src-tauri/Cargo.toml
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestjulesAssigned to Google JulesAssigned to Google Jules