You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+24-1Lines changed: 24 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,6 +7,29 @@ This is primary user entrypoint app for [PenumbraOS](https://github.com/Penumbra
7
7
8
8
MABL is a central orchestrator app, running as a normal unprivileged `untrusted` app, which exposes a plugin archecture built around the Android SDK ecosystem to enable users to install different implementations of LLMs (local, remote, realtime audio), TTS and STT, separate apps (like a timer or notes app), etc.
9
9
10
+
## Features
11
+
12
+
- Hold a single finger to talk to LLM
13
+
- Hold two fingers to talk to LLM with a picture
14
+
- Conversation persistence (ask "what did you just say" or similar)
15
+
- Rough laser ink projected display
16
+
- Date and time home screen
17
+
- Conversation display
18
+
- Navigation and menuing
19
+
- Dynamic tool calling
20
+
- Cosign similiarity between tool description embedding and user query selects the top `n` (currently 6) tools
21
+
- Only these tools, plus any "persistent" ones, are passed to the LLM
- Generic Android system operations (volume, more to come)
29
+
- Ai Pin specific operations (timers, more to come)
30
+
31
+
---
32
+
10
33
## Architecture
11
34
12
35
### Overview
@@ -41,7 +64,7 @@ Plugin discovery uses the normal SDK provisions of `PackageManager`. Plugins reg
41
64
42
65
#### Logic
43
66
44
-
Logic runs in the plugin's own process, like a normal Android app. Each plugin binds its own variant of the provider services it implements. `untrusted_app` should be able to register services usable by other `untrusted_app` based on the SELinux rules (**NOTE:** I have not tested this). Each plugin maintains its own access to the [PenumbraOS SDK](https://github.com/penumbraOS/sdk), and thus can access the network and priviledged operations like changing settings.
67
+
Logic runs in the plugin's own process, like a normal Android app. Each plugin binds its own variant of the provider services it implements. `untrusted_app` should be able to register services usable by other `untrusted_app` based on the SELinux rules. Each plugin maintains its own access to the [PenumbraOS SDK](https://github.com/penumbraOS/sdk), and thus can access the network and priviledged operations like changing settings.
0 commit comments