ContextQMD
Back to Runanywhere Sdks

RunAnywhere AI — Flutter Example

examples/flutter/RunAnywhereAI/README.md

0.20.127.3 KB
Original Source

RunAnywhere AI — Flutter Example

<p align="center"> </p> <p align="center"> <a href="https://apps.apple.com/us/app/runanywhere/id6756506307"> </a> <a href="https://play.google.com/store/apps/details?id=com.runanywhere.runanywhereai"> </a> </p> <p align="center"> </p>

A cross-platform reference app for the RunAnywhere Flutter SDK. LLM chat, speech, vision, voice agents, RAG, tools, and model management via Dart FFI—mirroring the native iOS example's feature set.

Requirements

ItemMinimum
Flutter3.44.6+ (Dart 3.12.2+)
Android StudioSDK 24+, NDK; ANDROID_HOME and ANDROID_NDK_HOME set
Xcode26+ and CocoaPods (iOS builds)
JDK17
Disk spaceSeveral GB for native artifacts and AI models
DeviceARM64 physical device recommended (required for Apple MLX)

Setup

Important: This sample uses local path: dependencies on Flutter SDK packages. A clean clone must stage Android JNI libraries and iOS XCFrameworks into those packages before the app will build.

1. Clone and resolve packages

bash
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git
cd runanywhere-sdks/examples/flutter/RunAnywhereAI

flutter pub get

2. Build and stage native artifacts (repo root)

bash
cd ../../..
./scripts/build/build-core-android.sh arm64-v8a
./sdk/runanywhere-swift/scripts/build-core-xcframework.sh
cd examples/flutter/RunAnywhereAI
  • Android .so files land in sdk/runanywhere-flutter/packages/*/android/src/main/jniLibs/.
  • iOS XCFrameworks land in each package's ios/<package>/Frameworks/ directory.
  • Local consumption is enabled by runanywhere.useLocalNatives=true in android/gradle.properties.

Re-run after any C++ change in runanywhere-commons.

3. Verify and build

bash
flutter analyze
flutter build apk --debug
flutter build ios --simulator --debug

If iOS Pods are stale after pub get:

bash
cd ios && pod install && cd ..

Or run the combined gate:

bash
./scripts/verify.sh           # APK + analyze; RUN_IOS=1 for iOS build too

4. Run the app

bash
flutter run                   # Connected device or emulator
flutter run -d "iPhone 16 Pro"   # Specific iOS simulator

Open in VS Code or Android Studio, select a target, and press Run.

After modifying the SDK

ChangeAction
Dart SDKHot reload for most UI changes; restart for native init changes
C++ / commonsRe-run both root native build scripts from step 2

Features

FeatureDescription
AI ChatStreaming and batch LLM with thinking-mode parsing
Apple MLXLLM, VLM, embeddings, STT, TTS on physical iOS devices
Speech-to-TextBatch and live transcription
Text-to-SpeechPiper ONNX voices with playback controls
Voice AssistantSTT → LLM → TTS via RunAnywhere.voice event stream
Vision (VLM)Camera auto-stream and photo capture
RAGPDF ingestion and document Q&A
Tools & Structured OutputTool calling and JSON schema generation
SolutionsYAML pipeline demos
Model ManagementDownload, load, storage, deletion

MLX registers only on physical iOS hardware; the arm64 simulator validates compile/link/startup but does not run MLX inference.

NPU / QHexRT (Android)

The runanywhere_qhexrt package accelerates inference on supported Snapdragon/Hexagon devices. QHexRT native libraries are private local artifacts—stage them into sdk/runanywhere-flutter/packages/runanywhere_qhexrt/android/src/main/jniLibs/arm64-v8a/ before building; do not commit them.

To test private HNPU bundles: Settings → Downloads → save a Hugging Face token → download/load an HNPU model → Clear to revert to public downloads. Token is passed via RunAnywhere.setHfToken(...) at runtime.

Project structure

RunAnywhereAI/
├── lib/
│   ├── app/                    # runanywhere_ai_app.dart, ContentView tabs
│   ├── features/               # chat, voice, vision, rag, tools, settings, …
│   ├── core/
│   │   ├── design_system/      # AppColors (#FF6900), typography, spacing
│   │   └── services/           # Audio, conversation store, permissions
│   └── helpers/
├── pubspec.yaml                # path: deps → sdk/runanywhere-flutter/packages/*
├── android/                    # minSdk 24, packagingOptions for duplicate .so
├── ios/                        # Podfile, deployment target 17.5
├── scripts/
│   ├── verify.sh
│   └── smoke.sh
└── README.md

AI calls go through RunAnywhere.* facades over Dart FFI—no platform-channel hop for inference.

Troubleshooting

SymptomFix
Missing native library errorsRe-run root native build scripts; confirm runanywhere.useLocalNatives=true
iOS Pod / arch errorscd ios && pod install; xcframeworks are arm64-only (x86_64 simulator excluded)
Gradle OOM-Xmx6g is set in gradle.properties; close other Gradle daemons
MLX unavailableUse a physical iOS device
Analysis failuresflutter analyze — strict mode treats unused imports as errors

Quick static check:

bash
./scripts/smoke.sh
flutter test
ResourceLink
Flutter SDKsdk/runanywhere-flutter/README.md
iOS exampleexamples/ios/RunAnywhereAI
Android exampleexamples/android/RunAnywhereAI
React Native exampleexamples/react-native/RunAnywhereAI
App Store / Play StoreiOS · Android
Discorddiscord.gg/N359FBbDVd
IssuesGitHub Issues
Email[email protected]

License

This project is licensed under the RunAnywhere License (Apache 2.0 based, with additional commercial-use terms). See LICENSE for details.