Back to Runanywhere Sdks

runanywhere_llamacpp

sdk/runanywhere-flutter/packages/runanywhere_llamacpp/README.md

0.20.121.1 KB
Original Source

runanywhere_llamacpp

Llama.cpp LLM backend for the RunAnywhere Flutter SDK — GGUF text generation on iOS and Android.


Installation

yaml
dependencies:
  runanywhere: 0.20.12
  runanywhere_llamacpp: 0.20.12

Platform setup (Podfile, permissions) is documented in the Flutter SDK README.


Usage

dart
import 'package:runanywhere/runanywhere.dart';
import 'package:runanywhere_llamacpp/runanywhere_llamacpp.dart';

await RunAnywhere.initialize();
await LlamaCpp.register();

// Register, download, load models and generate via core RunAnywhere APIs
final result = await RunAnywhere.llm.generate(
  'Hello!',
  LLMGenerationOptions(maxTokens: 64),
);

See the Flutter SDK README for full examples.


Support


License

RunAnywhere License. See LICENSE.