ContextQMD
Back to Langchain4j

Xinference

docs/docs/integrations/language-models/xinference.md

1.14.11.1 KB
Original Source

Xinference

Maven Dependency

1.0.0-alpha1 and later:

xml
<dependency>
    <groupId>dev.langchain4j</groupId>
    <artifactId>langchain4j-community-xinference</artifactId>
    <version>${latest version here}</version>
</dependency>

Or, you can use BOM to manage dependencies consistently:

xml
<dependencyManagement>
    <dependency>
        <groupId>dev.langchain4j</groupId>
        <artifactId>langchain4j-community-bom</artifactId>
        <version>${latest version here}</version>
        <type>pom</type>
        <scope>import</scope>
    </dependency>
</dependencyManagement>

APIs

  • XinferenceChatModel
  • XinferenceStreamingChatModel

Examples