released 0.22.0

dengrixionghnu · Aug 29, 2023 · c1cc5be · c1cc5be
1 parent 1e8c5a2
commit c1cc5be
Show file tree

Hide file tree

Showing 17 changed files with 39 additions and 28 deletions.
diff --git a/.github/ISSUE_TEMPLATE/bug_report.md b/.github/ISSUE_TEMPLATE/bug_report.md
@@ -23,7 +23,7 @@ Please provide a relevant code snippets to reproduce this bug.
 A clear and concise description of what you expected to happen.
 
 **Please complete the following information:**
-- LangChain4j version: e.g. 0.21.0
+- LangChain4j version: e.g. 0.22.0
 - Java version: e.g. 11
 - Spring Boot version (if applicable): e.g. 2.7.14
 

diff --git a/README.md b/README.md
@@ -27,6 +27,14 @@ Please see examples of how LangChain4j can be used in `langchain4j-examples` rep
 
 ## News
 
+29 August:
+- Offline [text classification with embeddings](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/classification/EmbeddingModelTextClassifierExample.java)
+- Integration with [Google Vertex AI](https://cloud.google.com/vertex-ai) by [@kuraleta](https://github.com/kuraleta)
+- Reworked [document splitters](https://github.com/langchain4j/langchain4j/blob/main/langchain4j/src/main/java/dev/langchain4j/data/document/splitter/DocumentSplitters.java)
+- In-process embedding models can now embed longer texts
+- In-memory embedding store can now be easily persisted
+- [And more](https://github.com/langchain4j/langchain4j/releases/tag/0.22.0)
+
 19 August:
 - Integration with [Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-services/openai/overview) by [@kuraleta](https://github.com/kuraleta)
 - Integration with Qwen models (DashScope) by [@jiangsier-xyz](https://github.com/jiangsier-xyz)
@@ -190,12 +198,12 @@ See example [here](https://github.com/langchain4j/langchain4j-examples/blob/main
       <dependency>
           <groupId>dev.langchain4j</groupId>
           <artifactId>langchain4j</artifactId>
-          <version>0.21.0</version>
+          <version>0.22.0</version>
       </dependency>
       ```
     - Gradle:
       ```
-      implementation 'dev.langchain4j:langchain4j:0.21.0'
+      implementation 'dev.langchain4j:langchain4j:0.22.0'
       ```
 
 2. Import your OpenAI/HuggingFace API key:
@@ -238,6 +246,10 @@ Please note that the library is in active development and:
     - [Chats](https://platform.openai.com/docs/guides/chat) (sync + streaming + functions)
     - [Completions](https://platform.openai.com/docs/guides/completion) (sync + streaming)
     - [Embeddings](https://platform.openai.com/docs/guides/embeddings)
+- Integration with [Google Vertex AI](https://cloud.google.com/vertex-ai) for:
+    - [Chats](https://cloud.google.com/vertex-ai/docs/generative-ai/chat/chat-prompts)
+    - [Completions](https://cloud.google.com/vertex-ai/docs/generative-ai/text/text-overview)
+    - [Embeddings](https://cloud.google.com/vertex-ai/docs/generative-ai/embeddings/get-text-embeddings)
 - Integration with [HuggingFace Inference API](https://huggingface.co/docs/api-inference/index) for:
     - [Chats](https://huggingface.co/docs/api-inference/detailed_parameters#text-generation-task)
     - [Completions](https://huggingface.co/docs/api-inference/detailed_parameters#text-generation-task)
@@ -252,16 +264,15 @@ Please note that the library is in active development and:
 - [Integration](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/store/ChromaEmbeddingStoreExample.java) with [Chroma](https://www.trychroma.com/)
 - [Integration](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/store/PineconeEmbeddingStoreExample.java) with [Pinecone](https://www.pinecone.io/)
 - [Integration](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/store/WeaviateEmbeddingStoreExample.java) with [Weaviate](https://weaviate.io/)
-- [In-memory embedding store](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/store/InMemoryEmbeddingStoreExample.java) (for prototyping and testing)
+- [In-memory embedding store](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/embedding/store/InMemoryEmbeddingStoreExample.java) (can be persisted)
 - [Structured outputs](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/OtherServiceExamples.java)
 - [Prompt templates](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/PromptTemplateExamples.java)
 - [Structured prompt templates](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/StructuredPromptTemplateExamples.java)
 - [Streaming of LLM responses](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/StreamingExamples.java)
 - [Loading txt, pdf, doc, xls and ppt documents from the file system and via URL](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/DocumentLoaderExamples.java)
 - [Splitting documents into segments](https://github.com/langchain4j/langchain4j-examples/blob/main/other-examples/src/main/java/ChatWithDocumentsExamples.java):
-    - by paragraph
-    - by sentence
-    - by character count
+    - by paragraphs, lines, sentences, words, etc
+    - recursively
 - Token count estimation (so that you can predict how much you will pay)
 
 ## Coming soon:

diff --git a/langchain4j-core/pom.xml b/langchain4j-core/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-dashscope/pom.xml b/langchain4j-dashscope/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-milvus/pom.xml b/langchain4j-milvus/pom.xml
@@ -6,7 +6,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-parent/pom.xml b/langchain4j-parent/pom.xml
@@ -6,7 +6,7 @@
 
     <groupId>dev.langchain4j</groupId>
     <artifactId>langchain4j-parent</artifactId>
-    <version>0.21.0</version>
+    <version>0.22.0</version>
     <packaging>pom</packaging>
 
     <name>langchain4j parent POM</name>

diff --git a/langchain4j-pinecone/pom.xml b/langchain4j-pinecone/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-spring-boot-starter/pom.xml b/langchain4j-spring-boot-starter/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-vertex-ai/pom.xml b/langchain4j-vertex-ai/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j-weaviate/pom.xml b/langchain4j-weaviate/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j/pom.xml b/langchain4j/pom.xml
@@ -7,7 +7,7 @@
     <parent>
         <groupId>dev.langchain4j</groupId>
         <artifactId>langchain4j-parent</artifactId>
-        <version>0.21.0</version>
+        <version>0.22.0</version>
         <relativePath>../langchain4j-parent/pom.xml</relativePath>
     </parent>
 

diff --git a/langchain4j/src/main/java/dev/langchain4j/data/document/transformer/HtmlTextExtractor.java b/langchain4j/src/main/java/dev/langchain4j/data/document/transformer/HtmlTextExtractor.java
@@ -42,7 +42,7 @@ public HtmlTextExtractor() {
      * @param metadataCssSelectors A mapping from metadata keys to CSS selectors.
      *                             For example, Mep.of("title", "#page-title") will extract all text from the HTML element
      *                             with id "title" and store it in {@link Metadata} under the key "title".
-     * @param includeLinks         Specifies whether links (<a>) should be included in the extracted text.
+     * @param includeLinks         Specifies whether links should be included in the extracted text.
      */
     public HtmlTextExtractor(String cssSelector, Map<String, String> metadataCssSelectors, boolean includeLinks) {
         this.cssSelector = cssSelector;

diff --git a/langchain4j/src/main/java/dev/langchain4j/model/inprocess/InProcessEmbeddingModel.java b/langchain4j/src/main/java/dev/langchain4j/model/inprocess/InProcessEmbeddingModel.java
@@ -92,11 +92,11 @@ private static String errorMessageForPrePackagedModel(InProcessEmbeddingModelTyp
                         + "<dependency>\n" +
                         "    <groupId>dev.langchain4j</groupId>\n" +
                         "    <artifactId>langchain4j-embeddings-%s</artifactId>\n" +
-                        "    <version>0.21.0</version>\n" +
+                        "    <version>0.22.0</version>\n" +
                         "</dependency>\n"
                         + "\n"
                         + "Gradle:\n"
-                        + "implementation 'dev.langchain4j:langchain4j-embeddings-%s:0.21.0'\n",
+                        + "implementation 'dev.langchain4j:langchain4j-embeddings-%s:0.22.0'\n",
                 type.name(),
                 type.name().replace("_", "-").toLowerCase(),
                 type.name().replace("_", "-").toLowerCase()
@@ -110,11 +110,11 @@ private static String errorMessageForCustomModel() {
                 + "<dependency>\n" +
                 "    <groupId>dev.langchain4j</groupId>\n" +
                 "    <artifactId>langchain4j-embeddings</artifactId>\n" +
-                "    <version>0.21.0</version>\n" +
+                "    <version>0.22.0</version>\n" +
                 "</dependency>\n"
                 + "\n"
                 + "Gradle:\n"
-                + "implementation 'dev.langchain4j:langchain4j-embeddings:0.21.0'\n";
+                + "implementation 'dev.langchain4j:langchain4j-embeddings:0.22.0'\n";
     }
 
     @Override

diff --git a/langchain4j/src/main/java/dev/langchain4j/store/embedding/milvus/MilvusEmbeddingStore.java b/langchain4j/src/main/java/dev/langchain4j/store/embedding/milvus/MilvusEmbeddingStore.java
@@ -111,10 +111,10 @@ private static String getMessage() {
                 + "<dependency>\n" +
                 "    <groupId>dev.langchain4j</groupId>\n" +
                 "    <artifactId>langchain4j-milvus</artifactId>\n" +
-                "    <version>0.21.0</version>\n" +
+                "    <version>0.22.0</version>\n" +
                 "</dependency>\n\n"
                 + "Gradle:\n"
-                + "implementation 'dev.langchain4j:langchain4j-milvus:0.21.0'\n";
+                + "implementation 'dev.langchain4j:langchain4j-milvus:0.22.0'\n";
     }
 
 

diff --git a/...hain4j/src/main/java/dev/langchain4j/store/embedding/pinecone/PineconeEmbeddingStore.java b/...hain4j/src/main/java/dev/langchain4j/store/embedding/pinecone/PineconeEmbeddingStore.java
@@ -51,10 +51,10 @@ private static String getMessage() {
                 + "<dependency>\n" +
                 "    <groupId>dev.langchain4j</groupId>\n" +
                 "    <artifactId>langchain4j-pinecone</artifactId>\n" +
-                "    <version>0.21.0</version>\n" +
+                "    <version>0.22.0</version>\n" +
                 "</dependency>\n\n"
                 + "Gradle:\n"
-                + "implementation 'dev.langchain4j:langchain4j-pinecone:0.21.0'\n";
+                + "implementation 'dev.langchain4j:langchain4j-pinecone:0.22.0'\n";
     }
 
     private static EmbeddingStore<TextSegment> loadDynamically(String implementationClassName, String apiKey, String environment, String project, String index, String nameSpace) throws ClassNotFoundException, NoSuchMethodException, InstantiationException, IllegalAccessException, InvocationTargetException {

diff --git a/...hain4j/src/main/java/dev/langchain4j/store/embedding/weaviate/WeaviateEmbeddingStore.java b/...hain4j/src/main/java/dev/langchain4j/store/embedding/weaviate/WeaviateEmbeddingStore.java
@@ -66,10 +66,10 @@ private static String getMessage() {
       "<dependency>\n" +
       "    <groupId>dev.langchain4j</groupId>\n" +
       "    <artifactId>langchain4j-weaviate</artifactId>\n" +
-      "    <version>0.21.0</version>\n" +
+      "    <version>0.22.0</version>\n" +
       "</dependency>\n\n" +
       "Gradle:\n" +
-      "implementation 'dev.langchain4j:langchain4j-weaviate:0.21.0'\n"
+      "implementation 'dev.langchain4j:langchain4j-weaviate:0.22.0'\n"
     );
   }
 

diff --git a/pom.xml b/pom.xml
@@ -6,7 +6,7 @@
 
     <groupId>dev.langchain4j</groupId>
     <artifactId>langchain4j-aggregator</artifactId>
-    <version>0.21.0</version>
+    <version>0.22.0</version>
     <packaging>pom</packaging>
 
     <modules>