[Obs AI Assistant] Add KB re-indexing when encountering semantic_text bug
#210386
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sorenlouv
added
release_note:fix
backport:prev-major
sorenlouv
force-pushed
the
kb-reindex-semantic-text-bug
branch
from
1710240 to
5bebe7f
Compare
|
Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant) |
viduni94
approved these changes
Feb 11, 2025
...orm/plugins/shared/observability_ai_assistant/server/service/knowledge_base_service/index.ts
Outdated
Show resolved
Hide resolved
...d/observability_ai_assistant/server/service/knowledge_base_service/reindex_knowledge_base.ts
Outdated
Show resolved
Hide resolved
...d/observability_ai_assistant/server/service/knowledge_base_service/reindex_knowledge_base.ts
Outdated
Show resolved
Hide resolved
...d/observability_ai_assistant/server/service/knowledge_base_service/reindex_knowledge_base.ts
Show resolved
Hide resolved
sorenlouv
force-pushed
the
kb-reindex-semantic-text-bug
branch
from
d374371 to
19d5f2d
Compare
sorenlouv
force-pushed
the
kb-reindex-semantic-text-bug
branch
from
19d5f2d to
78b4600
Compare
…er/service/knowledge_base_service/reindex_knowledge_base.ts Co-authored-by: Viduni Wickramarachchi <[email protected]>
dmlemeshko
reviewed
Feb 12, 2025
x-pack/test/api_integration/deployment_agnostic/default_configs/stateful.config.base.ts
Outdated
Show resolved
Hide resolved
💔 Some backports could not be created
Note: Successful backport PRs will be merged automatically after passing CI. Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
sorenlouv
added
backport:version
|
Starting backport for target branches: 8.17, 8.18 |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 17, 2025
…t` bug (elastic#210386) Closes elastic#210204 This will automatically re-index the knowledge base if upon adding a KB entry there is this error: > The [sparse_vector] field type is not supported on indices created on versions 8.0 to 8.10 That error means that semantic_text is not supported in the given index, and it should therefore be re-indexed. **How to test this PR:** **8.10** - `git checkout -B 8.10 origin/8.10` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` **8.19** - `git checkout -B 8.19 origin/8.x` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Install Knowledge base - Try adding an item to KB (it should fail ❌️) **9.1.0** - `gh pr checkout 210386` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Try adding an item to KB (it should succeed ✅️) **TODO:** - Add an upgrade test that covers this flow --------- Co-authored-by: Viduni Wickramarachchi <[email protected]> (cherry picked from commit df67a09)
💔 Some backports could not be created
Note: Successful backport PRs will be merged automatically after passing CI. Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
sorenlouv
added a commit
to sorenlouv/kibana
that referenced
this pull request
Feb 17, 2025
…t` bug (elastic#210386) Closes elastic#210204 This will automatically re-index the knowledge base if upon adding a KB entry there is this error: > The [sparse_vector] field type is not supported on indices created on versions 8.0 to 8.10 That error means that semantic_text is not supported in the given index, and it should therefore be re-indexed. **How to test this PR:** **8.10** - `git checkout -B 8.10 origin/8.10` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` **8.19** - `git checkout -B 8.19 origin/8.x` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Install Knowledge base - Try adding an item to KB (it should fail ❌️) **9.1.0** - `gh pr checkout 210386` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Try adding an item to KB (it should succeed ✅️) **TODO:** - Add an upgrade test that covers this flow --------- Co-authored-by: Viduni Wickramarachchi <[email protected]> (cherry picked from commit df67a09)
kibanamachine
added a commit
that referenced
this pull request
Feb 17, 2025
…ic_text` bug (#210386) (#211498) # Backport This will backport the following commits from `main` to `8.x`: - [[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)](#210386) <!--- Backport version: 9.6.5 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Søren Louv-Jansen","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-02-17T17:20:50Z","message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462","branchLabelMapping":{"^v9.1.0$":"main","^v8.19.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","backport:prev-major","Team:Obs AI Assistant","v9.1.0"],"title":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug","number":210386,"url":"https://github.com/elastic/kibana/pull/210386","mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/210386","number":210386,"mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}}]}] BACKPORT--> Co-authored-by: Søren Louv-Jansen <[email protected]>
💔 Some backports could not be created
Note: Successful backport PRs will be merged automatically after passing CI. Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Feb 17, 2025
…tic_text` bug (#210386) (#211497) # Backport This will backport the following commits from `main` to `8.18`: - [[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)](#210386) <!--- Backport version: 9.6.5 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Søren Louv-Jansen","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-02-17T17:20:50Z","message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462","branchLabelMapping":{"^v9.1.0$":"main","^v8.19.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","backport:prev-major","Team:Obs AI Assistant","v9.1.0"],"title":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug","number":210386,"url":"https://github.com/elastic/kibana/pull/210386","mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/210386","number":210386,"mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}}]}] BACKPORT--> Co-authored-by: Søren Louv-Jansen <[email protected]>
sorenlouv
added
the
backport:prev-minor
|
Starting backport for target branches: 8.18, 8.x, 9.0 |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 17, 2025
…t` bug (elastic#210386) Closes elastic#210204 This will automatically re-index the knowledge base if upon adding a KB entry there is this error: > The [sparse_vector] field type is not supported on indices created on versions 8.0 to 8.10 That error means that semantic_text is not supported in the given index, and it should therefore be re-indexed. **How to test this PR:** **8.10** - `git checkout -B 8.10 origin/8.10` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` **8.19** - `git checkout -B 8.19 origin/8.x` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Install Knowledge base - Try adding an item to KB (it should fail ❌️) **9.1.0** - `gh pr checkout 210386` - Start Kibana: - `nvm use && yarn kbn bootstrap && yarn start` - Start ES - `nvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"` - Try adding an item to KB (it should succeed ✅️) **TODO:** - Add an upgrade test that covers this flow --------- Co-authored-by: Viduni Wickramarachchi <[email protected]> (cherry picked from commit df67a09)
💔 Some backports could not be created
Note: Successful backport PRs will be merged automatically after passing CI. Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Feb 17, 2025
…ic_text` bug (#210386) (#211509) # Backport This will backport the following commits from `main` to `9.0`: - [[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)](#210386) <!--- Backport version: 9.6.5 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Søren Louv-Jansen","email":"[email protected]"},"sourceCommit":{"committedDate":"2025-02-17T17:20:50Z","message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462","branchLabelMapping":{"^v9.1.0$":"main","^v8.19.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","v9.0.0","backport:prev-minor","Team:Obs AI Assistant","backport:version","v8.18.0","v9.1.0","v8.19.0"],"title":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug","number":210386,"url":"https://github.com/elastic/kibana/pull/210386","mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/211504","number":211504,"state":"OPEN"},{"branch":"8.18","label":"v8.18.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/211497","number":211497,"state":"MERGED","mergeCommit":{"sha":"bac6d90d65f350bb58e999ebf63a977bc4e6714f","message":"[8.18] [Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386) (#211497)\n\n# Backport\n\nThis will backport the following commits from `main` to `8.18`:\n- [[Obs AI Assistant] Add KB re-indexing when encountering\n`semantic_text` bug\n(#210386)](https://github.com/elastic/kibana/pull/210386)\n\n<!--- Backport version: 9.6.5 -->\n\n### Questions ?\nPlease refer to the [Backport tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n<!--BACKPORT [{\"author\":{\"name\":\"Søren\nLouv-Jansen\",\"email\":\"[email protected]\"},\"sourceCommit\":{\"committedDate\":\"2025-02-17T17:20:50Z\",\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\",\"branchLabelMapping\":{\"^v9.1.0$\":\"main\",\"^v8.19.0$\":\"8.x\",\"^v(\\\\d+).(\\\\d+).\\\\d+$\":\"$1.$2\"}},\"sourcePullRequest\":{\"labels\":[\"release_note:fix\",\"backport:prev-major\",\"Team:Obs\nAI Assistant\",\"v9.1.0\"],\"title\":\"[Obs AI Assistant] Add KB re-indexing\nwhen encountering `semantic_text`\nbug\",\"number\":210386,\"url\":\"https://github.com/elastic/kibana/pull/210386\",\"mergeCommit\":{\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\"}},\"sourceBranch\":\"main\",\"suggestedTargetBranches\":[],\"targetPullRequestStates\":[{\"branch\":\"main\",\"label\":\"v9.1.0\",\"branchLabelMappingKey\":\"^v9.1.0$\",\"isSourceBranch\":true,\"state\":\"MERGED\",\"url\":\"https://github.com/elastic/kibana/pull/210386\",\"number\":210386,\"mergeCommit\":{\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\"}}]}]\nBACKPORT-->\n\nCo-authored-by: Søren Louv-Jansen <[email protected]>"}},{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/210386","number":210386,"mergeCommit":{"message":"[Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386)\n\nCloses https://github.com/elastic/kibana/issues/210204\n\nThis will automatically re-index the knowledge base if upon adding a KB\nentry there is this error:\n\n> The [sparse_vector] field type is not supported on indices created on\nversions 8.0 to 8.10\n\nThat error means that semantic_text is not supported in the given index,\nand it should therefore be re-indexed.\n\n**How to test this PR:**\n\n**8.10**\n- `git checkout -B 8.10 origin/8.10`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n\n**8.19**\n- `git checkout -B 8.19 origin/8.x`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Install Knowledge base\n- Try adding an item to KB (it should fail ❌️)\n\n**9.1.0**\n- `gh pr checkout 210386`\n- Start Kibana:\n - `nvm use && yarn kbn bootstrap && yarn start`\n- Start ES\n- `nvm use && yarn es snapshot --license trial --E\npath.data=\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\"`\n- Try adding an item to KB (it should succeed ✅️)\n\n**TODO:**\n\n- Add an upgrade test that covers this flow\n\n---------\n\nCo-authored-by: Viduni Wickramarachchi <[email protected]>","sha":"df67a09afab22521dfa9ff3ec3a4f624a039c462"}},{"branch":"8.x","label":"v8.19.0","branchLabelMappingKey":"^v8.19.0$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/211498","number":211498,"state":"MERGED","mergeCommit":{"sha":"ddd2ccd0a4246d5e4f2bc73f6e9716ee666025e2","message":"[8.x] [Obs AI Assistant] Add KB re-indexing when encountering `semantic_text` bug (#210386) (#211498)\n\n# Backport\n\nThis will backport the following commits from `main` to `8.x`:\n- [[Obs AI Assistant] Add KB re-indexing when encountering\n`semantic_text` bug\n(#210386)](https://github.com/elastic/kibana/pull/210386)\n\n<!--- Backport version: 9.6.5 -->\n\n### Questions ?\nPlease refer to the [Backport tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n<!--BACKPORT [{\"author\":{\"name\":\"Søren\nLouv-Jansen\",\"email\":\"[email protected]\"},\"sourceCommit\":{\"committedDate\":\"2025-02-17T17:20:50Z\",\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\",\"branchLabelMapping\":{\"^v9.1.0$\":\"main\",\"^v8.19.0$\":\"8.x\",\"^v(\\\\d+).(\\\\d+).\\\\d+$\":\"$1.$2\"}},\"sourcePullRequest\":{\"labels\":[\"release_note:fix\",\"backport:prev-major\",\"Team:Obs\nAI Assistant\",\"v9.1.0\"],\"title\":\"[Obs AI Assistant] Add KB re-indexing\nwhen encountering `semantic_text`\nbug\",\"number\":210386,\"url\":\"https://github.com/elastic/kibana/pull/210386\",\"mergeCommit\":{\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\"}},\"sourceBranch\":\"main\",\"suggestedTargetBranches\":[],\"targetPullRequestStates\":[{\"branch\":\"main\",\"label\":\"v9.1.0\",\"branchLabelMappingKey\":\"^v9.1.0$\",\"isSourceBranch\":true,\"state\":\"MERGED\",\"url\":\"https://github.com/elastic/kibana/pull/210386\",\"number\":210386,\"mergeCommit\":{\"message\":\"[Obs\nAI Assistant] Add KB re-indexing when encountering `semantic_text` bug\n(#210386)\\n\\nCloses\nhttps://github.com//issues/210204\\n\\nThis will\nautomatically re-index the knowledge base if upon adding a KB\\nentry\nthere is this error:\\n\\n> The [sparse_vector] field type is not\nsupported on indices created on\\nversions 8.0 to 8.10\\n\\nThat error\nmeans that semantic_text is not supported in the given index,\\nand it\nshould therefore be re-indexed.\\n\\n**How to test this\nPR:**\\n\\n**8.10**\\n- `git checkout -B 8.10 origin/8.10`\\n- Start\nKibana:\\n - `nvm use && yarn kbn bootstrap && yarn start`\\n- Start ES\\n-\n`nvm use && yarn es snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n\\n**8.19**\\n-\n`git checkout -B 8.19 origin/8.x`\\n- Start Kibana:\\n - `nvm use && yarn\nkbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn es snapshot\n--license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nInstall Knowledge base\\n- Try adding an item to KB (it should fail\n❌️)\\n\\n**9.1.0**\\n- `gh pr checkout 210386`\\n- Start Kibana:\\n - `nvm\nuse && yarn kbn bootstrap && yarn start`\\n- Start ES\\n- `nvm use && yarn\nes snapshot --license trial\n--E\\npath.data=\\\"/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing\\\"`\\n-\nTry adding an item to KB (it should succeed ✅️)\\n\\n**TODO:**\\n\\n- Add an\nupgrade test that covers this flow\\n\\n---------\\n\\nCo-authored-by:\nViduni Wickramarachchi\n<[email protected]>\",\"sha\":\"df67a09afab22521dfa9ff3ec3a4f624a039c462\"}}]}]\nBACKPORT-->\n\nCo-authored-by: Søren Louv-Jansen <[email protected]>"}}]}] BACKPORT--> Co-authored-by: Søren Louv-Jansen <[email protected]>
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 18, 2025
…dated (elastic#211523) Follow-up to elastic#210386 Closes: elastic#211525 This ensures that we don't start executing the knowledge base migration until index assets have been updated (cherry picked from commit 4cd9ef3)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 18, 2025
…dated (elastic#211523) Follow-up to elastic#210386 Closes: elastic#211525 This ensures that we don't start executing the knowledge base migration until index assets have been updated (cherry picked from commit 4cd9ef3)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 18, 2025
…dated (elastic#211523) Follow-up to elastic#210386 Closes: elastic#211525 This ensures that we don't start executing the knowledge base migration until index assets have been updated (cherry picked from commit 4cd9ef3)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes #210204
This will automatically re-index the knowledge base if upon adding a KB entry there is this error:
That error means that semantic_text is not supported in the given index, and it should therefore be re-indexed.
How to test this PR:
8.10
git checkout -B 8.10 origin/8.10nvm use && yarn kbn bootstrap && yarn startnvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"8.19
git checkout -B 8.19 origin/8.xnvm use && yarn kbn bootstrap && yarn startnvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"9.1.0
gh pr checkout 210386nvm use && yarn kbn bootstrap && yarn startnvm use && yarn es snapshot --license trial --E path.data="/Users/sorenlouv/elastic/kbn_es_data/upgrade_testing"TODO: