Skip to content

Tags: PubliusAu/ragas

Tags

v0.1.1

Toggle v0.1.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
feat(llms.json_load): Recursively load json lists (explodinggradients…

…#593)

Slightly broken json are protected against by the function
`ragas.llms.json_load.JsonLoader._find_outermost_json`. However, I've
found that for many metrics, gpt4 can often return slightly broken json
lists, for which this function returns only the first valid json. Here
we wrap `_find_outermost_json` with `_load_all_jsons` which calls it
recursively to load the full json list.

I.e. expected output for `'{"1":"2"}, ,, {"3":"4"}]'` is `[{'1': '2'},
{'3': '4'}]`

---------

Co-authored-by: jjmachan <[email protected]>

v0.1.0

Toggle v0.1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
fix: raise `ExceptionInRunner` if executor faces any issues (explodin…

…ggradients#569)

v0.1.0rc1

Toggle v0.1.0rc1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
fix: answer_correctness embedding (explodinggradients#513)

v0.0.22

Toggle v0.0.22's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
fix: handle edge cases in prompt processing (explodinggradients#374)

v0.0.21

Toggle v0.0.21's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Make testgenerator output compatible with evaluate (explodinggradient…

…s#302)

* Changed context from str to List[str] so that it is consistent with
eval. Now output of TestDataset can be used for evaluation.
*  Changed typo in _generate_doc_nodes_map
* Changed TestDataset class to reflect the changes in test set
generation. Drawback is episode_done will be True in all cases as data
is changed at the level above.

v0.0.20

Toggle v0.0.20's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
chore: pin OpenAI to >1 (explodinggradients#285)

v0.0.19

Toggle v0.0.19's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Fix typos in langfuse.ipynb (explodinggradients#237)

v0.0.18

Toggle v0.0.18's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
fix: remove limit on pydantic 2.0 (explodinggradients#209)

v0.0.17

Toggle v0.0.17's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
testset generation: bug fixes (explodinggradients#185)

Fixes 

- [x] issues with multi-context question generation  
- [x] Error in doc filtering

v0.0.16

Toggle v0.0.16's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Testset generation: documentation (explodinggradients#158)