Skip to content

Tags: inflaton/ragas_extended

Tags

v0.1.0rc1

Toggle v0.1.0rc1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
fix: answer_correctness embedding (explodinggradients#513)

v0.0.22

Toggle v0.0.22's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
fix: handle edge cases in prompt processing (explodinggradients#374)

v0.0.21

Toggle v0.0.21's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Make testgenerator output compatible with evaluate (explodinggradient…

…s#302)

* Changed context from str to List[str] so that it is consistent with
eval. Now output of TestDataset can be used for evaluation.
*  Changed typo in _generate_doc_nodes_map
* Changed TestDataset class to reflect the changes in test set
generation. Drawback is episode_done will be True in all cases as data
is changed at the level above.

v0.0.20

Toggle v0.0.20's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
chore: pin OpenAI to >1 (explodinggradients#285)

v0.0.19

Toggle v0.0.19's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Fix typos in langfuse.ipynb (explodinggradients#237)

v0.0.18

Toggle v0.0.18's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
fix: remove limit on pydantic 2.0 (explodinggradients#209)

v0.0.17

Toggle v0.0.17's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
testset generation: bug fixes (explodinggradients#185)

Fixes 

- [x] issues with multi-context question generation  
- [x] Error in doc filtering

v0.0.16

Toggle v0.0.16's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Testset generation: documentation (explodinggradients#158)

v0.0.15

Toggle v0.0.15's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
ZeroDivisionError in context_relevance (explodinggradients#154)

Changed: python3.9/site-packages/ragas/metrics/context_relevance.py",
line 162, in _score_batch

From: `score = min(len(indices) / len(context_sents), 1)`

To: ``` if len(context_sents) == 0:
                        score = 0
                else:
score = min(len(indices) / len(context_sents), 1)```

fixes: explodinggradients#153

Co-authored-by: devtribble <[email protected]>

v0.0.14

Toggle v0.0.14's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Fix remap_column_names (explodinggradients#140)

When I try to do the following, I got error:

```python
ds = Dataset.from_dict(
    {
        "question": ["question"],
        "answer": ["answer"],
        "contexts": [["context"]],
    }
)

from ragas import evaluate
from ragas.metrics import Faithfulness

evaluate(dataset =ds, metrics=[Faithfulness(batch_size=1)])
```

```
KeyError: "Column ground_truths not in the dataset. Current columns in the dataset: ['question', 'answer', 'contexts']"
```
But `ground_truths ` is not needed for `Faithfulness` .

This PR is to fix it.