fix comment

wangxuebing0906 · Jun 21, 2023 · 1cc00e6 · 1cc00e6
1 parent 0929e6c
commit 1cc00e6
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/olmo/data/memmap_dataset.py b/olmo/data/memmap_dataset.py
@@ -22,7 +22,7 @@ class MemMapDataset(Dataset[Dict[str, Any]]):
     remainder of the tokens will be ignored.
 
     No special tokens are added to the input IDs so it's assumed that if you want
-    EOS tokens between documents, for example, those will already by in the memory-mapped array.
+    EOS tokens between documents, for example, those will already be in the memory-mapped array.
 
     :param paths: Paths to memory-mapped token arrays.
     :param chunk_size: The number of tokens to chunk together into a single instance.