Skip to content

Commit

Permalink
Update test_tokenizer.py
Browse files Browse the repository at this point in the history
  • Loading branch information
jspisak authored Apr 3, 2024
1 parent 0627c1c commit 565d104
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions llama/test_tokenizer.py
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@
# Copyright (c) Meta Platforms, Inc. and affiliates.
# This software may be used and distributed in accordance with the terms of the Llama 3 Community License Agreement.

import os
from unittest import TestCase
from llama.tokenizer import ChatFormat, Tokenizer
Expand Down

0 comments on commit 565d104

Please sign in to comment.