Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: pytorch-labs/tokenizers
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: pytorch-labs/tokenizers
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: jz/test
Choose a head ref
  • 9 commits
  • 23 files changed
  • 1 contributor

Commits on Apr 15, 2025

  1. Add regex interface

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    934ffa3 View commit details
    Browse the repository at this point in the history

  2. Use IRegex interface

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    a78b408 View commit details
    Browse the repository at this point in the history

  3. Rename re2_regex.cpp (?)

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    6fdaa9f View commit details
    Browse the repository at this point in the history

  4. Fix seg fault

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    2d3899d View commit details
    Browse the repository at this point in the history

  5. Lint

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    fc4d926 View commit details
    Browse the repository at this point in the history

  6. Remove code

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    edd7c99 View commit details
    Browse the repository at this point in the history

  7. Add pcre2 as default re2 fallback

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    5d83d3e View commit details
    Browse the repository at this point in the history

  8. Lint

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    c3762c8 View commit details
    Browse the repository at this point in the history

  9. Make test general

    @jackzhxng
    jackzhxng committed Apr 15, 2025
    Configuration menu
    Copy the full SHA
    355c49a View commit details
    Browse the repository at this point in the history
Loading