Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: bigcode-project/bigcodebench
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: network
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 16 commits
  • 5 files changed
  • 2 contributors

Commits on Jul 11, 2024

  1. add ids that do not use the network functionality

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    0343fa9 View commit details
    Browse the repository at this point in the history

  2. filter instances that use network, add offline param in the function

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    b2a1b6f View commit details
    Browse the repository at this point in the history

  3. fix unused version argument in get_bigcodebench_hash

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    121a1bb View commit details
    Browse the repository at this point in the history

  4. move the filtering inside make_cache to handle both when gh is true… 

    … and false
    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    73c0b4f View commit details
    Browse the repository at this point in the history

  5. add offline argument when calling make_cache

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    c7e7c90 View commit details
    Browse the repository at this point in the history

  6. add --offline in the parser argument, add offline in the codegen … 

    …param and get_bigcodebench invocation
    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    dc960a0 View commit details
    Browse the repository at this point in the history

  7. add --offline argument in the parser

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    b03fb74 View commit details
    Browse the repository at this point in the history

  8. add offline argument when invoking get_bigcodebench

    @imamnurby
    imamnurby committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    88c8303 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2024

  1. move ids to constant.py

    @imamnurby
    imamnurby committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    ee0a116 View commit details
    Browse the repository at this point in the history

  2. remove network-free-set.txt

    @imamnurby
    imamnurby committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    f61cc77 View commit details
    Browse the repository at this point in the history

  3. replace reading ids from the txt file with importing OFFLINE_IDS fr… 

    …om `constant.py`
    @imamnurby
    imamnurby committed Jul 13, 2024
    Configuration menu
    Copy the full SHA
    b61b23c View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Delete bigcodebench/data/create_ids.ipynb

    @terryyz
    terryyz authored Jul 16, 2024
    Configuration menu
    Copy the full SHA
    c02f0d0 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. merge main

    @imamnurby
    imamnurby committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    800bccc View commit details
    Browse the repository at this point in the history

  2. remove BigCodeBench/

    @imamnurby
    imamnurby committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    d951246 View commit details
    Browse the repository at this point in the history

  3. remove BigCodeBench/ when getting the instance id

    @imamnurby
    imamnurby committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    b3734b8 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. feat: add --offline 

    Add network free set
    @terryyz
    terryyz authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    625cf09 View commit details
    Browse the repository at this point in the history
Loading