updating perf baseline to 0.29.0 (semgrep#1911)

* updating perf baseline to 0.29.0 * switching back to 5% slower as compared to 10% Co-authored-by: Colleen Dai <[email protected]>
tbugfinder · Oct 28, 2020 · dc970d2 · dc970d2
1 parent d1240f3
commit dc970d2
Show file tree

Hide file tree

Showing 2 changed files with 3 additions and 3 deletions.
diff --git a/.github/workflows/tests.yml b/.github/workflows/tests.yml
@@ -149,7 +149,7 @@ jobs:
           python-version: ${{ matrix.python }}
       - name: Run 0.17.0 Timing Benchmark
         run: |
-          pip3 install semgrep==0.17.0
+          pip3 install semgrep==0.29.0
           semgrep --version
           semgrep-core -version
           python3 -m semgrep --version

diff --git a/scripts/compare_perf.py b/scripts/compare_perf.py
@@ -19,8 +19,8 @@ def main() -> None:
     for baseline_time, latest_time in zip(baseline_times, latest_times):
         print(f"Baseline: {baseline_time}, Latest: {latest_time}")
 
-        # Assert latest time is not more than 10% slower than baseline
-        assert latest_time < baseline_time * 1.1
+        # Assert latest time is not more than 5% slower than baseline
+        assert latest_time < baseline_time * 1.05
 
 
 if __name__ == "__main__":