Skip to content

test: fix flaky test-benchmark-es#17516

Closed
Trott wants to merge 1 commit into
nodejs:masterfrom
Trott:fix-es-bench-test
Closed

test: fix flaky test-benchmark-es#17516
Trott wants to merge 1 commit into
nodejs:masterfrom
Trott:fix-es-bench-test

Conversation

@Trott
Copy link
Copy Markdown
Member

@Trott Trott commented Dec 7, 2017

Allow zero iterations for short benchmark in test.

Checklist
  • make -j4 test (UNIX), or vcbuild test (Windows) passes
  • commit message follows commit guidelines
Affected core subsystem(s)

test benchmark

Allow zero iterations for short benchmark in test.
@Trott Trott added benchmark Issues and PRs related to the benchmark subsystem. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test Issues and PRs related to the tests. labels Dec 7, 2017
@Trott
Copy link
Copy Markdown
Member Author

Trott commented Dec 7, 2017

Sample failure in CI:

https://ci.nodejs.org/job/node-test-commit-linux/14741/nodes=alpine35-container-x64/consoleFull

not ok 148 parallel/test-benchmark-es
  ---
  duration_ms: 3.27
  severity: fail
  stack: |-
    
    es/defaultparams-bench.js
    es/defaultparams-bench.js millions=0.000001 method="": 0.00597760788087823
    
    es/destructuring-bench.js
    es/destructuring-bench.js millions=0.000001 method="": 0.007550075878262576
    
    es/destructuring-object-bench.js
    /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:202
          throw new Error('insufficient clock precision for short benchmark');
          ^
    
    Error: insufficient clock precision for short benchmark
        at Benchmark.end (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:202:13)
        at runNormal (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/es/destructuring-object-bench.js:21:9)
        at main (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/es/destructuring-object-bench.js:43:7)
        at Benchmark.process.nextTick (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:34:28)
        at process._tickCallback (internal/process/next_tick.js:150:11)
        at Function.Module.runMain (module.js:703:11)
        at startup (bootstrap_node.js:195:16)
        at bootstrap_node.js:646:3
    assert.js:42
      throw new errors.AssertionError({
      ^
    
    AssertionError [ERR_ASSERTION]: 1 strictEqual 0
        at ChildProcess.child.on (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/test/common/benchmark.js:25:12)
        at ChildProcess.emit (events.js:126:13)
        at Process.ChildProcess._handle.onexit (internal/child_process.js:209:12)
  ...
@Trott
Copy link
Copy Markdown
Member Author

Trott commented Dec 7, 2017

Trott added a commit to Trott/io.js that referenced this pull request Dec 9, 2017
Allow zero iterations for short benchmark in test.

PR-URL: nodejs#17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@Trott
Copy link
Copy Markdown
Member Author

Trott commented Dec 9, 2017

Landed in f01e9e7

@Trott Trott closed this Dec 9, 2017
MylesBorins pushed a commit that referenced this pull request Dec 12, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
MylesBorins pushed a commit that referenced this pull request Dec 12, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@MylesBorins MylesBorins mentioned this pull request Dec 12, 2017
gibfahn pushed a commit that referenced this pull request Dec 20, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@gibfahn gibfahn mentioned this pull request Dec 20, 2017
gibfahn pushed a commit that referenced this pull request Dec 20, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@gibfahn gibfahn mentioned this pull request Dec 20, 2017
@Trott Trott deleted the fix-es-bench-test branch January 13, 2022 22:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmark Issues and PRs related to the benchmark subsystem. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test Issues and PRs related to the tests.

4 participants