Commit graph

15 commits

Author SHA1 Message Date
Henrik Kjellander
90fd7d84fd Rename tools-webrtc -> tools_webrtc
This aligns with established naming convention for all
other directories.

BUG=webrtc:7593
NOTRY=True
NOTREECHECKS=True
R=ehmaldonado@webrtc.org, mbonadei@webrtc.org
TBR=henrika@webrtc.org

Review-Url: https://codereview.webrtc.org/2864213004 .
Cr-Commit-Position: refs/heads/master@{#18059}
2017-05-09 06:30:13 +00:00
kjellander
461a560f22 Enable LSan leak checking for ASan bots.
We seem to have lost the LSan leak detection when we migrated
our tests to Swarming last year. Too many layers of wrapping scripts
are involved in this

BUG=chromium:718839
NOTRY=True

Review-Url: https://codereview.webrtc.org/2868443002
Cr-Commit-Position: refs/heads/master@{#18032}
2017-05-05 13:39:16 +00:00
ehmaldonado
2a28035627 Add --retry_failed=3 flag to gtest-parallel.
This means the test will be executed 4 times max, one run and three retries.

BUG=chromium:718339

Review-Url: https://codereview.webrtc.org/2861043002
Cr-Commit-Position: refs/heads/master@{#18028}
2017-05-05 11:33:57 +00:00
ehmaldonado
76e60e928f Don't duplicate gtest-parallel flags in gtest-parallel-wrappers.
Also, move the --timeout=900 flag from the recipe to the mb.py script. That way it is passed as an arg to gtest-parallel and not to the test executable.

BUG=webrtc:7568
NOTRY=True

Review-Url: https://codereview.webrtc.org/2862803002
Cr-Commit-Position: refs/heads/master@{#18015}
2017-05-04 13:18:26 +00:00
ehmaldonado
950614eb0c Don't display colors on gtest-parallel logs on swarming.
It makes the logs hard to read, and swarming doesn't output colors anyway.

Also:
- Fix a bug where we tried to access output_dir when combining the logs even if the flag was not set.
- Update a comment explaining why we just 'eat' the --isolated-script-test-chartjson-output flag.

NOTRY=True
BUG=webrtc:7524

Review-Url: https://codereview.webrtc.org/2843263005
Cr-Commit-Position: refs/heads/master@{#17973}
2017-05-02 12:52:57 +00:00
kjellander
382f2b2c45 Fix swarming tests not running in parallel
Due to recent Chrome infra changes in
https://chromium-review.googlesource.com/c/472290/
tests running on swarming are now assumed to emit JSON results
or will be marked as failing. This requires us to use our
gtest-parallel wrapper for all our Swarming tests
(or implement the --isolated-script-test-output flag, which
normally only is implemented by the Chromium test launcher).

The low_bandwidth_audio_test can actually run in parallel,
so just change that.

The webrtc_nonparallel_tests cannot, so this CL changes MB
to pass --workers=1 flag to gtest-parallel, which makes the
tests run in sequence. This adds a little confusion but the root
problem is really that our gtest-parallel script [1] does a lot more
than just running the tests in parallel these days, so it should
probably be renamed.

Also make sure gtest-parallel-wrapper.py [2] consumes the
--isolated-script-test-chartjson-output flag (unused) so we don't
pass it on to the test executable.

[1]: https://chromium.googlesource.com/external/github.com/google/gtest-parallel/+/master/gtest-parallel
[2]: https://chromium.googlesource.com/external/webrtc/+/master/tools-webrtc/gtest-parallel-wrapper.py

BUG=709988
TBR=ehmaldonado@webrtc.org
NOTRY=True

Review-Url: https://codereview.webrtc.org/2806373002
Cr-Commit-Position: refs/heads/master@{#17646}
2017-04-11 11:07:01 +00:00
ehmaldonado
3ff7a95552 Use Chromium's mirror of github for gtest-parallel.
- Move gtest-parallel-wrapper.py to tools-webrtc.
- Update mb.py and mb_unittest.py

BUG=webrtc:7391
NOTRY=True
R=kjellander@webrtc.org

Review-Url: https://codereview.webrtc.org/2785653002
Cr-Commit-Position: refs/heads/master@{#17453}
2017-03-29 16:42:32 +00:00
kjellander
f9e2a36229 Roll chromium_revision 22b81f6c45..d604de96c9 (459032:459307)
MB changes were needed due to https://codereview.chromium.org/2767833002
FullStackTest.ScreenshareSlidesVP9_2SL
test was disabled due to libvpx regression, see webrtc:7401.

Roll chromium_revision 22b81f6c45..d604de96c9 (459032:459307)

Change log: 22b81f6c45..d604de96c9
Full diff: 22b81f6c45..d604de96c9

Changed dependencies:
* src/base: 258342709c..d49079a0cb
* src/build: 4a2354d6ce..a18678dc18
* src/ios: f825ec1419..4afbbbaa88
* src/testing: 83a00745ef..7a028befe4
* src/third_party: 5c1951e265..5903b09f59
* src/third_party/catapult: 1b6a20ab7e..5c300b0898
* src/third_party/ffmpeg: b9acb5c51e..6d2e444456
* src/third_party/libvpx/source/libvpx: 8121f85473..2fac50fa0e
* src/tools: a4f9a9e9e9..3a6ca3a28a
DEPS diff: 22b81f6c45..d604de96c9/DEPS

No update to Clang.

TBR=marpan@webrtc.org,
BUG=webrtc:7401

Review-Url: https://codereview.webrtc.org/2777553002
Cr-Commit-Position: refs/heads/master@{#17376}
2017-03-24 19:17:33 +00:00
kjellander
8430825856 Roll chromium_revision 0036d9b08e..2d05f4450c (457220:457366)
Reverting MB changes from https://codereview.webrtc.org/2755433005/
since https://codereview.chromium.org/2695963003 was reverted.

Change log: 0036d9b08e..2d05f4450c
Full diff: 0036d9b08e..2d05f4450c

Changed dependencies:
* src/base: 921d4dc4be..536da69816
* src/build: 15d5fcab1c..81c2772699
* src/ios: 6f28a4ab1b..bee9511bdb
* src/testing: 3cc4ea5920..6d32ea1500
* src/third_party: 95b8b082f7..eccad07478
* src/third_party/catapult: 76b86f523b..faf60eb37f
* src/tools: 04c6d654f7..b06789b11a
DEPS diff: 0036d9b08e..2d05f4450c/DEPS

No update to Clang.

TBR=
BUG=None
NOTRY=True

Review-Url: https://codereview.webrtc.org/2753773005
Cr-Commit-Position: refs/heads/master@{#17268}
2017-03-16 08:35:09 +00:00
kjellander
9f8a566316 Roll chromium_revision 981ff3850e..99c1f4221e (456928:457015)
MB was updated to accomodate changes in https://codereview.chromium.org/2695963003

Change log: 981ff3850e..99c1f4221e
Full diff: 981ff3850e..99c1f4221e

Changed dependencies:
* src/base: be5cf86ede..6d7c22c4f5
* src/build: 2744073131..e8b5e58534
* src/ios: 65ada1572f..8d1f4a15e6
* src/testing: 3d76f6cb4c..d6eb1e0a11
* src/third_party: 779bb26879..24999c043d
* src/tools: f2d0d63fdc..2ffeda5cdc
DEPS diff: 981ff3850e..99c1f4221e/DEPS

No update to Clang.

TBR=
BUG=None
NOTRY=True

Review-Url: https://codereview.webrtc.org/2755433005
Cr-Commit-Position: refs/heads/master@{#17238}
2017-03-15 09:31:11 +00:00
kjellander
1c3548c67c Reland of iOS: Use JSON for GN configuration instead of MB + remove symbols
Reason for revert:
MB is now updated to handle spaces in the buildername properly, something that
only affected our commit bots (not trybots).

Original issue's description:
> Revert of iOS: Use JSON for GN configuration instead of MB + remove symbols (patchset #4 id:80001 of https://codereview.webrtc.org/2688103002/ )
>
> Reason for revert:
> Something is different from trybots vs the commit bots, causing it to fail when running GN:
> https://build.chromium.org/p/client.webrtc/builders/iOS32%20Release/builds/10151
>
> Original issue's description:
> > iOS: Use JSON for GN configuration instead of MB + remove symbols.
> >
> > This aligns with how the ios recipe module is used in Chromium.
> > It should prevent breakages like one we had recently.
> >
> > It also means we're no longer setting symbol_level=1 explicitly.
> > The default is 0 (no symbols), which is now what's being used.
> >
> > Also move all the directories containing JSON files into
> > tools-webrtc/ios/bots to make it clearer (and more similar to
> > Chromium).
> >
> > BUG=webrtc:7140, webrtc:7161
> > NOTRY=True
> >
> > Review-Url: https://codereview.webrtc.org/2688103002
> > Cr-Commit-Position: refs/heads/master@{#16633}
> > Committed: 73f01de4ed
>
> TBR=ehmaldonado@webrtc.org
> # Skipping CQ checks because original CL landed less than 1 days ago.
> NOPRESUBMIT=true
> NOTREECHECKS=true
> NOTRY=true
> BUG=webrtc:7140, webrtc:7161
>
> Review-Url: https://codereview.webrtc.org/2694423002
> Cr-Commit-Position: refs/heads/master@{#16634}
> Committed: 68ab366547

TBR=ehmaldonado@webrtc.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=webrtc:7140, webrtc:7161

Review-Url: https://codereview.webrtc.org/2697133002
Cr-Commit-Position: refs/heads/master@{#16636}
2017-02-16 06:38:22 +00:00
kjellander
68ab366547 Revert of iOS: Use JSON for GN configuration instead of MB + remove symbols (patchset #4 id:80001 of https://codereview.webrtc.org/2688103002/ )
Reason for revert:
Something is different from trybots vs the commit bots, causing it to fail when running GN:
https://build.chromium.org/p/client.webrtc/builders/iOS32%20Release/builds/10151

Original issue's description:
> iOS: Use JSON for GN configuration instead of MB + remove symbols.
>
> This aligns with how the ios recipe module is used in Chromium.
> It should prevent breakages like one we had recently.
>
> It also means we're no longer setting symbol_level=1 explicitly.
> The default is 0 (no symbols), which is now what's being used.
>
> Also move all the directories containing JSON files into
> tools-webrtc/ios/bots to make it clearer (and more similar to
> Chromium).
>
> BUG=webrtc:7140, webrtc:7161
> NOTRY=True
>
> Review-Url: https://codereview.webrtc.org/2688103002
> Cr-Commit-Position: refs/heads/master@{#16633}
> Committed: 73f01de4ed

TBR=ehmaldonado@webrtc.org
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG=webrtc:7140, webrtc:7161

Review-Url: https://codereview.webrtc.org/2694423002
Cr-Commit-Position: refs/heads/master@{#16634}
2017-02-15 20:45:35 +00:00
kjellander
73f01de4ed iOS: Use JSON for GN configuration instead of MB + remove symbols.
This aligns with how the ios recipe module is used in Chromium.
It should prevent breakages like one we had recently.

It also means we're no longer setting symbol_level=1 explicitly.
The default is 0 (no symbols), which is now what's being used.

Also move all the directories containing JSON files into
tools-webrtc/ios/bots to make it clearer (and more similar to
Chromium).

BUG=webrtc:7140, webrtc:7161
NOTRY=True

Review-Url: https://codereview.webrtc.org/2688103002
Cr-Commit-Position: refs/heads/master@{#16633}
2017-02-15 20:34:03 +00:00
ehmaldonado
5583384048 Pass isolate output dir to gtest-parallel-wrapper.py
This makes it possible to archive all test execution logs on swarming jobs.

R=kjellander@webrtc.org
BUG=webrtc:7086
NOTRY=True

Review-Url: https://codereview.webrtc.org/2686563002
Cr-Commit-Position: refs/heads/master@{#16574}
2017-02-13 11:58:13 +00:00
Henrik Kjellander
b2d5577caf Move tools/mb -> tools-webrtc/mb
In addition to moving tools/mb -> tools-webrtc/mb, also
move webrtc/build/mb_config.pyl into tools-webrtc/mb
to match the default location better.
Remove Chromium-specific check for 'mb validate' that failed
due to doing this (we never cleaned that when we forked the code).

BUG=webrtc:5006
TBR=ehmaldonado@webrtc.org
NOTRY=True
TESTED=Manually ran:
tools-webrtc/mb/mb.py gen -m client.webrtc -b 'iOS64 Release' --config-file tools-webrtc/mb/mb_config.pyl  //out/Release-iphoneos
tools-webrtc/mb/mb.py gen -m client.webrtc -b 'Mac64 Release' --config-file tools-webrtc/mb/mb_config.pyl  //out/Release-mac

Review-Url: https://codereview.webrtc.org/2585743002 .
Cr-Commit-Position: refs/heads/master@{#15664}
2016-12-18 21:14:50 +00:00
Renamed from tools/mb/mb_unittest.py (Browse further)