Commit graph

49 commits

Author SHA1 Message Date
Christoffer Jansson
a45a7cbc0d Add fuchsia bot
No-Try: true
Bug: b/232740856
Change-Id: I5b4c9b41395466e68e00a7e63fffb26eb31d8313
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/274401
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#38028}
2022-09-07 12:44:00 +00:00
Jeremy Leconte
1ab4e873e4 Run svc_tests on 4 shards.
The tests are sometimes hiting timeouts on msan runs:
https://chromium-swarm.appspot.com/task?id=5d02a893ec864210

Change-Id: I16f15f3ab5750bdcc37a1cd1e32846adb2fb7602
Bug: webrtc:11607
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/273343
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37935}
2022-08-29 20:24:04 +00:00
Jeremy Leconte
b61f39e00e Remove process_perf_results_py2 now that recipe code is using py3.
Change-Id: I04085a3b773bac84b3b1da1a702f1a441fc2a097
Bug: webrtc:13835
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272960
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37904}
2022-08-25 13:30:34 +00:00
Jeremy Leconte
df4dc3ca6b Add a win10-any mixins that don't specify the version.
This is to fix "Win32 Release (Clang)" and "Perf Win7" bots that cannot find resources.

Change-Id: I0db4719d508b70c78f4357b28a69d3d711ca9be3
Bug: webrtc:14384
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272362
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37832}
2022-08-19 07:38:56 +00:00
Jeremy Leconte
5414cce0a1 Migrate iOS and Mac tests from mac-11 to mac-12 machines
Also remove unused mixins.

Bug: b/233192409
Change-Id: I959916b98cebd417088fb7804dc1f44f64134555
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/272241
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37826}
2022-08-18 14:41:56 +00:00
Austin Orion
81797744fd Reland "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit dd32562f24.

Reason for revert: Updated the original change to dynamically load
the CoreMessaging.dll instead of statically linking with the .lib.

Original change's description:
> Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
>
> This reverts commit 93bb305149.
>
> Reason for revert: It breaks a test while rolling into Chromium,
> see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.
>
> Original change's description:
> > Wait for frames to arrive in WgcCapturer instead of returning nothing.
> >
> > We're seeing a high instance of "first capture failed" in Chromium when
> > using WGC. We can reduce this by waiting for frames to arrive if there
> > are none in the frame pool instead of returning a temporary error.
> >
> > I've set the maximum time to wait for a frame to 50ms. If no frame
> > arrives before 50ms has elapsed, we will return a temporary error.
> > Added a new test, FirstCaptureSucceeds, to verify that this is working
> > as expected.
> >
> > As part of this I updated the name of the `kCreateFreeThreadedFailed`
> > enum value to `kCreateFramePoolFailed`. The value remains the same
> > since they both report failures in frame pool creation.
> >
> > I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> > store two frames. This should prevent us from having to wait on the
> > event as frequently. This will increase the latency between capture
> > and display, however. High frame rate applications should not be
> > noticeably affected.
> >
> > Additionally, we uncovered a bug in the OS that prevents window capture
> > when there are displays attached, but none of them are active. Added
> > a new check to `IsWgcSupported` to cover this scenario.
> >
> > Finally, some issues with other WGC tests blocked moving the TryBots
> > to a newer version of Windows. This CL fixes those issues and updates
> > the TryBot configuration.
> >
> > bug: chromium:1314868
> > Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> > Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> > Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> > Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> > Commit-Queue: Austin Orion <auorion@microsoft.com>
> > Reviewed-by: Jeremy Leconte <jleconte@google.com>
> > Cr-Commit-Position: refs/heads/main@{#37404}
>
> Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
> Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
> Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
> Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
> Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#37408}

Change-Id: I6cc2becd9ed363782ab2f326f58d9401bc8fb820
Bug: chromium:1314868
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267902
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Cr-Commit-Position: refs/heads/main@{#37470}
2022-07-06 20:28:26 +00:00
Mirko Bonadei
dd32562f24 Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit 93bb305149.

Reason for revert: It breaks a test while rolling into Chromium,
see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.

Original change's description:
> Wait for frames to arrive in WgcCapturer instead of returning nothing.
>
> We're seeing a high instance of "first capture failed" in Chromium when
> using WGC. We can reduce this by waiting for frames to arrive if there
> are none in the frame pool instead of returning a temporary error.
>
> I've set the maximum time to wait for a frame to 50ms. If no frame
> arrives before 50ms has elapsed, we will return a temporary error.
> Added a new test, FirstCaptureSucceeds, to verify that this is working
> as expected.
>
> As part of this I updated the name of the `kCreateFreeThreadedFailed`
> enum value to `kCreateFramePoolFailed`. The value remains the same
> since they both report failures in frame pool creation.
>
> I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> store two frames. This should prevent us from having to wait on the
> event as frequently. This will increase the latency between capture
> and display, however. High frame rate applications should not be
> noticeably affected.
>
> Additionally, we uncovered a bug in the OS that prevents window capture
> when there are displays attached, but none of them are active. Added
> a new check to `IsWgcSupported` to cover this scenario.
>
> Finally, some issues with other WGC tests blocked moving the TryBots
> to a newer version of Windows. This CL fixes those issues and updates
> the TryBot configuration.
>
> bug: chromium:1314868
> Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> Commit-Queue: Austin Orion <auorion@microsoft.com>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#37404}

Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37408}
2022-07-02 07:41:21 +00:00
Austin Orion
93bb305149 Wait for frames to arrive in WgcCapturer instead of returning nothing.
We're seeing a high instance of "first capture failed" in Chromium when
using WGC. We can reduce this by waiting for frames to arrive if there
are none in the frame pool instead of returning a temporary error.

I've set the maximum time to wait for a frame to 50ms. If no frame
arrives before 50ms has elapsed, we will return a temporary error.
Added a new test, FirstCaptureSucceeds, to verify that this is working
as expected.

As part of this I updated the name of the `kCreateFreeThreadedFailed`
enum value to `kCreateFramePoolFailed`. The value remains the same
since they both report failures in frame pool creation.

I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
store two frames. This should prevent us from having to wait on the
event as frequently. This will increase the latency between capture
and display, however. High frame rate applications should not be
noticeably affected.

Additionally, we uncovered a bug in the OS that prevents window capture
when there are displays attached, but none of them are active. Added
a new check to `IsWgcSupported` to cover this scenario.

Finally, some issues with other WGC tests blocked moving the TryBots
to a newer version of Windows. This CL fixes those issues and updates
the TryBot configuration.

bug: chromium:1314868
Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37404}
2022-07-01 17:42:20 +00:00
Mirko Bonadei
68fef2f3e9 Update protobuf-py2_py3 wheel.
This is required after updating protobuf to 3.20.0 in
https://chromium-review.googlesource.com/c/chromium/src/+/3733827.

Bug: b/237760527
Change-Id: I9c4df89b7116dfa934a2c313aaad9c9b88c36787
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267405
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37399}
2022-07-01 15:17:36 +00:00
Andrey Logvin
ba90d025a1 Revert "Temporarily disable video_capture_tests on linux"
This reverts commit 915d419eb9.

Reason for revert: The bots which can run this tests is now working

Original change's description:
> Temporarily disable video_capture_tests on linux
>
> No bots can run linux video_capture_tests for now.
>
> Bug: webrtc:14220
> Change-Id: I5dbdefdd104befff92648a0693bee331d2b50e88
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/266660
> Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
> Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> Reviewed-by: Andrey Logvin <landrey@webrtc.org>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#37312}

Bug: webrtc:14220
Change-Id: I0a7a82cf64b0692be62a38f3df6416a33917c3d5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267105
Owners-Override: Andrey Logvin <landrey@webrtc.org>
Commit-Queue: Andrey Logvin <landrey@webrtc.org>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Cr-Commit-Position: refs/heads/main@{#37369}
2022-06-29 13:35:28 +00:00
Byoungchan Lee
915d419eb9 Temporarily disable video_capture_tests on linux
No bots can run linux video_capture_tests for now.

Bug: webrtc:14220
Change-Id: I5dbdefdd104befff92648a0693bee331d2b50e88
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/266660
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Andrey Logvin <landrey@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37312}
2022-06-23 10:13:52 +00:00
Florent Castelli
90b74389a2 SVC: Add end to end tests for VP8 and VP9
The tests check that the various scalability mode are supported
and the frames are marked properly by the encoder with their
spatial and temporal index.
The same information is then checked on the receiving side.

A new member is added on EncodedImage to store the temporal index,
and is filled by the encoders and retreived by the ref finder
objects on the decoding side.

Bug: webrtc:11607
Change-Id: I7522f6a6fc5402244cab0c4c64b544ce09bc5204
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260189
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Rasmus Brandt <brandtr@webrtc.org>
Reviewed-by: Artem Titov <titovartem@webrtc.org>
Commit-Queue: Florent Castelli <orphis@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37303}
2022-06-22 11:07:01 +00:00
Jeremy Leconte
413ca2b95d Run Mac M1 try jobs.
Also use baremetal pool only for the video_capture_tests.
Currently this test is disabled on the M1 machines because they don't have a camera ready.

Change-Id: Ie34b5a09219d7e0e43ff026bcbdfba922955f8bb
Bug: b/230719743
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265680
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37235}
2022-06-16 13:00:42 +00:00
Christoffer Jansson
b137fb93e8 Add mac11_or_mac12 dimension and apply to all MacOS bots in prep for upgrade
Bug: b/233192409
Change-Id: I65b65ca4f992eef8d0ebc8e1dac90c656269db17
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265662
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#37208}
2022-06-14 12:51:17 +00:00
Jeremy Leconte
72b5dbc44b Don't run quick perf tests on baremetal machines.
Baremetal machines have webcams and it makes it confusing wether webrtc_perf_tests require cameras to run.

Change-Id: I1f3dc05c976ed008079f990b9a55f3310ea73dda
Bug: b/235780120
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265641
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37189}
2022-06-13 08:55:57 +00:00
Jeremy Leconte
35fc144e01 Rename 'iOS64 Sim Debug (iOS 14.0)' bot.
Change-Id: I83bb0dfd0edcc199c2e44d2627bb6945514a6c84
Bug: b/228171822
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/264941
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37104}
2022-06-03 07:17:27 +00:00
Jeremy Leconte
33e5873712 Upgrade iOS bots to xcode 13.
Also update ios 14.0 simulators to 14.5 because tests were failing.

Change-Id: I36c946ff26899502ad611d3f473f3692374b08a4
Bug: b/228171822
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/264830
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37103}
2022-06-03 07:06:37 +00:00
Christoffer Jansson
5ca01b5a5b Use ios_perf_test for M1 arm64 perf tester
Bug: b/232347569
Change-Id: I16fa752ee81d3a331ce2c2d4fe2f4bd9b28a5597
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/263481
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36987}
2022-05-24 14:59:12 +00:00
Jeremy Leconte
fb9ae767aa Reland "Run iOS tests on multiple shards."
This is a reland of commit 5a71f15858

Original change's description:
> Run iOS tests on multiple shards.
>
> Bug: b/230824012
> Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36796}

Bug: b/230824012
Change-Id: I4a8627e87a6f22953238a28a714af3a97de065b9
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261724
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36883}
2022-05-13 13:49:44 +00:00
Christoffer Jansson
598044f9ee Add M1 perf bot
Companion CL: https://chromium-review.googlesource.com/c/chromium/tools/build/+/3634362

Bug: b/230719743
Change-Id: I52babb62dddbcadeb2854720c3c022ee3e04dbec
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260321
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36829}
2022-05-10 08:10:20 +00:00
Jeremy Leconte
58d774ba78 Revert "Run iOS tests on multiple shards."
This reverts commit 5a71f15858.

Reason for revert: Turns out all the tests are running on all the shards.

Original change's description:
> Run iOS tests on multiple shards.
>
> Bug: b/230824012
> Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36796}

Bug: b/230824012
Change-Id: Id353501f07156ccc109abf94e6d2a22014a5e767
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261562
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36807}
2022-05-09 07:40:54 +00:00
Jeremy Leconte
5a71f15858 Run iOS tests on multiple shards.
Bug: b/230824012
Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36796}
2022-05-06 09:55:41 +00:00
Jeremy Leconte
2445602bdf Revert "Migrate iOS simulator tests to Mac-12 machines."
This reverts commit 3466511ee1.

Reason for revert: Pending time can be very long when the test are running at the same time as this builder:
https://luci-milo.appspot.com/p/chromium/builders/ci/ios15-beta-simulator

Original change's description:
> Migrate iOS simulator tests to Mac-12 machines.
>
> Bug: b/227442116
> Change-Id: I7b5157a735596616f9785391c40b8f26974c222d
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260985
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36751}

Bug: b/227442116
Change-Id: I87f27b36db7aa4c6d9d6982a5e86d56648a709e8
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261307
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36795}
2022-05-06 09:38:34 +00:00
Jeremy Leconte
95897aea2f Run peerconnection_unittests on multiple shards.
The shards were removed with https://webrtc-review.googlesource.com/c/src/+/261262 as an experiment.

It turns out the new test target slow_peer_connection_unittests doesn't take much time compared to peerconnection_unittests.
slow_peer_connection_unittests: 7min
peerconnection_unittests: 35min
https://chromium-swarm.appspot.com/tasklist?f=parent_task_id-tag%3A5aad344b2285be11&st=1651756987488

Bug: webrtc:14025
Change-Id: Iaaf2b476ea6fdc419c5b14beb8040c5a0d973952
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261264
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36785}
2022-05-05 15:10:29 +00:00
Harald Alvestrand
f8f7b70050 Create a "slow peerconnection unittests" target
This CL moves all tests that take more than 5 seconds into the new target.

Bug: webrtc:14025
Change-Id: I760d1a270b399b581f41606647740466f6b87e7c
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261262
Commit-Queue: Harald Alvestrand <hta@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36782}
2022-05-05 14:40:38 +00:00
Jeremy Leconte
4ef2de6290 Remove the iOS internal try bots.
Bug: b/230708129
Change-Id: Ic4315997af0c01c5f5d987d13d88ada7d76ab0ea
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260191
Reviewed-by: Mirko Bonadei <mbonadei@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36770}
2022-05-05 07:20:49 +00:00
Jeremy Leconte
3466511ee1 Migrate iOS simulator tests to Mac-12 machines.
Bug: b/227442116
Change-Id: I7b5157a735596616f9785391c40b8f26974c222d
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260985
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36751}
2022-05-04 07:27:25 +00:00
Christoffer Jansson
b45d4deb3b Rename MacOS perf bot to 11 to reflect OS version
Bug: b/227442116
Change-Id: I80cf745a3a38d08c833864d2f8e4533776be2585
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260460
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36702}
2022-04-29 09:24:13 +00:00
Jeremy Leconte
2dad0a1668 Re-enable XCTests sdk_unittests on simulators.
Bug: webrtc:12244
Change-Id: Id5cd44e93cd0221e09380d05da510b05c22e143f
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/259773
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36699}
2022-04-28 19:58:31 +00:00
Christoffer Jansson
69edcaf47b relax dimensions for mac perf bot to allow MacOS 11 upgrade
Bug: b/227442116
Change-Id: I30d8002997519f348988e2867c9a5f4935a265de
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260281
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36688}
2022-04-28 10:17:34 +00:00
Jeremy Leconte
72efd91d1f Re-enable XCTests apprtcmobile_tests on simulators.
Bug: webrtc:12244
Change-Id: Idca6bcc1505b0b9ceadfafbe128d64d53800f34a
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260280
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36684}
2022-04-28 08:31:03 +00:00
Jeremy Leconte
68dcea5f0d Remove the bot 'Perf Linux Trusty'
Bug: chromium:1199405
Change-Id: I0a0ca56b217760cba0db6b1a8b1580bea0edc6a5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260103
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36652}
2022-04-26 08:47:35 +00:00
Jeremy Leconte
424cc65a4a Centralized test command argument in .pyl configuration.
* Remove args from gn_isolate_map.pyl
* Set idempotent to false for performance tests

Bug: webrtc:13899
Change-Id: Icde80af02070e024c1292721db9c0b8a4d906343
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258685
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36531}
2022-04-12 10:43:05 +00:00
Jeremy Leconte
ed1bc59a6e Remove perf tests from the builders.
Also fix wrong iOS bot definition in waterfalls.pyl.

Bug: webrtc:13899
Change-Id: I3146751a49d359cdb17324b53065757b0e93e402
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258661
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36521}
2022-04-11 12:10:57 +00:00
Jeremy Leconte
dad78f8cff Move the readline-timeout to the iOS device instead of simulator.
Also increase the timeout over 10 minutes and increase the bot timeout.
https://chrome-swarming.appspot.com/task?id=5a2118b0119c3b10

Bug: b/228402401
Change-Id: Idf652fd7fa2fc6670011df254836444dfaf553a8
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258420
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36508}
2022-04-08 20:50:25 +00:00
Jeremy Leconte
616bea20e1 Fix missing perftest-output.pb file for Android perf bots.
Bug: webrtc:13899
Change-Id: Ica8fe3f90a80c79b5cd53b755cc0761292664547
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258403
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36507}
2022-04-08 20:48:05 +00:00
Jeremy Leconte
a54171b46b Fix failure on 'MacARM64 M1 Release' bot.
Error when trying to access the try pool from a ci bot:
https://ci.chromium.org/ui/p/webrtc/builders/ci/MacARM64%20M1%20Release/2181/overview

Bug: webrtc:13899
Change-Id: Id509fae9b519ec08818861787f98e990479a1a0b
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258320
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36486}
2022-04-07 17:02:02 +00:00
Jeremy Leconte
9190fef84d Fix bots failure when migrating to waterfalls.pyl.
An assert that the same tests are running before and after the migration is failing.
The new config was adding "video_capture_test".

Also add bot 'Android64 Builder arm64' instead of 'Android32 Builder arm64'.

Bug: webrtc:13899
Change-Id: Ic87576ab9740c0dc138f0b087e97ee0ae4be3376
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258138
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36484}
2022-04-07 15:38:02 +00:00
Jeremy Leconte
9f420d918f Add all the bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: Icc01225901abb19cf92f70354a97d61c625670c2
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258132
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36476}
2022-04-07 10:34:22 +00:00
Jeremy Leconte
bf11a202de Add the 'more configs' and the 'libfuzzer' bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I453d228fc250bf5f6ac1313c9c30f15bec36a191
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258130
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36472}
2022-04-07 07:17:43 +00:00
Jeremy Leconte
117596b15f Add all tryserver bots to waterfalls.pyl.
This is a no-op, the config needs to be enabled on the recipe side.
Adding the trybots early might prevent to have too many trybot failures on branches.

Bug: webrtc:13899
Change-Id: I443804dca268b71f841a6a4e0e3310f3926a3634
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258128
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36464}
2022-04-06 13:33:04 +00:00
Jeremy Leconte
7b84f06151 Add the perf builders and 2 perf tests bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I4a58f81afc62ac66b810ff3f501887bd09856238
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258126
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36462}
2022-04-06 11:54:50 +00:00
Jeremy Leconte
08591931c0 Add some iOS bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I5d3907a5eb1db599878581fa1b0571e35dcc019c
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258121
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36456}
2022-04-06 08:33:40 +00:00
Jeremy Leconte
64380ce385 Add 2 Android bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I9ac25c2b1b9d7797d5289b1fa0956eec85029ce6
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258023
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36448}
2022-04-05 15:35:49 +00:00
Jeremy Leconte
360f49a540 Add all bots running on baremetal pool to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I0ab6f04b0d5403ddf4340aa17b8de4f9fa82e622
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258022
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36442}
2022-04-05 10:14:40 +00:00
Mirko Bonadei
5c8993cba0 Reland "Add 2 additional tests config in waterfalls.pyl."
This reverts commit b5ab062a3e.

Reason for revert: The CL was not the culprit.

Original change's description:
> Revert "Add 2 additional tests config in waterfalls.pyl."
>
> This reverts commit 429c1bd74d.
>
> Reason for revert: It breaks some CQ bots (e.g. https://ci.chromium.org/ui/p/webrtc/builders/try/linux_compile_rel/42825/overview). I am reverting to check is this is the culprit.
>
> Original change's description:
> > Add 2 additional tests config in waterfalls.pyl.
> >
> > * Add a presubmit check that generate_builbot_json.py has been called.
> > * Add a webrtc_mixins.pyl file.
> >
> > Bug: webrtc:13899
> > Change-Id: I7c4226ddd80bf9376bcb91476a1446a0392e7ec6
> > Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257904
> > Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
> > Commit-Queue: Jeremy Leconte <jleconte@google.com>
> > Cr-Commit-Position: refs/heads/main@{#36428}
>
> Bug: webrtc:13899
> Change-Id: Ic79306688c26937a988a9eacb4799f53f7145c65
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257919
> Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
> Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
> Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#36431}

Bug: webrtc:13899
Change-Id: Id0ac9a98744fa5019cbb69bbd1e53e138f887e9e
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257980
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36433}
2022-04-04 19:11:38 +00:00
Mirko Bonadei
b5ab062a3e Revert "Add 2 additional tests config in waterfalls.pyl."
This reverts commit 429c1bd74d.

Reason for revert: It breaks some CQ bots (e.g. https://ci.chromium.org/ui/p/webrtc/builders/try/linux_compile_rel/42825/overview). I am reverting to check is this is the culprit.

Original change's description:
> Add 2 additional tests config in waterfalls.pyl.
>
> * Add a presubmit check that generate_builbot_json.py has been called.
> * Add a webrtc_mixins.pyl file.
>
> Bug: webrtc:13899
> Change-Id: I7c4226ddd80bf9376bcb91476a1446a0392e7ec6
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257904
> Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36428}

Bug: webrtc:13899
Change-Id: Ic79306688c26937a988a9eacb4799f53f7145c65
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257919
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36431}
2022-04-04 18:23:08 +00:00
Jeremy Leconte
429c1bd74d Add 2 additional tests config in waterfalls.pyl.
* Add a presubmit check that generate_builbot_json.py has been called.
* Add a webrtc_mixins.pyl file.

Bug: webrtc:13899
Change-Id: I7c4226ddd80bf9376bcb91476a1446a0392e7ec6
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257904
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36428}
2022-04-04 15:18:56 +00:00
Jeremy Leconte
0c4059c4c8 Add pyl files to generate the tests config.
The config is only added for the bot luci.webrtc.ci:"Linux64 Release" as a proof of concept.

Bug: webrtc:13899
Change-Id: I5ac37da5f63ca4b1c346dffe43e635b2c55e0c01
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/257160
Reviewed-by: Christoffer Jansson <jansson@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36417}
2022-04-04 06:10:15 +00:00