Commit graph

206 commits

Author SHA1 Message Date
Austin Orion
81797744fd Reland "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit dd32562f24.

Reason for revert: Updated the original change to dynamically load
the CoreMessaging.dll instead of statically linking with the .lib.

Original change's description:
> Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
>
> This reverts commit 93bb305149.
>
> Reason for revert: It breaks a test while rolling into Chromium,
> see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.
>
> Original change's description:
> > Wait for frames to arrive in WgcCapturer instead of returning nothing.
> >
> > We're seeing a high instance of "first capture failed" in Chromium when
> > using WGC. We can reduce this by waiting for frames to arrive if there
> > are none in the frame pool instead of returning a temporary error.
> >
> > I've set the maximum time to wait for a frame to 50ms. If no frame
> > arrives before 50ms has elapsed, we will return a temporary error.
> > Added a new test, FirstCaptureSucceeds, to verify that this is working
> > as expected.
> >
> > As part of this I updated the name of the `kCreateFreeThreadedFailed`
> > enum value to `kCreateFramePoolFailed`. The value remains the same
> > since they both report failures in frame pool creation.
> >
> > I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> > store two frames. This should prevent us from having to wait on the
> > event as frequently. This will increase the latency between capture
> > and display, however. High frame rate applications should not be
> > noticeably affected.
> >
> > Additionally, we uncovered a bug in the OS that prevents window capture
> > when there are displays attached, but none of them are active. Added
> > a new check to `IsWgcSupported` to cover this scenario.
> >
> > Finally, some issues with other WGC tests blocked moving the TryBots
> > to a newer version of Windows. This CL fixes those issues and updates
> > the TryBot configuration.
> >
> > bug: chromium:1314868
> > Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> > Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> > Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> > Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> > Commit-Queue: Austin Orion <auorion@microsoft.com>
> > Reviewed-by: Jeremy Leconte <jleconte@google.com>
> > Cr-Commit-Position: refs/heads/main@{#37404}
>
> Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
> No-Presubmit: true
> No-Tree-Checks: true
> No-Try: true
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
> Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
> Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
> Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
> Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
> Cr-Commit-Position: refs/heads/main@{#37408}

Change-Id: I6cc2becd9ed363782ab2f326f58d9401bc8fb820
Bug: chromium:1314868
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267902
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Cr-Commit-Position: refs/heads/main@{#37470}
2022-07-06 20:28:26 +00:00
Mirko Bonadei
dd32562f24 Revert "Wait for frames to arrive in WgcCapturer instead of returning nothing."
This reverts commit 93bb305149.

Reason for revert: It breaks a test while rolling into Chromium,
see https://webrtc-review.googlesource.com/c/src/+/261780/21#message-4a96e33bfb475f19a618be82bbe72951b23085ef for details.

Original change's description:
> Wait for frames to arrive in WgcCapturer instead of returning nothing.
>
> We're seeing a high instance of "first capture failed" in Chromium when
> using WGC. We can reduce this by waiting for frames to arrive if there
> are none in the frame pool instead of returning a temporary error.
>
> I've set the maximum time to wait for a frame to 50ms. If no frame
> arrives before 50ms has elapsed, we will return a temporary error.
> Added a new test, FirstCaptureSucceeds, to verify that this is working
> as expected.
>
> As part of this I updated the name of the `kCreateFreeThreadedFailed`
> enum value to `kCreateFramePoolFailed`. The value remains the same
> since they both report failures in frame pool creation.
>
> I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
> store two frames. This should prevent us from having to wait on the
> event as frequently. This will increase the latency between capture
> and display, however. High frame rate applications should not be
> noticeably affected.
>
> Additionally, we uncovered a bug in the OS that prevents window capture
> when there are displays attached, but none of them are active. Added
> a new check to `IsWgcSupported` to cover this scenario.
>
> Finally, some issues with other WGC tests blocked moving the TryBots
> to a newer version of Windows. This CL fixes those issues and updates
> the TryBot configuration.
>
> bug: chromium:1314868
> Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
> Reviewed-by: Alexander Cooper <alcooper@chromium.org>
> Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> Commit-Queue: Austin Orion <auorion@microsoft.com>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#37404}

Change-Id: If237df4826fe20b6fe2ca4b57253623321bf33c5
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267460
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Owners-Override: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Auto-Submit: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37408}
2022-07-02 07:41:21 +00:00
Austin Orion
93bb305149 Wait for frames to arrive in WgcCapturer instead of returning nothing.
We're seeing a high instance of "first capture failed" in Chromium when
using WGC. We can reduce this by waiting for frames to arrive if there
are none in the frame pool instead of returning a temporary error.

I've set the maximum time to wait for a frame to 50ms. If no frame
arrives before 50ms has elapsed, we will return a temporary error.
Added a new test, FirstCaptureSucceeds, to verify that this is working
as expected.

As part of this I updated the name of the `kCreateFreeThreadedFailed`
enum value to `kCreateFramePoolFailed`. The value remains the same
since they both report failures in frame pool creation.

I also increased `kNumBuffers` from 1 to 2, so that the frame pool can
store two frames. This should prevent us from having to wait on the
event as frequently. This will increase the latency between capture
and display, however. High frame rate applications should not be
noticeably affected.

Additionally, we uncovered a bug in the OS that prevents window capture
when there are displays attached, but none of them are active. Added
a new check to `IsWgcSupported` to cover this scenario.

Finally, some issues with other WGC tests blocked moving the TryBots
to a newer version of Windows. This CL fixes those issues and updates
the TryBot configuration.

bug: chromium:1314868
Change-Id: Id9c4d5ee98621e682ef04864c3848d50e761cdb7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261780
Reviewed-by: Alexander Cooper <alcooper@chromium.org>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Austin Orion <auorion@microsoft.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37404}
2022-07-01 17:42:20 +00:00
Mirko Bonadei
68fef2f3e9 Update protobuf-py2_py3 wheel.
This is required after updating protobuf to 3.20.0 in
https://chromium-review.googlesource.com/c/chromium/src/+/3733827.

Bug: b/237760527
Change-Id: I9c4df89b7116dfa934a2c313aaad9c9b88c36787
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267405
Commit-Queue: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37399}
2022-07-01 15:17:36 +00:00
Andrey Logvin
ba90d025a1 Revert "Temporarily disable video_capture_tests on linux"
This reverts commit 915d419eb9.

Reason for revert: The bots which can run this tests is now working

Original change's description:
> Temporarily disable video_capture_tests on linux
>
> No bots can run linux video_capture_tests for now.
>
> Bug: webrtc:14220
> Change-Id: I5dbdefdd104befff92648a0693bee331d2b50e88
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/266660
> Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
> Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
> Reviewed-by: Andrey Logvin <landrey@webrtc.org>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#37312}

Bug: webrtc:14220
Change-Id: I0a7a82cf64b0692be62a38f3df6416a33917c3d5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/267105
Owners-Override: Andrey Logvin <landrey@webrtc.org>
Commit-Queue: Andrey Logvin <landrey@webrtc.org>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Cr-Commit-Position: refs/heads/main@{#37369}
2022-06-29 13:35:28 +00:00
Byoungchan Lee
915d419eb9 Temporarily disable video_capture_tests on linux
No bots can run linux video_capture_tests for now.

Bug: webrtc:14220
Change-Id: I5dbdefdd104befff92648a0693bee331d2b50e88
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/266660
Commit-Queue: Daniel.L (Byoungchan) Lee <daniel.l@hpcnt.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Reviewed-by: Andrey Logvin <landrey@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37312}
2022-06-23 10:13:52 +00:00
Florent Castelli
90b74389a2 SVC: Add end to end tests for VP8 and VP9
The tests check that the various scalability mode are supported
and the frames are marked properly by the encoder with their
spatial and temporal index.
The same information is then checked on the receiving side.

A new member is added on EncodedImage to store the temporal index,
and is filled by the encoders and retreived by the ref finder
objects on the decoding side.

Bug: webrtc:11607
Change-Id: I7522f6a6fc5402244cab0c4c64b544ce09bc5204
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260189
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Rasmus Brandt <brandtr@webrtc.org>
Reviewed-by: Artem Titov <titovartem@webrtc.org>
Commit-Queue: Florent Castelli <orphis@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37303}
2022-06-22 11:07:01 +00:00
Jeremy Leconte
413ca2b95d Run Mac M1 try jobs.
Also use baremetal pool only for the video_capture_tests.
Currently this test is disabled on the M1 machines because they don't have a camera ready.

Change-Id: Ie34b5a09219d7e0e43ff026bcbdfba922955f8bb
Bug: b/230719743
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265680
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37235}
2022-06-16 13:00:42 +00:00
Christoffer Jansson
b137fb93e8 Add mac11_or_mac12 dimension and apply to all MacOS bots in prep for upgrade
Bug: b/233192409
Change-Id: I65b65ca4f992eef8d0ebc8e1dac90c656269db17
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265662
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#37208}
2022-06-14 12:51:17 +00:00
Jeremy Leconte
72b5dbc44b Don't run quick perf tests on baremetal machines.
Baremetal machines have webcams and it makes it confusing wether webrtc_perf_tests require cameras to run.

Change-Id: I1f3dc05c976ed008079f990b9a55f3310ea73dda
Bug: b/235780120
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/265641
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37189}
2022-06-13 08:55:57 +00:00
Jeremy Leconte
35fc144e01 Rename 'iOS64 Sim Debug (iOS 14.0)' bot.
Change-Id: I83bb0dfd0edcc199c2e44d2627bb6945514a6c84
Bug: b/228171822
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/264941
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#37104}
2022-06-03 07:17:27 +00:00
Jeremy Leconte
33e5873712 Upgrade iOS bots to xcode 13.
Also update ios 14.0 simulators to 14.5 because tests were failing.

Change-Id: I36c946ff26899502ad611d3f473f3692374b08a4
Bug: b/228171822
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/264830
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#37103}
2022-06-03 07:06:37 +00:00
Christoffer Jansson
5ca01b5a5b Use ios_perf_test for M1 arm64 perf tester
Bug: b/232347569
Change-Id: I16fa752ee81d3a331ce2c2d4fe2f4bd9b28a5597
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/263481
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36987}
2022-05-24 14:59:12 +00:00
Christoffer Jansson
742714870a Reland CL 262942 with dev specific dataset.
GCP permissions have also been updated to allow
bigquery dataset and table read+create etc.

Bug: b/227310186
Change-Id: I2e0404877b608c1b3dd9bb3d97fa99f712832a1d
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/263160
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36967}
2022-05-23 09:11:38 +00:00
Patrick Meiring
dbfa78114b Revert "Add cluster rules, fix bug instance"
This reverts commit afe1680609.

Reason for revert: Bad configuration, causes alerts to fire in Weetbix dev/prod.

Original change's description:
> Add cluster rules, fix bug instance
>
> Bug: b/227310186
> Change-Id: I39fa3204f0dd6b514dc468b29faa819c644486a8
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/262942
> Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
> Reviewed-by: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36943}

Bug: b/227310186
Change-Id: I8a0fd8662765b50175960bc28fae5c3254588772
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/263100
Auto-Submit: Patrick Meiring <meiring@google.com>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36962}
2022-05-23 07:12:10 +00:00
Christoffer Jansson
afe1680609 Add cluster rules, fix bug instance
Bug: b/227310186
Change-Id: I39fa3204f0dd6b514dc468b29faa819c644486a8
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/262942
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36943}
2022-05-20 12:00:46 +00:00
Jeremy Leconte
d68a06aedf Move pinpoint acl to the perf bucket.
The perf builders have been moved from the 'ci' to the 'perf' bucket.

Bug: b/233159334
Change-Id: Ic5de4489892599d3a9cf94696a4db8a708c1f0e3
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/262808
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36928}
2022-05-19 07:22:00 +00:00
Jeremy Leconte
fb9ae767aa Reland "Run iOS tests on multiple shards."
This is a reland of commit 5a71f15858

Original change's description:
> Run iOS tests on multiple shards.
>
> Bug: b/230824012
> Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36796}

Bug: b/230824012
Change-Id: I4a8627e87a6f22953238a28a714af3a97de065b9
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261724
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36883}
2022-05-13 13:49:44 +00:00
Christoffer Jansson
9e73e2e430 Add MacArm64 builder and perf config
Bug: b/230719743
Change-Id: Ib735a4a22a40053b816b4d1481aa1820de210f39
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261727
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36830}
2022-05-10 08:52:00 +00:00
Christoffer Jansson
598044f9ee Add M1 perf bot
Companion CL: https://chromium-review.googlesource.com/c/chromium/tools/build/+/3634362

Bug: b/230719743
Change-Id: I52babb62dddbcadeb2854720c3c022ee3e04dbec
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260321
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36829}
2022-05-10 08:10:20 +00:00
Jeremy Leconte
58d774ba78 Revert "Run iOS tests on multiple shards."
This reverts commit 5a71f15858.

Reason for revert: Turns out all the tests are running on all the shards.

Original change's description:
> Run iOS tests on multiple shards.
>
> Bug: b/230824012
> Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36796}

Bug: b/230824012
Change-Id: Id353501f07156ccc109abf94e6d2a22014a5e767
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261562
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36807}
2022-05-09 07:40:54 +00:00
Jeremy Leconte
5a71f15858 Run iOS tests on multiple shards.
Bug: b/230824012
Change-Id: I6d27a8ed2c07eb76972b3bbe3679f6346ba58e06
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261306
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36796}
2022-05-06 09:55:41 +00:00
Jeremy Leconte
2445602bdf Revert "Migrate iOS simulator tests to Mac-12 machines."
This reverts commit 3466511ee1.

Reason for revert: Pending time can be very long when the test are running at the same time as this builder:
https://luci-milo.appspot.com/p/chromium/builders/ci/ios15-beta-simulator

Original change's description:
> Migrate iOS simulator tests to Mac-12 machines.
>
> Bug: b/227442116
> Change-Id: I7b5157a735596616f9785391c40b8f26974c222d
> Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260985
> Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
> Commit-Queue: Jeremy Leconte <jleconte@google.com>
> Cr-Commit-Position: refs/heads/main@{#36751}

Bug: b/227442116
Change-Id: I87f27b36db7aa4c6d9d6982a5e86d56648a709e8
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261307
Bot-Commit: rubber-stamper@appspot.gserviceaccount.com <rubber-stamper@appspot.gserviceaccount.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36795}
2022-05-06 09:38:34 +00:00
Jeremy Leconte
95897aea2f Run peerconnection_unittests on multiple shards.
The shards were removed with https://webrtc-review.googlesource.com/c/src/+/261262 as an experiment.

It turns out the new test target slow_peer_connection_unittests doesn't take much time compared to peerconnection_unittests.
slow_peer_connection_unittests: 7min
peerconnection_unittests: 35min
https://chromium-swarm.appspot.com/tasklist?f=parent_task_id-tag%3A5aad344b2285be11&st=1651756987488

Bug: webrtc:14025
Change-Id: Iaaf2b476ea6fdc419c5b14beb8040c5a0d973952
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261264
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36785}
2022-05-05 15:10:29 +00:00
Harald Alvestrand
f8f7b70050 Create a "slow peerconnection unittests" target
This CL moves all tests that take more than 5 seconds into the new target.

Bug: webrtc:14025
Change-Id: I760d1a270b399b581f41606647740466f6b87e7c
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/261262
Commit-Queue: Harald Alvestrand <hta@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36782}
2022-05-05 14:40:38 +00:00
Jeremy Leconte
4ef2de6290 Remove the iOS internal try bots.
Bug: b/230708129
Change-Id: Ic4315997af0c01c5f5d987d13d88ada7d76ab0ea
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260191
Reviewed-by: Mirko Bonadei <mbonadei@google.com>
Commit-Queue: Jeremy Leconte <jleconte@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36770}
2022-05-05 07:20:49 +00:00
Jeremy Leconte
3466511ee1 Migrate iOS simulator tests to Mac-12 machines.
Bug: b/227442116
Change-Id: I7b5157a735596616f9785391c40b8f26974c222d
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260985
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36751}
2022-05-04 07:27:25 +00:00
Christoffer Jansson
b45d4deb3b Rename MacOS perf bot to 11 to reflect OS version
Bug: b/227442116
Change-Id: I80cf745a3a38d08c833864d2f8e4533776be2585
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260460
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36702}
2022-04-29 09:24:13 +00:00
Jeremy Leconte
2dad0a1668 Re-enable XCTests sdk_unittests on simulators.
Bug: webrtc:12244
Change-Id: Id5cd44e93cd0221e09380d05da510b05c22e143f
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/259773
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36699}
2022-04-28 19:58:31 +00:00
Christoffer Jansson
69edcaf47b relax dimensions for mac perf bot to allow MacOS 11 upgrade
Bug: b/227442116
Change-Id: I30d8002997519f348988e2867c9a5f4935a265de
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260281
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36688}
2022-04-28 10:17:34 +00:00
Jeremy Leconte
72efd91d1f Re-enable XCTests apprtcmobile_tests on simulators.
Bug: webrtc:12244
Change-Id: Idca6bcc1505b0b9ceadfafbe128d64d53800f34a
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260280
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36684}
2022-04-28 08:31:03 +00:00
Jeremy Leconte
24eb595587 Switch iOS bots to xcode 13.
Bug: b/228171822
Change-Id: I03bf0283d86d3c8a8ba2e04ea1469579bb15bf4a
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260181
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36667}
2022-04-27 10:09:21 +00:00
Jeremy Leconte
225c308af0 Upgrade iOS simulator bots from Mac-10.15 to Mac-11.
Bug: chromium:1263538
No-Try: true
Change-Id: I2d20360e5daf1f3907364b51859f7f90d216d58a
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260118
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36665}
2022-04-27 07:52:45 +00:00
Christoffer Jansson
f3a9007d03 Remove Windows 7 tester from LKGR in preparation for removal.
Bug: b/227442116
Change-Id: Ie34d437f2eabc57dd734bb4051101a1cf97ec3b7
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260108
Reviewed-by: Jeremy Leconte <jleconte@google.com>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36656}
2022-04-26 10:10:25 +00:00
Jeremy Leconte
68dcea5f0d Remove the bot 'Perf Linux Trusty'
Bug: chromium:1199405
Change-Id: I0a0ca56b217760cba0db6b1a8b1580bea0edc6a5
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260103
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36652}
2022-04-26 08:47:35 +00:00
Alexander Schulze
cf01838790 [lkgr_finder] Make lkgr_finder more robust
In the referenced ticket, we changed the allowed_lag from 40h to 90h (for low volume commit periods) to survive weekends without succeeding builders.

This rolls the change into WebRTC, and removes a duplicated builder entry.

Bug: chromium:1317669
Change-Id: Ife9dd6ff119948ffbd0fa92c7d59466d31ebb215
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/260040
Auto-Submit: Alex Schulze <alexschulze@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36650}
2022-04-26 06:42:30 +00:00
Alexander Schulze
5f96daa8a5 [lkgr_finder] Toggle allowed_lag and allowed_gap
It seems like this got confused when initially added [1,2]. The confusion affects the lag check [3], which only send an email in the past, but will raise a builder failure after [4] landed if there is a gap for more than 4 commits.

[1] https://crsrc.org/i/infra/services/lkgr_finder/config/default_cfg.pyl?q=allowed_gap
[2] https://crsrc.org/i/infra/services/lkgr_finder/test/lkgr_lib_test.py?q=allowed_gap
[3] https://crsrc.org/i/infra/services/lkgr_finder/lkgr_lib.py;l=500?q=allowed_lag
[4] https://crrev.com/c/3599253

Bug: chromium:1317669
Change-Id: I23726957439b03dced0fc0038ee65a3108f88fea
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/259874
Auto-Submit: Alex Schulze <alexschulze@google.com>
Reviewed-by: Christoffer Jansson <jansson@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@webrtc.org>
Cr-Commit-Position: refs/heads/main@{#36642}
2022-04-25 12:00:10 +00:00
Christoffer
ba1657c95c Ensure perf builders are not part of LKGR
Bug: b/218825531
Change-Id: Idff35f420da2a6246b87ae1041bb6dff007deb70
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/259501
Reviewed-by: Björn Terelius <terelius@webrtc.org>
Commit-Queue: Christoffer Jansson <jansson@google.com>
Cr-Commit-Position: refs/heads/main@{#36586}
2022-04-20 13:05:57 +00:00
Jeremy Leconte
b252a0027e Move perf builders to perf bucket.
Existing recipe code to trigger testers from builders assumes the bots belong to the same bucket.

Bug: b/218825531
Change-Id: I3cd6414f7e1bacc21d3443285d1217f6b90a6adf
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/259260
Reviewed-by: Christoffer Jansson <jansson@google.com>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36568}
2022-04-19 07:15:05 +00:00
Jeremy Leconte
424cc65a4a Centralized test command argument in .pyl configuration.
* Remove args from gn_isolate_map.pyl
* Set idempotent to false for performance tests

Bug: webrtc:13899
Change-Id: Icde80af02070e024c1292721db9c0b8a4d906343
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258685
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36531}
2022-04-12 10:43:05 +00:00
Jeremy Leconte
ed1bc59a6e Remove perf tests from the builders.
Also fix wrong iOS bot definition in waterfalls.pyl.

Bug: webrtc:13899
Change-Id: I3146751a49d359cdb17324b53065757b0e93e402
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258661
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36521}
2022-04-11 12:10:57 +00:00
Jeremy Leconte
dad78f8cff Move the readline-timeout to the iOS device instead of simulator.
Also increase the timeout over 10 minutes and increase the bot timeout.
https://chrome-swarming.appspot.com/task?id=5a2118b0119c3b10

Bug: b/228402401
Change-Id: Idf652fd7fa2fc6670011df254836444dfaf553a8
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258420
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36508}
2022-04-08 20:50:25 +00:00
Jeremy Leconte
616bea20e1 Fix missing perftest-output.pb file for Android perf bots.
Bug: webrtc:13899
Change-Id: Ica8fe3f90a80c79b5cd53b755cc0761292664547
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258403
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36507}
2022-04-08 20:48:05 +00:00
Jeremy Leconte
a54171b46b Fix failure on 'MacARM64 M1 Release' bot.
Error when trying to access the try pool from a ci bot:
https://ci.chromium.org/ui/p/webrtc/builders/ci/MacARM64%20M1%20Release/2181/overview

Bug: webrtc:13899
Change-Id: Id509fae9b519ec08818861787f98e990479a1a0b
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258320
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36486}
2022-04-07 17:02:02 +00:00
Jeremy Leconte
9190fef84d Fix bots failure when migrating to waterfalls.pyl.
An assert that the same tests are running before and after the migration is failing.
The new config was adding "video_capture_test".

Also add bot 'Android64 Builder arm64' instead of 'Android32 Builder arm64'.

Bug: webrtc:13899
Change-Id: Ic87576ab9740c0dc138f0b087e97ee0ae4be3376
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258138
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36484}
2022-04-07 15:38:02 +00:00
Jeremy Leconte
9f420d918f Add all the bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: Icc01225901abb19cf92f70354a97d61c625670c2
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258132
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36476}
2022-04-07 10:34:22 +00:00
Jeremy Leconte
bf11a202de Add the 'more configs' and the 'libfuzzer' bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I453d228fc250bf5f6ac1313c9c30f15bec36a191
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258130
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36472}
2022-04-07 07:17:43 +00:00
Jeremy Leconte
117596b15f Add all tryserver bots to waterfalls.pyl.
This is a no-op, the config needs to be enabled on the recipe side.
Adding the trybots early might prevent to have too many trybot failures on branches.

Bug: webrtc:13899
Change-Id: I443804dca268b71f841a6a4e0e3310f3926a3634
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258128
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36464}
2022-04-06 13:33:04 +00:00
Jeremy Leconte
7b84f06151 Add the perf builders and 2 perf tests bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I4a58f81afc62ac66b810ff3f501887bd09856238
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258126
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36462}
2022-04-06 11:54:50 +00:00
Jeremy Leconte
08591931c0 Add some iOS bots to waterfalls.pyl.
Bug: webrtc:13899
Change-Id: I5d3907a5eb1db599878581fa1b0571e35dcc019c
Reviewed-on: https://webrtc-review.googlesource.com/c/src/+/258121
Reviewed-by: Mirko Bonadei <mbonadei@webrtc.org>
Commit-Queue: Jeremy Leconte <jleconte@google.com>
Cr-Commit-Position: refs/heads/main@{#36456}
2022-04-06 08:33:40 +00:00