From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wm1-x333.google.com (mail-wm1-x333.google.com [IPv6:2a00:1450:4864:20::333]) by mail.toke.dk (Postfix) with ESMTPS id D2BCE802408 for ; Tue, 2 Mar 2021 17:01:54 +0100 (CET) Authentication-Results: mail.toke.dk; dkim=pass (1024-bit key) header.d=ieee.org header.i=@ieee.org header.b=R7Yl/ek1 Received: by mail-wm1-x333.google.com with SMTP id o2so2773759wme.5 for ; Tue, 02 Mar 2021 08:01:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ieee.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=6rIiZnY2wK4lFA4XgMdKGs61cKDyzo+9ujxPGVPDmOs=; b=R7Yl/ek12FHOM5yXJo7YEoKv7dAB4dfiI/omDC6EbTN7IABzM3ivVIkMnY99VJfjQL lQlhOWy5yUz978T3j+Lu7mgllERYYtgdfbxJAfvhaNamwpRS0ACDcA5PGtxd4iielBnI //ES3Dl9S5IVj9DxwZ1ogNBZXLep/mD1+Sx10= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=6rIiZnY2wK4lFA4XgMdKGs61cKDyzo+9ujxPGVPDmOs=; b=RpvdzBHbtQOSEvKCHK4E4BXj5dB+IP6wloa1a5lmLMFclN72Mw00iWvrSw5va/WWXG UXMsomFSiV7Na6kT2S5v7de5ouiHA9uZeexXfN/MyIOPHzjAaCpd3giF4JygOWaS4Dj6 jpJe7O3wlS78d9XARp90yAG5i6rSvPCvbyAcT0UtPf0jYi6a9mVO+b/1LneCrw+zfYID lLx4xSa4WEnTvgWayOc9hB6pH0qJXaw5aL4CRj8wXCepOxootP35Cca6VUqB2+gxNDDl yBF5coV0HkmZps/1crCero6MvNZhCdDMrX5N/O2e96ajNztNLp8jr0hCMo4t9JH0Ayqy oJ1w== X-Gm-Message-State: AOAM531i2nw8X0i3UbPmxa0GE5sNokEFoo+f0CrqNdhj6Q9TH/6bxjAV 5eI/K5GxboE04Vc1UibhajgjpJ2dxZ2jSAla92gJMA== X-Google-Smtp-Source: ABdhPJwGINkgUTbttwKzGs3z59o0upfwpZaflHrjU3yN4j4VFJNC9KTiYg4Ge7OtLnnRCoRoM2RG7tjwN9ZPdjj0tZA= X-Received: by 2002:a05:600c:2048:: with SMTP id p8mr4750484wmg.170.1614700913256; Tue, 02 Mar 2021 08:01:53 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Luca Muscariello Date: Tue, 2 Mar 2021 17:01:42 +0100 Message-ID: To: Dave Taht Content-Type: multipart/alternative; boundary="0000000000005a848b05bc8fda89" X-MailFrom: muscariello@ieee.org X-Mailman-Rule-Hits: nonmember-moderation X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation Message-ID-Hash: 7HII25WS7TKXSJWV5OEYEPSJARBU7E4T X-Message-ID-Hash: 7HII25WS7TKXSJWV5OEYEPSJARBU7E4T X-Mailman-Approved-At: Tue, 02 Mar 2021 17:14:18 +0100 CC: bloat , galene@lists.galene.org X-Mailman-Version: 3.3.2 Precedence: list Subject: [Galene] Re: [Bloat] testing latency under load on webrtc with galene? List-Id: =?utf-8?q?Gal=C3=A8ne_videoconferencing_server_discussion_list?= Archived-At: List-Archive: List-Help: List-Post: List-Subscribe: List-Unsubscribe: --0000000000005a848b05bc8fda89 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Dave, we have done extensive WebRTC (and several other online meeting apps) testing lately and this paper https://ieeexplore.ieee.org/document/9153228 reports a methodology for WebRTC based on Chromium and Selenium Grid and as test orchestrator Jitsi Torture. I would avoid feeding clients with BBB as video as it is not representative of a meeting as encoders are optimized for different kinds of video. There are several video samples out there. We have scaled up clients to hundreds with this methodology. The paper is short so many details have been omitted but there are not many other options to do this kind of test at scale. Luca describes the methodology On Tue, Mar 2, 2021 at 2:15 AM Dave Taht wrote: > Given that we have a worldwide network of flent servers... > > Given how easy galene is to hack on... and a 10 minute install... > > given some webrtc scripting... a few more stats... some javascript... > skull sweat... funding... > > It seems plausible to be able to construct a suite of tests that could > indeed track jitter > delay and loss across the internet over webrtc. Perpetually uploading > bigbuckbunny or some > other suitable movie might be an option, but I have a fondness for > extracting a sub 30 second segment from "Max Headroom", which if > those here have not seen it, predicted much of the fine mess we're all > in now. > > I guess my question is mostly, is a "headless" test feasible? In the > context of samknow's lack of webrtc test... lowpowered hw.... > > -- > "For a successful technology, reality must take precedence over public > relations, for Mother Nature cannot be fooled" - Richard Feynman > > dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729 > _______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat > --0000000000005a848b05bc8fda89 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Dave,

we have done extensive WebRTC (and several ot= her online meeting=C2=A0
apps) testing lately and this paper
methodology=C2=A0for WebRTC based on Chromium and Selenium Grid and
as tes= t orchestrator Jitsi Torture.

I would avoid feeding clients with BBB as video as i= t is not=C2=A0
representative of a meeting as encoders are optimized for=C2=A0
=
different kind= s of video. There are several video samples=C2=A0
out there.

We have scaled up clients to hun= dreds with this methodology.
The paper is short so many details have been omitted bu= t there
are not many other options to do this kind of test at scale.

Luca=C2=A0
=C2=A0






describes the methodology=C2=A0



On= Tue, Mar 2, 2021 at 2:15 AM Dave Taht <dave.taht@gmail.com> wrote:
Given that we have a worldwide network of flent s= ervers...

Given how easy galene is to hack on... and a 10 minute install...

given some webrtc scripting... a few more stats... some javascript...
skull sweat... funding...

It seems plausible to be able to construct a suite of tests that could
indeed track jitter
delay and loss across the internet over webrtc. Perpetually uploading
bigbuckbunny or some
other suitable movie might be an option, but I have a fondness for
extracting a sub 30 second segment from=C2=A0 "Max Headroom", whi= ch if
those here have not seen it, predicted much of the fine mess we're all<= br> in now.

I guess my question is mostly, is a "headless" test feasible? In = the
context of samknow's lack of webrtc test... lowpowered hw....

--
"For a successful technology, reality must take precedence over public=
relations, for Mother Nature cannot be fooled" - Richard Feynman

dave@taht.net <Da= ve T=C3=A4ht> CTO, TekLibre, LLC Tel: 1-831-435-0729
_______________________________________________
Bloat mailing list
Bloat@list= s.bufferbloat.net
https://lists.bufferbloat.net/listinfo/bloat
--0000000000005a848b05bc8fda89--