From mboxrd@z Thu Jan 1 00:00:00 1970
Received: from mail-wm1-x333.google.com (mail-wm1-x333.google.com [IPv6:2a00:1450:4864:20::333])
by mail.toke.dk (Postfix) with ESMTPS id D2BCE802408
for <galene@lists.galene.org>; Tue, 2 Mar 2021 17:01:54 +0100 (CET)
Authentication-Results: mail.toke.dk;
dkim=pass (1024-bit key) header.d=ieee.org header.i=@ieee.org header.b=R7Yl/ek1
Received: by mail-wm1-x333.google.com with SMTP id o2so2773759wme.5
for <galene@lists.galene.org>; Tue, 02 Mar 2021 08:01:54 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=ieee.org; s=google;
h=mime-version:references:in-reply-to:from:date:message-id:subject:to
:cc;
bh=6rIiZnY2wK4lFA4XgMdKGs61cKDyzo+9ujxPGVPDmOs=;
b=R7Yl/ek12FHOM5yXJo7YEoKv7dAB4dfiI/omDC6EbTN7IABzM3ivVIkMnY99VJfjQL
lQlhOWy5yUz978T3j+Lu7mgllERYYtgdfbxJAfvhaNamwpRS0ACDcA5PGtxd4iielBnI
//ES3Dl9S5IVj9DxwZ1ogNBZXLep/mD1+Sx10=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:references:in-reply-to:from:date
:message-id:subject:to:cc;
bh=6rIiZnY2wK4lFA4XgMdKGs61cKDyzo+9ujxPGVPDmOs=;
b=RpvdzBHbtQOSEvKCHK4E4BXj5dB+IP6wloa1a5lmLMFclN72Mw00iWvrSw5va/WWXG
UXMsomFSiV7Na6kT2S5v7de5ouiHA9uZeexXfN/MyIOPHzjAaCpd3giF4JygOWaS4Dj6
jpJe7O3wlS78d9XARp90yAG5i6rSvPCvbyAcT0UtPf0jYi6a9mVO+b/1LneCrw+zfYID
lLx4xSa4WEnTvgWayOc9hB6pH0qJXaw5aL4CRj8wXCepOxootP35Cca6VUqB2+gxNDDl
yBF5coV0HkmZps/1crCero6MvNZhCdDMrX5N/O2e96ajNztNLp8jr0hCMo4t9JH0Ayqy
oJ1w==
X-Gm-Message-State: AOAM531i2nw8X0i3UbPmxa0GE5sNokEFoo+f0CrqNdhj6Q9TH/6bxjAV
5eI/K5GxboE04Vc1UibhajgjpJ2dxZ2jSAla92gJMA==
X-Google-Smtp-Source: ABdhPJwGINkgUTbttwKzGs3z59o0upfwpZaflHrjU3yN4j4VFJNC9KTiYg4Ge7OtLnnRCoRoM2RG7tjwN9ZPdjj0tZA=
X-Received: by 2002:a05:600c:2048:: with SMTP id p8mr4750484wmg.170.1614700913256;
Tue, 02 Mar 2021 08:01:53 -0800 (PST)
MIME-Version: 1.0
References: <CAA93jw5aOdEFY0+5uc0v6pkLwOed+bp2S91-TJFLHZZ0_Gtq5w@mail.gmail.com>
In-Reply-To: <CAA93jw5aOdEFY0+5uc0v6pkLwOed+bp2S91-TJFLHZZ0_Gtq5w@mail.gmail.com>
From: Luca Muscariello <muscariello@ieee.org>
Date: Tue, 2 Mar 2021 17:01:42 +0100
Message-ID: <CAH8sseQ-vGYJdrj+6mmz++L2MrQ4SvfEh4Ja49Tx_mTUVXJG2w@mail.gmail.com>
To: Dave Taht <dave.taht@gmail.com>
Content-Type: multipart/alternative; boundary="0000000000005a848b05bc8fda89"
X-MailFrom: muscariello@ieee.org
X-Mailman-Rule-Hits: nonmember-moderation
X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation
Message-ID-Hash: 7HII25WS7TKXSJWV5OEYEPSJARBU7E4T
X-Message-ID-Hash: 7HII25WS7TKXSJWV5OEYEPSJARBU7E4T
X-Mailman-Approved-At: Tue, 02 Mar 2021 17:14:18 +0100
CC: bloat <bloat@lists.bufferbloat.net>, galene@lists.galene.org
X-Mailman-Version: 3.3.2
Precedence: list
Subject: [Galene] Re: [Bloat] testing latency under load on webrtc with galene?
List-Id: =?utf-8?q?Gal=C3=A8ne_videoconferencing_server_discussion_list?= <galene.lists.galene.org>
Archived-At: <https://lists.galene.org/galene/CAH8sseQ-vGYJdrj+6mmz++L2MrQ4SvfEh4Ja49Tx_mTUVXJG2w@mail.gmail.com/>
List-Archive: <https://lists.galene.org/galene/>
List-Help: <mailto:galene-request@lists.galene.org?subject=help>
List-Post: <mailto:galene@lists.galene.org>
List-Subscribe: <mailto:galene-join@lists.galene.org>
List-Unsubscribe: <mailto:galene-leave@lists.galene.org>
--0000000000005a848b05bc8fda89
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Dave,
we have done extensive WebRTC (and several other online meeting
apps) testing lately and this paper
https://ieeexplore.ieee.org/document/9153228 reports a
methodology for WebRTC based on Chromium and Selenium Grid and
as test orchestrator Jitsi Torture.
I would avoid feeding clients with BBB as video as it is not
representative of a meeting as encoders are optimized for
different kinds of video. There are several video samples
out there.
We have scaled up clients to hundreds with this methodology.
The paper is short so many details have been omitted but there
are not many other options to do this kind of test at scale.
Luca
describes the methodology
On Tue, Mar 2, 2021 at 2:15 AM Dave Taht <dave.taht@gmail.com> wrote:
> Given that we have a worldwide network of flent servers...
>
> Given how easy galene is to hack on... and a 10 minute install...
>
> given some webrtc scripting... a few more stats... some javascript...
> skull sweat... funding...
>
> It seems plausible to be able to construct a suite of tests that could
> indeed track jitter
> delay and loss across the internet over webrtc. Perpetually uploading
> bigbuckbunny or some
> other suitable movie might be an option, but I have a fondness for
> extracting a sub 30 second segment from "Max Headroom", which if
> those here have not seen it, predicted much of the fine mess we're all
> in now.
>
> I guess my question is mostly, is a "headless" test feasible? In the
> context of samknow's lack of webrtc test... lowpowered hw....
>
> --
> "For a successful technology, reality must take precedence over public
> relations, for Mother Nature cannot be fooled" - Richard Feynman
>
> dave@taht.net <Dave T=C3=A4ht> CTO, TekLibre, LLC Tel: 1-831-435-0729
> _______________________________________________
> Bloat mailing list
> Bloat@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/bloat
>
--0000000000005a848b05bc8fda89
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr"><div class=3D"gmail_defa=
ult" style=3D"font-family:monospace">Dave,</div><div class=3D"gmail_default=
" style=3D"font-family:monospace"><br></div><div class=3D"gmail_default" st=
yle=3D"font-family:monospace">we have done extensive WebRTC (and several ot=
her online meeting=C2=A0</div><div class=3D"gmail_default" style=3D"font-fa=
mily:monospace">apps) testing lately and this paper</div><div class=3D"gmai=
l_default" style=3D"font-family:monospace"><a href=3D"https://ieeexplore.ie=
ee.org/document/9153228">https://ieeexplore.ieee.org/document/9153228</a> r=
eports a=C2=A0</div><div class=3D"gmail_default" style=3D"font-family:monos=
pace">methodology=C2=A0for WebRTC based on Chromium and Selenium Grid and<b=
r></div><div class=3D"gmail_default" style=3D"font-family:monospace">as tes=
t orchestrator Jitsi Torture.<br></div><div class=3D"gmail_default" style=
=3D"font-family:monospace"><br></div><div class=3D"gmail_default" style=3D"=
font-family:monospace">I would avoid feeding clients with BBB as video as i=
t is not=C2=A0</div><div class=3D"gmail_default" style=3D"font-family:monos=
pace">representative of a meeting as encoders are optimized for=C2=A0</div>=
<div class=3D"gmail_default" style=3D"font-family:monospace">different kind=
s of video. There are several video samples=C2=A0</div><div class=3D"gmail_=
default" style=3D"font-family:monospace">out there.<br></div><div class=3D"=
gmail_default" style=3D"font-family:monospace"><br></div><div class=3D"gmai=
l_default" style=3D"font-family:monospace">We have scaled up clients to hun=
dreds with this methodology.</div><div class=3D"gmail_default" style=3D"fon=
t-family:monospace">The paper is short so many details have been omitted bu=
t there<br></div><div class=3D"gmail_default" style=3D"font-family:monospac=
e">are not many other options to do this kind of test at scale.<br></div><d=
iv class=3D"gmail_default" style=3D"font-family:monospace"><br></div><div c=
lass=3D"gmail_default" style=3D"font-family:monospace">Luca=C2=A0</div><div=
class=3D"gmail_default" style=3D"font-family:monospace">=C2=A0</div><div c=
lass=3D"gmail_default" style=3D"font-family:monospace"><br></div><div class=
=3D"gmail_default" style=3D"font-family:monospace"><br></div><div class=3D"=
gmail_default" style=3D"font-family:monospace"><br></div><div class=3D"gmai=
l_default" style=3D"font-family:monospace"><br></div><div class=3D"gmail_de=
fault" style=3D"font-family:monospace"><br></div><div class=3D"gmail_defaul=
t" style=3D"font-family:monospace"><br></div><div class=3D"gmail_default" s=
tyle=3D"font-family:monospace">describes the methodology=C2=A0</div><div cl=
ass=3D"gmail_default" style=3D"font-family:monospace"><br></div><div class=
=3D"gmail_default" style=3D"font-family:monospace"><br></div></div></div></=
div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On=
Tue, Mar 2, 2021 at 2:15 AM Dave Taht <<a href=3D"mailto:dave.taht@gmai=
l.com">dave.taht@gmail.com</a>> wrote:<br></div><blockquote class=3D"gma=
il_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,2=
04,204);padding-left:1ex">Given that we have a worldwide network of flent s=
ervers...<br>
<br>
Given how easy galene is to hack on... and a 10 minute install...<br>
<br>
given some webrtc scripting... a few more stats... some javascript...<br>
skull sweat... funding...<br>
<br>
It seems plausible to be able to construct a suite of tests that could<br>
indeed track jitter<br>
delay and loss across the internet over webrtc. Perpetually uploading<br>
bigbuckbunny or some<br>
other suitable movie might be an option, but I have a fondness for<br>
extracting a sub 30 second segment from=C2=A0 "Max Headroom", whi=
ch if<br>
those here have not seen it, predicted much of the fine mess we're all<=
br>
in now.<br>
<br>
I guess my question is mostly, is a "headless" test feasible? In =
the<br>
context of samknow's lack of webrtc test... lowpowered hw....<br>
<br>
-- <br>
"For a successful technology, reality must take precedence over public=
<br>
relations, for Mother Nature cannot be fooled" - Richard Feynman<br>
<br>
<a href=3D"mailto:dave@taht.net" target=3D"_blank">dave@taht.net</a> <Da=
ve T=C3=A4ht> CTO, TekLibre, LLC Tel: 1-831-435-0729<br>
_______________________________________________<br>
Bloat mailing list<br>
<a href=3D"mailto:Bloat@lists.bufferbloat.net" target=3D"_blank">Bloat@list=
s.bufferbloat.net</a><br>
<a href=3D"https://lists.bufferbloat.net/listinfo/bloat" rel=3D"noreferrer"=
target=3D"_blank">https://lists.bufferbloat.net/listinfo/bloat</a><br>
</blockquote></div>
--0000000000005a848b05bc8fda89--