From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: mail.toke.dk; spf=pass (mailfrom) smtp.mailfrom=siobud.com (client-ip=165.227.221.230; helo=mail.siobud.com; envelope-from=sean@siobud.com; receiver=) Authentication-Results: mail.toke.dk; dkim=pass (1024-bit key) header.d=siobud.com header.i=@siobud.com header.b=W/+5Myip Received: from mail.siobud.com (mail.siobud.com [165.227.221.230]) by mail.toke.dk (Postfix) with ESMTPS id A8AFF807178 for ; Thu, 4 Mar 2021 20:09:32 +0100 (CET) Date: Thu, 4 Mar 2021 11:09:27 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=siobud.com; s=mail; t=1614884781; bh=75BV2Da8CPEwPiufWDTFMXBq3kVNvWHBsLagQ7aIKis=; h=From:To:Cc:Subject:References:In-Reply-To; b=W/+5Myip4grPz72IwibkdpDJUt+XvWXRU5zfLvS4ZuQ9bHLZigILQ0JPuxCnto3Di 8BLYHr1YH4o5dQJhwXlsoVxs/n+XybM1wSIboarIuxGabAk6GzZFTp1bD5Q7lI7aSH kJIuAA7MDYWnO1Tf71IkjrEvBA8YQM8MnkpwhKI0= From: Sean DuBois To: Luca Muscariello Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: Message-ID-Hash: RND3SELYXAFMJDANKUYPN52LT3KYNNBG X-Message-ID-Hash: RND3SELYXAFMJDANKUYPN52LT3KYNNBG X-MailFrom: sean@siobud.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; suspicious-header CC: Dave Taht , bloat , galene@lists.galene.org X-Mailman-Version: 3.3.2 Precedence: list Subject: [Galene] Re: [Bloat] testing latency under load on webrtc with galene? List-Id: =?utf-8?q?Gal=C3=A8ne_videoconferencing_server_discussion_list?= Archived-At: List-Archive: List-Help: List-Post: List-Subscribe: List-Unsubscribe: I would really love to build a general WebRTC tester. Spinning up lots of Chromium instances is super expensive. Even if you do the mock webcam you are doing way more then needed. I created[0] which spins up many PeerConnections to load test a server. I think this would be a great alternative to the testing that exists today. * You can send pre-encoded video or RTP packets directly. * You can receive RTP and not pay the costs of processing * You get direct access to Receiver Reports, Transport Wide Congestion Control and Receiver Estimated Max Bandwidth. * Way easier to deploy. We can build a small static binary. If anyone is interested would love to help them kick off a project. We can make it general enough to test Galene, Janus, Jitsi, Ion etc... If it gets acceptance from the greater WebRTC community it could really grow! [0] https://github.com/pion/rtsp-bench/blob/master/client/main.go On Tue, Mar 02, 2021 at 05:01:42PM +0100, Luca Muscariello wrote: > Dave, > > we have done extensive WebRTC (and several other online meeting > apps) testing lately and this paper > https://ieeexplore.ieee.org/document/9153228 reports a > methodology for WebRTC based on Chromium and Selenium Grid and > as test orchestrator Jitsi Torture. > > I would avoid feeding clients with BBB as video as it is not > representative of a meeting as encoders are optimized for > different kinds of video. There are several video samples > out there. > > We have scaled up clients to hundreds with this methodology. > The paper is short so many details have been omitted but there > are not many other options to do this kind of test at scale. > > Luca > > > > > > > > describes the methodology > > > > On Tue, Mar 2, 2021 at 2:15 AM Dave Taht wrote: > > > Given that we have a worldwide network of flent servers... > > > > Given how easy galene is to hack on... and a 10 minute install... > > > > given some webrtc scripting... a few more stats... some javascript... > > skull sweat... funding... > > > > It seems plausible to be able to construct a suite of tests that could > > indeed track jitter > > delay and loss across the internet over webrtc. Perpetually uploading > > bigbuckbunny or some > > other suitable movie might be an option, but I have a fondness for > > extracting a sub 30 second segment from "Max Headroom", which if > > those here have not seen it, predicted much of the fine mess we're all > > in now. > > > > I guess my question is mostly, is a "headless" test feasible? In the > > context of samknow's lack of webrtc test... lowpowered hw.... > > > > -- > > "For a successful technology, reality must take precedence over public > > relations, for Mother Nature cannot be fooled" - Richard Feynman > > > > dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729 > > _______________________________________________ > > Bloat mailing list > > Bloat@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/bloat > > > _______________________________________________ > Galene mailing list -- galene@lists.galene.org > To unsubscribe send an email to galene-leave@lists.galene.org