I haven’t been following your other threads @silly-train-16715. Have you shared more info about the issues testers are complaining about? Do you surface connection quality in your UI? Do you have sessions/participant URLs in your cloud dash you can share with us, which identify some problematic sessions?

Hi @dry-elephant-14928. • Testers are mostly located in Ukraine. Exceptions are: one in Cyprus and one in UK • No firewalls. By most part they are using WiFi but sometimes 4G • Here is example of something our testers called "bad" (said that connection was very bad and wasn't able to carry out a call): https://cloud.livekit.io/projects/p_519ctfqf1bf/sessions/RM_2vwLSKihFKfD

Hi @magnificent-art-43333. Yes I shared more info in that threads. I show connection indicator in UI but it doesn't seem to work properly. Sometimes it shows perfect connection quality by video quality is poor and sometimes vice versa.

what indicated to the tester that the connection is bad? could they record a screen recording that allows us to see what they are experiencing?

for the flutter/adaptivestream issue, could you paste the publish settings that you've used? that'd help to see what bitrates/layer sizes are at play

here are the current settings that seem to work +-

final videoSimulcastLayers = Platform.isAndroid
        ? const [
          VideoParameters(
            dimensions: VideoDimensionsPresets.h180_169,
            encoding: VideoEncoding(
              maxBitrate: 500 * 1000,
              maxFramerate: 20,
            ),
          ),
          VideoParameters(
            dimensions: VideoDimensionsPresets.h360_169,
            encoding: VideoEncoding(
              maxBitrate: 1000 * 1000,
              maxFramerate: 20,
            ),
          )
        ]
        : const [
            VideoParameters(
              dimensions: VideoDimensionsPresets.h360_169,
              encoding: VideoEncoding(
                maxBitrate: 1000 * 1000,
                maxFramerate: 20,
              ),
            ),
            VideoParameters(
              dimensions: VideoDimensionsPresets.h540_169,
              encoding: VideoEncoding(
                maxBitrate: 3000 * 1000,
                maxFramerate: 20,
              ),
            )
          ];
      await room.connect(
        roomServerUrl,
        roomToken,
        connectOptions: ConnectOptions(
          autoSubscribe: currentUser?.isCoach ?? false,
        ),
        roomOptions: RoomOptions(
            adaptiveStream: !Platform.isAndroid,
            dynacast: true,
            defaultVideoPublishOptions: VideoPublishOptions(
              simulcast: true,
              videoSimulcastLayers: videoSimulcastLayers,
            ),
            defaultCameraCaptureOptions:
                CameraCaptureOptions(cameraPosition: newCameraPosition)),
      );
    }

also I added this event handling for android devices. Looks like it helps a bit too:

..on<TrackSubscribedEvent>((e) async {
      if (e.publication.kind == TrackType.VIDEO && Platform.isAndroid) {
        await e.publication.setVideoQuality(VideoQuality.LOW);
      }
    })

Sorry, I didn't notice

defaultCameraCaptureOptions

. I'll try to modify it too

Doesn't seem to help. Speed test shows good connection but connection indicator shows poor internet connection quality.

Can you try to open another flutter web (chrome) or iOS app to watch the same publish track?

I will try merge the

Stats Monitor API

soon so we can track the RTC stats. This should help us locate the cause of the low frame rate/bit rate.

@freezing-lifeguard-43174, interesting thing I've noticed recently: When I open profiler and monitor memory usage the RSS memory usage "sticks" to Dart/Flutter level over time and keeps that way on (first picture). While before it was much higher and wasn't lowering over time (was at the level like on the most left in the second picture). And it happens only on android devices. On iPhone it is has the plot where RSS memory is almost x2 times higher than Dart/Flutter and never lowers over time (when on the same page in app). Maybe this behaviour is responsible for those lags.

disconnecting from surface 0xb4000070c31e0010, reason disconnectFromSurface

After this log prints, the decoder is reset and starts dropping frames

Is that a backend thing you will do or I should change H264 to VP8 in

VideoPublishOptions

?

Hi @freezing-lifeguard-43174 @dry-elephant-14928. It looks like there is similar problem with audio for Android. When I spawn

ffmpeg

process to strem music to previously generated rtmp URL with this code (JS)

const ffmpeg = childProcess.spawn(
                `ffmpeg`, [`-re`, `-ss`, `${toHHMMSS(req.body.seekSeconds)}`, `-stream_loop`, `-1`, `-i`, `${concat}`, `-c:v`, `libx264`, `-c:a`, `aac`, `-f`, `flv`, `${req.body.rtmpUrl}`],
                {
                    cwd: process.cwd() + '/songs'
                }
            );

It looks like some parts of a song are dropping and it becomes choppy. I haven't tried it using cloud project with h264 turned off yet, but I'll let you know.

I tried with cloud project where h264 is turned off and got the same behaviour. For Web and iPhone everything works fine. Watch the attached video (playback progression bar is not configured yet so don't mind about it).

But we are planning to use this flow for video too

having the ffmpeg command you've used to reproduce would be helpful

We are spawning ffmpeg process using node.js

In this code snippet

toHHMMSS

transforms seconds to MM:SS format, and we pass list of mp3 files with

concat

@dry-elephant-14928 I opened new issue: https://github.com/livekit/ingress/issues/115

Hello again. Any updates on this one? Still can reproduce with version 1.4.2 of livekit client. I've added logging to write stats to influx DB every 20-30 seconds. Below are the plots of decoded and dropped fractions of received frames for android device (first) and iphone (second). Both have inconsistency with sum of decoded and dropped fractions is not equal to 1, but iphone device has 0 dropped frames and video from android is clean without delays, whereas the video from iphone on android device has 10-15 seconds delay.

@freezing-lifeguard-43174 in order to make everything work made a build with version 1.3.3 (prior to dropped frames fix for Android) of livekit client and enabled support of VP8 only in cloud dashboard. This build works fine somehow (none of our testers complained about video quality issues).

oh nvm, it's from iPhone.. I see in your original message now

@silly-train-16715 Which Android phone model are you using? There is another possibility that when decoding multiple VP8 tracks, there will be frame drops due to device performance limitations, perhaps through the subscriber setting the quality layer to medium or low

Hey @dry-elephant-14928 @freezing-lifeguard-43174. I've made one mistake once again (I wrote about it to David some time ago). In my project I forgot to commit one quite important update: set video parameters for camera track to 360p in preview page. The track was created with default parameters (which means 720p) and passed to fast connect options. Which may explain frame drops. I don't know how I missed this part but I'm very sorry for that. I'll test again and let you know if anything have changed.