audio recording mic & app?

[r4mst3r]

Hi all,

Thanks for great plugin. The screenrecording side of things is working great.

But with audio, is the plugin meant to record app audio and microphone audio at same time?

Backstory:

I am trying to implement video and audio recorder for a video and audio call react native mobile app using react-native-webrtc. Basically, when a call is in progress, I want to be able to record video and audio.

Behavior:

Plugin records entire screen, which solves the purpose. It starts to record mic audio, however when the call is established (webrtc audio/video tracks are set etc.) it no longer records audio.

Any one tried to do this?

Any ideas?

Thanks

Edit:

On Android: it records audio before and during webrtc call.
On iOS: it records audio, but as soon as call getting answered no audio recorded

[kyadalu1]

Try this https://www.youtube.com/watch?v=2bGLn10RGF4

[ivergot-rc]

@r4mst3r I have the exact same problem - recording a webRTC session on iOS. Did you find a solution for this issue?

[r4mst3r]

@ivergot-rc no solution as of yet. Im at a stage where i would need to debug, but given it works on android and not on iphone, it tells me it might be a codec issue.

realised it records audio up until the remote session audio tracks get added..

[r4mst3r]

@yutasuzuki Would appreciate your input on this issue. Your plugin records audio and video on android and ios. As soon as Webrtc connection gets established, audio is no longer recorded. any idea why? this behavior is only on iOS, on android video and audio are recorded.

[ivergot-rc]

@r4mst3r I experimented with iOS AVAudioSession object and setting its category, mode, etc, and I managed to get it to record the in-call audio. The configuration that worked for me: mode - AVAudioSessionModeDefault, category - AVAudioSessionCategoryPlayAndRecord, and I also called the setAllowHapticsAndSystemSoundsDuringRecording method 'YES' as a param.
The audio session is a shared session so you can write your own module and call it from RN code and it should work.

[r4mst3r]

@ivergot-rc that sounds promising. To be honest, I am not familiar with native ios, do you mind posting a code snippet? I would greatlty appreciate it. Or better yet the code or something. im searching these names in the pluigin code, and im finding nothing.

Edit:
I managed to get something together in terms of code, I added the following code at the begining of startRecord() in the plugin, still not recording the webrtc audio, so I need to do soemthing special from webrtc side?

`// Retrieve the shared audio session.
self.audioSession = [AVAudioSession sharedInstance];
NSError *averror = nil;

// Set the audio session category and mode.
[self.audioSession setCategory:AVAudioSessionCategoryPlayAndRecord error:&averror];

if (averror) {
    NSLog(@"Error setting category: %@", averror.localizedDescription);
} else {
    // Set mode to Default
    [self.audioSession setMode:AVAudioSessionModeVideoChat error:&averror];
    if (averror) {
        NSLog(@"Error setting setMode: %@", averror.localizedDescription);
    } else {
        // Enable haptics system sounds during recording
        [self.audioSession setAllowHapticsAndSystemSoundsDuringRecording:YES error:&averror];

        if (averror) {
            NSLog(@"Error setting allowHapticsAndSystemSoundsDuringRecording: %@", averror.localizedDescription);
        } else {
            // Activate the audio session
            [self.audioSession setActive:YES error:&averror];
        }
    }
}`

[sathit-poo]

same issue