Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

All about WTware on Raspberry. WTware works with Raspberry Pi 4, Raspberry Pi 3B+, Pi 3 and Pi 2 devices
http://www.winterminal.com
Post Reply
cory1768
Posts: 7
Joined: Sun Sep 03, 2017 5:05 am

Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

Post by cory1768 »

I have read in this article USB-sound redirection (cameras, garniture, USB speakers) , if I understand correctly, that you could only have one or the other in terms of either a microphone or sound output. This does seem to be the case, when the microphone is built into the web cam. I have tried a mixture of things in the config file such as defining the sound hardware value

This gives me playback sound on the virtual desktop:

Code: Select all

sound=on, hw:0:0

Code: Select all

microphone = on
If I do:

Code: Select all

sound=remote
I lose playback sound but now the microphone built into the usb web cam is working and recognized by the virtual desktop.


I guess my question is, is this something that has been resolved and I am just missing a ling in the config to make both the speakers over HDMI and the microphone through the webcam work or is this still in the sate where you would have to have a separate usb microphone?

I have also tried microphone = on, hw:1:0 and other values but those throw errors, not entirely sure I have the right HW referenced for the microphone as I am not sure how to obtain that usb value. If anyone could point me in the correct direction I would appreciate it.

Code: Select all

[ rdpclient 732] [   33.532079] RDP5 encryption (X.509).
[ rdpclient 732] [   33.583894] GFX codec.
[ rdpclient 732] [   34.117746] Run 4 tile threads.
[ rdpclient 732] [   34.134829] errorInfo 0x00000000.
[ rdpclient 732] [   34.597069] SessionId 0x00000002: DomainName\UserID.
[ rdpclient 732] [  100.717292] Sound version: 8.
[ rdpclient 732] [  100.717509] ADPCM sound compression.
[ rdpclient 732] [  100.717761] Sound redirection: 44100 frames per second.
[        rdpsnd] [  101.170093] ALSA: use device hw:0,0.
[        rdpsnd] [  101.171007] ALSA: Hardware rate 44100Hz.
[        rdpsnd] [  101.171337] ALSA: chunk size 512 frames, 1024 bytes, 11 msec.
[rdpdr-usb 0458:708c] [  208.744751]  rdpdr[usb]-main.cpp ( 2280): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [  208.745674]  rdpdr[usb]-main.cpp ( 2269): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [  224.787619]  rdpdr[usb]-main.cpp ( 2280): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [  224.788652]  rdpdr[usb]-main.cpp ( 2269): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[      rdpaudin] [  241.851317] ALSA: /sys/class/sound/pcmC0D0c/dev does not exist. Choose another recording device.
[ rdpclient 732] [  241.851409] Audin daemon is dead.
[      rdpaudin] [  241.851505] ALSA ERROR: no sound devices in hw:0. Correct sound= value.
[ rdpclient 732] [  241.851551]  rdpclient-audin.cpp (  266): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[      rdpaudin] [  241.851636]    rdpaudin-main.cpp (  529): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[ rdpclient 732] [  241.851681] I'm tired.
[          pfac] [  241.851990] Process pid 695 terminated, status 00000100.
[            gm] [  241.852311] Final message: I'm tired.
[        rdpsnd] [  241.887916] Link lost.
[rdpdr-usb 041e:4095] [  241.888029]  rdpdr[usb]-main.cpp ( 1794): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[          pfac] [  241.888679] Process pid 732 terminated, status 00000009.
akatik
SUPPORT
SUPPORT
Posts: 630
Joined: Mon Jan 17, 2005 6:30 pm
Contact:

Re: Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

Post by akatik »

cory1768 wrote:...to make both the speakers over HDMI and the microphone through the webcam...
There is no such thing as "redirect 42% of USB device" in RDP. Whole USB device is redirected. If you redirect USB device "webcam", thin client can not interact with any of it's part anymore.
cory1768 wrote:..have to have a separate usb microphone?
Yes. Or separate USB speakers.
cory1768
Posts: 7
Joined: Sun Sep 03, 2017 5:05 am

Re: Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

Post by cory1768 »

I guess I am a little confused on this, the setup works with windows client to windows vdi through remotefx. If I attempt the same setup with wtware I can either have sound playback or mic recording, I cannot find a setting that allows both.

Maybe this will help, sort of visual reference:

VDI >> Sound >> ThinClient >> HDMI Speakers

(I think this is how the next part would flow as you are logged into a VDI so with pass-through the mic is still recording, result is being passed to VDI which in turns needs to pass to the playback device)
webcam Sound Record >> ThinClient >> VDI >> Sound >> ThinClient >> HDMI Speakers

I can successfully get video from the webcam but its almost as if its not being passed correctly in the USB redirection and its not being seen as an input device for sound on the VDI.

If I set sound=remote then in the VDI it sees the webcam as a sound input device, but I lose any playback device, as in I can no longer get sound back.
And attempting to show recording devices in the Windows VDI Client results in this crash on the thinClient: (I think this is because there is no output or playback device anymore.)

Code: Select all

[rdpdr-usb 0458:708c] [ 1028.989801]  rdpdr[usb]-main.cpp ( 2280): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [ 1029.062784]  rdpdr[usb]-main.cpp ( 2269): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [ 1030.233727]  rdpdr[usb]-main.cpp ( 2280): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 0458:708c] [ 1030.306762]  rdpdr[usb]-main.cpp ( 2269): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 041e:4095] [ 1030.313446]  rdpdr[usb]-main.cpp ( 2280): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[rdpdr-usb 041e:4095] [ 1030.333897]  rdpdr[usb]-main.cpp ( 2269): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[        KERNEL] [ 1032.282654] Unable to handle kernel paging request at virtual address fe61fc01
[        KERNEL] [ 1032.282665] pgd = b93e0000
[        KERNEL] [ 1032.282670] [fe61fc01] *pgd=00000000
[        KERNEL] [ 1032.282686] Internal error: Oops: 5 [#1] SMP ARM
[        KERNEL] [ 1032.282700] Modules linked in: smsc95xx
[        KERNEL] [ 1032.282720] CPU: 2 PID: 676 Comm: rdpclient Not tainted 4.9.39 #9
[        KERNEL] [ 1032.282729] Hardware name: BCM2835
[        KERNEL] [ 1032.282739] task: b9a14ec0 task.stack: b90ce000
[        KERNEL] [ 1032.282762] PC is at __kmalloc_track_caller+0x80/0x1b4
[        KERNEL] [ 1032.282772] LR is at 0x145
[        KERNEL] [ 1032.282785] pc : [<801ec73c>]    lr : [<00000145>]    psr: a0000013
[        KERNEL] [ 1032.282785] sp : b90cfd00  ip : b90cfd00  fp : b90cfd24
[        KERNEL] [ 1032.282797] r10: ffffffff  r9 : 8045c0b8  r8 : 00000780
[        KERNEL] [ 1032.282807] r7 : 80409314  r6 : 024102c0  r5 : b98019c0  r4 : fe61fc01
[        KERNEL] [ 1032.282817] r3 : 00000000  r2 : b9f8bf50  r1 : b90cfd00  r0 : 39491000
[        KERNEL] [ 1032.282829] Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
[        KERNEL] [ 1032.282838] Control: 10c5383d  Table: 393e006a  DAC: 00000055
[        KERNEL] [ 1032.282848] Process rdpclient (pid: 676, stack limit = 0xb90ce210)
[        KERNEL] [ 1032.282858] Stack: (0xb90cfd00 to 0xb90d0000)
[        KERNEL] [ 1032.282874] fd00: b90cfd5f 024000c0 024000c0 80409314 00000780 8045c0b8 b90cfd4c b90cfd28
[        KERNEL] [ 1032.282890] fd20: 80409254 801ec6c8 b8606180 00000688 024000c0 b9813a80 00000001 8045c0b8
[        KERNEL] [ 1032.282905] fd40: b90cfd8c b90cfd50 80409314 80409234 b90cfd5f 00010001 00000004 00000001
[        KERNEL] [ 1032.282920] fd60: 00000005 b92385c0 000005a8 00000000 b90cfe78 b92385c0 b8606000 b90cfe80
[        KERNEL] [ 1032.282936] fd80: b90cfdb4 b90cfd90 8045c0b8 804092ac b90cfdb4 b90cfda0 b9238678 00000000
[        KERNEL] [ 1032.282951] fda0: 000005a8 b90cfe78 b90cfe44 b90cfdb8 8045cbf4 8045c070 8014639c 801452f0
[        KERNEL] [ 1032.282966] fdc0: 801462ac b9a14ec0 80b4d4b0 38e38e39 b90ce000 00000000 00000000 00000000
[        KERNEL] [ 1032.282981] fde0: 00000000 b94f5380 00000001 00000000 00000000 00000020 000005a8 000005a8
[        KERNEL] [ 1032.282998] fe00: 00000000 000005a8 7fffffff 00000000 00000000 00000000 b90cfe30 b92385c0
[        KERNEL] [ 1032.283012] fe20: 00000000 00000000 00000000 b99c1d80 b94f4a80 00000000 b90cfe64 b90cfe48
[        KERNEL] [ 1032.283028] fe40: 804852d4 8045c834 b90cfe84 b90cfe58 b90cfee0 00000000 b90cfe74 b90cfe68
[        KERNEL] [ 1032.283043] fe60: 804029d8 8048524c b90cfecc b90cfe78 80402a70 804029c8 00000000 00000000
[        KERNEL] [ 1032.283058] fe80: 00000001 000005a8 000000cc b90cfed8 00000001 00000001 00000000 00000000
[        KERNEL] [ 1032.283072] fea0: 00000000 b90cfef8 b99c1d80 00000000 b90cff78 00000674 00000000 00000000
[        KERNEL] [ 1032.283088] fec0: b90cff3c b90cfed0 801fb48c 804029f4 00000674 80401360 0133c1fb 00000674
[        KERNEL] [ 1032.283103] fee0: 00000001 00000000 00000674 b90cfed8 00000001 00000001 b99c1d80 00000000
[        KERNEL] [ 1032.283118] ff00: 00000000 00000000 00000000 00000000 00000000 00000000 b99c1d80 0133c1fb
[        KERNEL] [ 1032.283133] ff20: 00000674 00000000 0133c1fb 00000674 b90cff74 b90cff40 801fb834 801fb3d0
[        KERNEL] [ 1032.283148] ff40: b90cff5c b90cff50 8021a350 80219be0 b99c1d81 b99c1d80 00000000 00000000
[        KERNEL] [ 1032.283163] ff60: 0133c1fb 00000674 b90cffa4 b90cff78 801fd49c 801fb790 00000000 00000000
[        KERNEL] [ 1032.283178] ff80: 0133c1fb 013321f8 00000674 00000004 801079c4 b90ce000 00000000 b90cffa8
[        KERNEL] [ 1032.283194] ffa0: 80107820 801fd464 0133c1fb 013321f8 00000009 0133c1fb 00000674 00000000
[        KERNEL] [ 1032.283209] ffc0: 0133c1fb 013321f8 00000674 00000004 00000002 7edbca3e 00000000 0008c9c8
[        KERNEL] [ 1032.283224] ffe0: 00000000 7edbc8d0 76f6edeb 76f6edf2 00000030 00000009 00010eac 00010eac
[        KERNEL] [ 1032.283230] Backtrace: 
[        KERNEL] [ 1032.283256] [<801ec6bc>] (__kmalloc_track_caller) from [<80409254>] (__kmalloc_reserve+0x2c/0x78)
[        KERNEL] [ 1032.283274]  r9:8045c0b8 r8:00000780 r7:80409314 r6:024000c0 r5:024000c0 r4:b90cfd5f
[        KERNEL] [ 1032.283289] [<80409228>] (__kmalloc_reserve) from [<80409314>] (__alloc_skb+0x74/0x14c)
[        KERNEL] [ 1032.283305]  r9:8045c0b8 r8:00000001 r7:b9813a80 r6:024000c0 r5:00000688 r4:b8606180
[        KERNEL] [ 1032.283322] [<804092a0>] (__alloc_skb) from [<8045c0b8>] (sk_stream_alloc_skb+0x54/0x1c8)
[        KERNEL] [ 1032.283339]  r10:b90cfe80 r9:b8606000 r8:b92385c0 r7:b90cfe78 r6:00000000 r5:000005a8
[        KERNEL] [ 1032.283347]  r4:b92385c0
[        KERNEL] [ 1032.283363] [<8045c064>] (sk_stream_alloc_skb) from [<8045cbf4>] (tcp_sendmsg+0x3cc/0xbcc)
[        KERNEL] [ 1032.283376]  r7:b90cfe78 r6:000005a8 r5:00000000 r4:b9238678
[        KERNEL] [ 1032.283394] [<8045c828>] (tcp_sendmsg) from [<804852d4>] (inet_sendmsg+0x94/0xc8)
[        KERNEL] [ 1032.283410]  r10:00000000 r9:b94f4a80 r8:b99c1d80 r7:00000000 r6:00000000 r5:00000000
[        KERNEL] [ 1032.283419]  r4:b92385c0
[        KERNEL] [ 1032.283439] [<80485240>] (inet_sendmsg) from [<804029d8>] (sock_sendmsg+0x1c/0x2c)
[        KERNEL] [ 1032.283449]  r5:00000000 r4:b90cfee0
[        KERNEL] [ 1032.283465] [<804029bc>] (sock_sendmsg) from [<80402a70>] (sock_write_iter+0x88/0xbc)
[        KERNEL] [ 1032.283484] [<804029e8>] (sock_write_iter) from [<801fb48c>] (__vfs_write+0xc8/0x120)
[        KERNEL] [ 1032.283500]  r9:00000000 r8:00000000 r7:00000674 r6:b90cff78 r5:00000000 r4:b99c1d80
[        KERNEL] [ 1032.283516] [<801fb3c4>] (__vfs_write) from [<801fb834>] (vfs_write+0xb0/0x1f8)
[        KERNEL] [ 1032.283532]  r9:00000674 r8:0133c1fb r7:00000000 r6:00000674 r5:0133c1fb r4:b99c1d80
[        KERNEL] [ 1032.283550] [<801fb784>] (vfs_write) from [<801fd49c>] (SyS_write+0x44/0x98)
[        KERNEL] [ 1032.283566]  r9:00000674 r8:0133c1fb r7:00000000 r6:00000000 r5:b99c1d80 r4:b99c1d81
[        KERNEL] [ 1032.283585] [<801fd458>] (SyS_write) from [<80107820>] (ret_fast_syscall+0x0/0x34)
[        KERNEL] [ 1032.283601]  r9:b90ce000 r8:801079c4 r7:00000004 r6:00000674 r5:013321f8 r4:0133c1fb
[        KERNEL] [ 1032.283616] Code: e7934000 e3540000 0a000038 e5953014 (e794c003) 
[        KERNEL] [ 1032.283629] ---[ end trace 27e1781f0913c7bf ]---
If I set sound=on and microphone=on then I get my sound playback and the VDI shows there is a MIC, but if I click in windows show recording devices, it crashes back to the thin client screen (The VDI OS itself doesn't crash). This is the log when that happens:

Code: Select all

[ rdpclient 706] [   39.458929] Enable font smoothing and Desktop Composition.
[ rdpclient 706] [   39.463305] RDP5 encryption (X.509).
[ rdpclient 706] [   39.506908] GFX codec.
[ rdpclient 706] [   40.034295] Run 4 tile threads.
[ rdpclient 706] [   40.053472] errorInfo 0x00000000.
[ rdpclient 706] [   40.480191] SessionId 0x00000002: .
[      rdpaudin] [   40.849248] ALSA: /sys/class/sound/pcmC0D1c/dev does not exist. Choose another recording device.
[      rdpaudin] [   40.849347] ALSA ERROR: no sound devices in hw:0. Correct sound= value.
[      rdpaudin] [   40.849400]    rdpaudin-main.cpp (  529): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[ rdpclient 706] [   40.849566] Audin daemon is dead.
[ rdpclient 706] [   40.849611]  rdpclient-audin.cpp (  266): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
[ rdpclient 706] [   40.849654] I'm tired.
[          pfac] [   40.860119] Process pid 696 terminated, status 00000100.
[            gm] [   40.860185] Final message: I'm tired.
[RDP] close kotopipe (n = 0, errno 11).
[        rdpsnd] [   40.862738] Link lost.
[          pfac] [   40.862781] Process pid 706 terminated, status 00000009.
[rdpdr-usb 0458:708c] [   40.882573] Caught signal SIGPIPE.
[rdpdr-usb 0458:708c] [   40.882624]  rdpdr[usb]-main.cpp ( 1398): -- ERROR -- INTERNAL ERROR. Please, contact WTware tech support.
Any ideas?
Last edited by cory1768 on Fri Sep 08, 2017 2:46 am, edited 1 time in total.
akatik
SUPPORT
SUPPORT
Posts: 630
Joined: Mon Jan 17, 2005 6:30 pm
Contact:

Re: Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

Post by akatik »

Please, give me full logs. From boot to error, as short as possible.
And remove all redundant lines from config.. Put only lines you are sure that are absolutely necessary.
cory1768
Posts: 7
Joined: Sun Sep 03, 2017 5:05 am

Re: Raspberry Pi3 RemoteFX Server 2016 Sound/Video Redirection

Post by cory1768 »

I have attached a zip of the two logs, one with sound=on and one with sound=remote. I have also shortened the logs to only show what I think is needed and included a couple screenshots inside the vdi once logged in. If you require the full logs I have those as well and can send them if you request them.
Attachments
SoundRemote.zip
(100.6 KiB) Downloaded 374 times
SoundOn.zip
(81.43 KiB) Downloaded 367 times
Post Reply