【创龙科技imx8开发板】让嵌入式应用更简单——基于TLIMX8-EVM 评估板的多媒体终端产品快速开发

楼主

原创

qinyunti

99 主题
118 帖子
2015 积分

身份：LV5 资深技术员

E币：11195

发消息

 2720

 0

发表于 2023-4-11 11:28:20

显示全部楼层

转自公众号,欢迎关注
公众号
前言

本开发板具备非常强的多媒体能力,特别适合多媒体终端,广告机,室外播放器等应用场合。本篇就全方面的进行多媒体相关的开发体验。

一.安装ffmpeg

sudo apt-get install ffmpeg

查看版本ffmpeg

root@IMX8-Tronlong:~# ffmpeg -v

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/aarch64-linux-gnu --incdir=/usr/include/aarch64-linux-gnu --arch=arm64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared

libavutil 56. 31.100 / 56. 31.100

libavcodec 58. 54.100 / 58. 54.100

libavformat 58. 29.100 / 58. 29.100

libavdevice 58. 8.100 / 58. 8.100

libavfilter 7. 57.100 / 7. 57.100

libavresample 4. 0. 0 / 4. 0. 0

libswscale 5. 5.100 / 5. 5.100

libswresample 3. 5.100 / 3. 5.100

libpostproc 55. 5.100 / 55. 5.100

Missing argument for option 'v'.

Error splitting the argument list: Invalid argument

root@IMX8-Tronlong:~#

复制代码

ffplay

root@IMX8-Tronlong:~# ffplay

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

libavutil 56. 31.100 / 56. 31.100

libavcodec 58. 54.100 / 58. 54.100

libavformat 58. 29.100 / 58. 29.100

libavdevice 58. 8.100 / 58. 8.100

libavfilter 7. 57.100 / 7. 57.100

libavresample 4. 0. 0 / 4. 0. 0

libswscale 5. 5.100 / 5. 5.100

libswresample 3. 5.100 / 3. 5.100

libpostproc 55. 5.100 / 55. 5.100

Simple media player

usage: ffplay [options] input_file

An input file must be specified

Use -h to get full help or, even better, run 'man ffplay'

root@IMX8-Tronlong:~#

复制代码

ffprobe

root@IMX8-Tronlong:~# ffprobe

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

libavutil 56. 31.100 / 56. 31.100

libavcodec 58. 54.100 / 58. 54.100

libavformat 58. 29.100 / 58. 29.100

libavdevice 58. 8.100 / 58. 8.100

libavfilter 7. 57.100 / 7. 57.100

libavresample 4. 0. 0 / 4. 0. 0

libswscale 5. 5.100 / 5. 5.100

libswresample 3. 5.100 / 3. 5.100

libpostproc 55. 5.100 / 55. 5.100

Simple multimedia streams analyzer

usage: ffprobe [OPTIONS] [INPUT_FILE]

You have to specify one input file.

Use -h to get full help or, even better, run 'man ffprobe'.

root@IMX8-Tronlong:~#

复制代码

二.下载开发库

wget https://github.com/BtbN/FFmpeg-Builds/releases/download/latest/ffmpeg-master-latest-linuxarm64-gpl-shared.tar.xz

sudo apt-get install xz-utils

xz -d ffmpeg-master-latest-linuxarm64-gpl-shared.tar.xz

tar -xvf ffmpeg-master-latest-linuxarm64-gpl-shared.tar

复制代码

三.性能测试3.1PC机上

下载测试文件

wget https://www.sample-videos.com/video123/mp4/720/big_buck_bunny_720p_20mb.mp4 --no-check-certificate

mv big_buck_bunny_720p_20mb.mp4 test.mp4

ffmpeg -benchmark -i test.mp4 -f null -

复制代码

lhj@lhj:~$ ffmpeg -benchmark -i test.mp4 -f null -

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

configuration: --disable-x86asm

libavutil 57. 44.100 / 57. 44.100

libavcodec 59. 60.100 / 59. 60.100

libavformat 59. 37.100 / 59. 37.100

libavdevice 59. 8.101 / 59. 8.101

libavfilter 8. 56.100 / 8. 56.100

libswscale 6. 8.112 / 6. 8.112

libswresample 4. 9.100 / 4. 9.100

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test.mp4':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

creation_time : 1970-01-01T00:00:00.000000Z

encoder : Lavf53.24.2

Duration: 00:01:57.31, start: 0.000000, bitrate: 1436 kb/s

Stream #0:0[0x1](und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(progressive), 1280x720 [SAR 1:1 DAR 16:9], 1048 kb/s, 25 fps, 25 tbr, 12800 tbn (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

vendor_id : [0][0][0][0]

Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, 5.1, fltp, 383 kb/s (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : SoundHandler

vendor_id : [0][0][0][0]

Stream mapping:

Stream #0:0 -> #0:0 (h264 (native) -> wrapped_avframe (native))

Stream #0:1 -> #0:1 (aac (native) -> pcm_s16le (native))

Press [q] to stop, [?] for help

Output #0, null, to 'pipe:':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

encoder : Lavf59.37.100

Stream #0:0(und): Video: wrapped_avframe, yuv420p(progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

vendor_id : [0][0][0][0]

encoder : Lavc59.60.100 wrapped_avframe

Stream #0:1(und): Audio: pcm_s16le, 48000 Hz, 5.1, s16, 4608 kb/s (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : SoundHandler

vendor_id : [0][0][0][0]

encoder : Lavc59.60.100 pcm_s16le

frame= 2932 fps=1873 q=-0.0 Lsize=N/A time=00:01:57.29 bitrate=N/A speed=74.9x

video:1374kB audio:65988kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

bench: utime=9.655s stime=1.482s rtime=1.573s

bench: maxrss=95948kB

lhj@lhj:~$

复制代码

3.2开发板上

下载测试文件

wget https://www.sample-videos.com/video123/mp4/720/big_buck_bunny_720p_20mb.mp4 --no-check-certificate

mv big_buck_bunny_720p_20mb.mp4 test.mp4

ffmpeg -benchmark -i test.mp4 -f null -

复制代码

root@IMX8-Tronlong:~# ffmpeg -benchmark -i test.mp4 -f null -

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

libavutil 56. 31.100 / 56. 31.100

libavcodec 58. 54.100 / 58. 54.100

libavformat 58. 29.100 / 58. 29.100

libavdevice 58. 8.100 / 58. 8.100

libavfilter 7. 57.100 / 7. 57.100

libavresample 4. 0. 0 / 4. 0. 0

libswscale 5. 5.100 / 5. 5.100

libswresample 3. 5.100 / 3. 5.100

libpostproc 55. 5.100 / 55. 5.100

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test.mp4':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

creation_time : 1970-01-01T00:00:00.000000Z

encoder : Lavf53.24.2

Duration: 00:01:57.31, start: 0.000000, bitrate: 1436 kb/s

Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 1048 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, 5.1, fltp, 383 kb/s (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : SoundHandler

Stream mapping:

Stream #0:0 -> #0:0 (h264 (native) -> wrapped_avframe (native))

Stream #0:1 -> #0:1 (aac (native) -> pcm_s16le (native))

Press [q] to stop, [?] for help

Output #0, null, to 'pipe:':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

encoder : Lavf58.29.100

Stream #0:0(und): Video: wrapped_avframe, yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

encoder : Lavc58.54.100 wrapped_avframe

Stream #0:1(und): Audio: pcm_s16le, 48000 Hz, 5.1, s16, 4608 kb/s (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : SoundHandler

encoder : Lavc58.54.100 pcm_s16le

frame= 2932 fps=214 q=-0.0 Lsize=N/A time=00:01:57.31 bitrate=N/A speed=8.55x

video:1535kB audio:65988kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

bench: utime=49.453s stime=1.131s rtime=13.728s

bench: maxrss=68924kB

root@IMX8-Tronlong:~#

复制代码

3.3对比

PC上是fps=1873

开发板上是fps=214

大概是8.6倍数

PC是固态硬盘,开发板是SD卡,

PC是12th Gen Intel(R) Core(TM) i5-12500H 2.50 GHz

所以开发板的性能已经非常不错了。

四.编解码测试4.1编码测试4.1.1代码

vi encode_video.c

复制代码

encode_video.c.txt (6.48 KB, 下载次数: 0)

2023-4-11 11:22 上传

点击文件名下载附件

4.1.2编译

gcc encode_video.c -Iffmpeg-master-latest-linuxarm64-gpl-shared/include -Lffmpeg-master-latest-linuxarm64-gpl-shared/lib -lavcodec -lavutil -lswresample -o encode

复制代码

4.1.3运行

export LD_LIBRARY_PATH=/root/ffmpeg-master-latest-linuxarm64-gpl-shared/lib:$LD_LIBRARY_PATH

./encode encode.bin mpeg1video

复制代码

4.1.4结果

root@IMX8-Tronlong:~# ./encode encode.bin mpeg1video

Send frame 0

Send frame 1

Write packet 0 (size= 6731)

Send frame 2

Write packet 2 (size= 3727)

Send frame 3

Write packet 1 (size= 1698)

Send frame 4

Write packet 4 (size= 2744)

Send frame 5

Write packet 3 (size= 1676)

Send frame 6

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 6 (size= 2955)

Send frame 7

Write packet 5 (size= 1810)

Send frame 8

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 8 (size= 3170)

Send frame 9

Write packet 7 (size= 1937)

Send frame 10

Write packet 10 (size=12306)

Send frame 11

Write packet 9 (size= 2173)

Send frame 12

Write packet 12 (size= 3770)

Send frame 13

Write packet 11 (size= 2064)

Send frame 14

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 14 (size= 3340)

Send frame 15

Write packet 13 (size= 1941)

Send frame 16

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 16 (size= 3121)

Send frame 17

Write packet 15 (size= 1897)

Send frame 18

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 18 (size= 3392)

Send frame 19

Write packet 17 (size= 2172)

Send frame 20

Write packet 20 (size=12266)

Send frame 21

Write packet 19 (size= 2169)

Send frame 22

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 22 (size= 4000)

Send frame 23

Write packet 21 (size= 2018)

Send frame 24

[mpeg1video @ 0xaaaafd1f68f0] warning, clipping 1 dct coefficients to -255..255

Write packet 24 (size= 3072)

Write packet 23 (size= 1935)

root@IMX8-Tronlong:~#

复制代码

4.2解码测试4.2.1代码

vi decode_video.c

复制代码

decode_video.c.txt (5.43 KB, 下载次数: 0)

2023-4-11 11:29 上传
点击文件名下载附件
4.2.2编译

gcc decode_video.c -Iffmpeg-master-latest-linuxarm64-gpl-shared/include -Lffmpeg-master-latest-linuxarm64-gpl-shared/lib -lavcodec -lavutil -lswresample -o decode

复制代码

4.2.3运行

export LD_LIBRARY_PATH=/root/ffmpeg-master-latest-linuxarm64-gpl-shared/lib:$LD_LIBRARY_PATH

./decode encode.bin decode.bin

复制代码

4.2.4结果

root@IMX8-Tronlong:~# ./decode encode.bin decode.bin

saving frame 1

saving frame 2

saving frame 3

saving frame 4

saving frame 5

saving frame 6

saving frame 7

saving frame 8

saving frame 9

saving frame 10

saving frame 11

saving frame 12

saving frame 13

saving frame 14

saving frame 15

saving frame 16

saving frame 17

saving frame 18

saving frame 19

saving frame 20

saving frame 21

saving frame 22

saving frame 23

saving frame 24

saving frame 25

root@IMX8-Tronlong:~# ls

8188eu.ko decode.bin-10 decode.bin-14 decode.bin-18 decode.bin-21 decode.bin-25 decode.bin-6 decode_video.c ffmpeg-master-latest-linuxarm64-gpl-shared udhcpd.conf

ap_setup.sh decode.bin-11 decode.bin-15 decode.bin-19 decode.bin-22 decode.bin-3 decode.bin-7 encode ffmpeg-master-latest-linuxarm64-gpl-shared.tar wifi_setup.sh

decode decode.bin-12 decode.bin-16 decode.bin-2 decode.bin-23 decode.bin-4 decode.bin-8 encode.bin rtl_hostapd_2G.conf

decode.bin-1 decode.bin-13 decode.bin-17 decode.bin-20 decode.bin-24 decode.bin-5 decode.bin-9 encode_video.c test.mp4

root@IMX8-Tronlong:~#

复制代码

五.视频播放器

ffplay test.mp4

复制代码

可以看到播放效果如下

六.网络视频播放器6.1PC端下载VLC安装

https://www.videolan.org/

打开

弹出用户账户控制点击是

6.2开发板中发送流

ffmpeg -re -i test.mp4 -an -vcodec copy -f rtp rtp://192.168.31.64:5004

复制代码

打印如下

root@IMX8-Tronlong:~# ffmpeg -re -i test.mp4 -an -vcodec copy -f rtp rtp://192.168.31.64:5004

built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)

libavutil 56. 31.100 / 56. 31.100

libavcodec 58. 54.100 / 58. 54.100

libavformat 58. 29.100 / 58. 29.100

libavdevice 58. 8.100 / 58. 8.100

libavfilter 7. 57.100 / 7. 57.100

libavresample 4. 0. 0 / 4. 0. 0

libswscale 5. 5.100 / 5. 5.100

libswresample 3. 5.100 / 3. 5.100

libpostproc 55. 5.100 / 55. 5.100

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test.mp4':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

creation_time : 1970-01-01T00:00:00.000000Z

encoder : Lavf53.24.2

Duration: 00:01:57.31, start: 0.000000, bitrate: 1436 kb/s

Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 1048 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, 5.1, fltp, 383 kb/s (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : SoundHandler

Output #0, rtp, to 'rtp://192.168.31.64:5004':

Metadata:

major_brand : isom

minor_version : 512

compatible_brands: isomiso2avc1mp41

encoder : Lavf58.29.100

Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 1048 kb/s, 25 fps, 25 tbr, 90k tbn, 25 tbc (default)

Metadata:

creation_time : 1970-01-01T00:00:00.000000Z

handler_name : VideoHandler

SDP:

v=0

o=- 0 0 IN IP4 127.0.0.1

s=No Name

c=IN IP4 192.168.31.64

t=0 0

a=tool:libavformat 58.29.100

m=video 5004 RTP/AVP 96

b=AS:1048