一、前言
搞定了实时预览后,另一个功能就是录像回放,录像回放和视频点播功能完全一致,唯一的区别就是发送点播的sdp信息中携带了开始时间和结束时间,因为是录像文件,所以有这个时间,而实时视频预览这个对应的值是0,录像文件是可以切换播放进度的,实时视频是无法切换进度的,因为当前是7点钟,不可能切换到未来的某个时间点查看到对应的视频画面,遇到过几个用户居然希望问为何实时预览功能不支持切换进度,这个从逻辑层面来说就是无法实现的。
要实现录像回放,首先就是要拿到录像文件,也就是录像文件查询,发个查询指令到设备端,会返回录像文件的信息,这里有个细节强调下,返回的录像文件信息并不是在一个xml中,可能一个xml中有多个录像文件信息,也可能只有一个,不同厂家约定不同,都是合规的,所以在tcp模式交互的sip数据中,很可能出现粘包的情况,需要自己取出来逐个解析,这个细节很多国标工具没有实现。
在回放的过程中,还可以任意切换播放进度,不少厂家用的很老的机制实现的切换进度,也就是重新点播,这样好处是兼容了各个国标版本,坏处是相当于重新点播,切换过程会黑屏中断2s左右。其实国标协议就提供了切换播放进度的sip协议,只需要发给设备端即可,设备收到切换进度指令后,会立即用指定进度的开始的位置发流过来,这边收到后立即解析即可。
//查询文件:服务端-》设备端
MESSAGE sip:34020000001320000002@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bKe9591d42a3cc4518a421b62aa668428d
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1038
To: <sip:34020000001320000002@192.168.0.64:5060>
Call-ID: a6d47d255da543e79f484475b49340de
CSeq: 41 MESSAGE
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 262
Content-Type: application/MANSCDP+xml
Contact: <sip:34020000002000000001@192.168.0.110:15060><?xml version="1.0" encoding="GB2312"?>
<Query><CmdType>RecordInfo</CmdType><SN>10035</SN><DeviceID>34020000001310000001</DeviceID><StartTime>2025-04-18T00:00:00</StartTime><EndTime>2025-04-19T23:59:59</EndTime><Type>all</Type>
</Query>//文件返回:设备端-》服务端
MESSAGE sip:34020000002000000001@3402000000 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.64:5060;rport;branch=z9hG4bK727604973
From: <sip:34020000001320000002@3402000000>;tag=593479594
To: <sip:34020000002000000001@3402000000>
Call-ID: 40677081
CSeq: 20 MESSAGE
Content-Type: Application/MANSCDP+xml
Max-Forwards: 70
User-Agent: IP Camera
Content-Length: 3161<?xml version="1.0" encoding="GB2312"?>
<Response>
<CmdType>RecordInfo</CmdType>
<SN>10035</SN>
<DeviceID>34020000001310000001</DeviceID>
<Name>hikangname</Name>
<SumNum>134</SumNum>
<RecordList Num="2">
<Item>
<DeviceID>34020000001310000001</DeviceID>
<Name>hikangname</Name>
<FilePath>file_path</FilePath>
<Address>Address 1</Address>
<StartTime>2025-04-18T10:23:02</StartTime>
<EndTime>2025-04-18T10:40:20</EndTime>
<Secrecy>0</Secrecy>
<Type>time</Type>
<FileSize>263094272</FileSize>
</Item>
<Item>
<DeviceID>34020000001310000001</DeviceID>
<Name>hikangname</Name>
<FilePath>file_path</FilePath>
<Address>Address 1</Address>
<StartTime>2025-04-18T10:40:20</StartTime>
<EndTime>2025-04-18T10:57:36</EndTime>
<Secrecy>0</Secrecy>
<Type>time</Type>
<FileSize>262488064</FileSize>
</Item>
</RecordList>
</Response>//点播请求:服务端-》设备端
INVITE sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK3d8b174429304a9d8af106f460debf9b
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 42 INVITE
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 342
Content-Type: application/sdp
Contact: <sip:34020000002000000001@192.168.0.110:15060>
Subject: 34020000001310000001:1000010003,34020000002000000001:0v=0
o=34020000001310000001 0 0 IN IP4 192.168.0.110
s=Download
u=34020000001310000001:0
c=IN IP4 192.168.0.110
t=1744946094 1744947129
m=video 6902 RTP/AVP 96 97 98
a=recvonly
a=setup:passive
a=connection:new
a=rtpmap:96 PS/90000
a=rtpmap:97 MPEG4/90000
a=rtpmap:98 H264/90000
a=downloadspeed:8
a=streamprofile:1
y=1000010003//请求应答:设备端-》服务端
SIP/2.0 200 OK
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK3d8b174429304a9d8af106f460debf9b
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 42 INVITE
Contact: <sip:34020000001320000002@192.168.0.64:5060>
Content-Type: application/sdp
User-Agent: IP Camera
Content-Length: 211v=0
o=34020000001320000002 539 539 IN IP4 192.168.0.64
s=Download
c=IN IP4 192.168.0.64
t=0 0
m=video 15060 RTP/AVP 96
a=setup:active
a=sendonly
a=rtpmap:96 PS/90000
a=filesize:262209536
y=1000010003//开始点播:服务端-》设备端
ACK sip:34020000001320000002@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK3d8b174429304a9d8af106f460debf9b
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 42 ACK//暂停播放:服务端-》设备端
INFO sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK28e2fc9dac8b421f9a8450a10933210d
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 43 INFO
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 41
Content-Type: application/MANSRTSP
Contact: <sip:34020000002000000001@192.168.0.110:15060>PAUSE RTSP/1.0
CSeq: 1
PauseTime: now//继续播放:服务端-》设备端
INFO sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK86d002cd67004d0487ed0000b652c1bd
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 45 INFO
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 41
Content-Type: application/MANSRTSP
Contact: <sip:34020000002000000001@192.168.0.110:15060>PLAY RTSP/1.0
CSeq: 3
Range: npt=now-//切换速度:服务端-》设备端
INFO sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bKd790bfabeea74caaba1594708fb91ada
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 46 INFO
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 34
Content-Type: application/MANSRTSP
Contact: <sip:34020000002000000001@192.168.0.110:15060>PLAY RTSP/1.0
CSeq: 4
Scale: 4//切换进度:服务端-》设备端
INFO sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bKeb9b6621c9e446c9912f48127ecf0932
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1039
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=723451991
Call-ID: 2b3bf36cf7164ea0aac06fbd3e24680f
CSeq: 47 INFO
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 41
Content-Type: application/MANSRTSP
Contact: <sip:34020000002000000001@192.168.0.110:15060>PLAY RTSP/1.0
CSeq: 5
Range: npt=379-//下载请求:服务端-》设备端
INVITE sip:34020000001310000001@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK6a208da569eb44028e0d159f9f245386
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1041
To: <sip:34020000001310000001@192.168.0.64:5060>
Call-ID: 3bd33cd0f76c40e8b0d702b4212c74e5
CSeq: 50 INVITE
User-Agent: wx_feiyangqingyun
Max-Forwards: 70
Content-Length: 342
Content-Type: application/sdp
Contact: <sip:34020000002000000001@192.168.0.110:15060>
Subject: 34020000001310000001:1000010004,34020000002000000001:0v=0
o=34020000001310000001 0 0 IN IP4 192.168.0.110
s=Download
u=34020000001310000001:0
c=IN IP4 192.168.0.110
t=1744856617 1744856620
m=video 6902 RTP/AVP 96 97 98
a=recvonly
a=setup:passive
a=connection:new
a=rtpmap:96 PS/90000
a=rtpmap:97 MPEG4/90000
a=rtpmap:98 H264/90000
a=downloadspeed:8
a=streamprofile:1
y=1000010004//请求应答:设备端-》服务端
SIP/2.0 200 OK
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK6a208da569eb44028e0d159f9f245386
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1041
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=1160726752
Call-ID: 3bd33cd0f76c40e8b0d702b4212c74e5
CSeq: 50 INVITE
Contact: <sip:34020000001320000002@192.168.0.64:5060>
Content-Type: application/sdp
User-Agent: IP Camera
Content-Length: 211v=0
o=34020000001320000002 2589 2589 IN IP4 192.168.0.64
s=Download
c=IN IP4 192.168.0.64
t=0 0
m=video 15060 RTP/AVP 96
a=setup:active
a=sendonly
a=rtpmap:96 PS/90000
a=filesize:1367160
y=1000010004//开始下载:服务端-》设备端
ACK sip:34020000001320000002@192.168.0.64:5060 SIP/2.0
Via: SIP/2.0/UDP 192.168.0.110:15060;branch=z3hG9bK6a208da569eb44028e0d159f9f245386
From: <sip:34020000002000000001@192.168.0.110:15060>;tag=1041
To: <sip:34020000001310000001@192.168.0.64:5060>;tag=1160726752
Call-ID: 3bd33cd0f76c40e8b0d702b4212c74e5
CSeq: 50 ACK
二、效果图
三、相关地址
- 国内站点:https://gitee.com/feiyangqingyun
- 国际站点:https://github.com/feiyangqingyun
- 个人作品:https://blog.csdn.net/feiyangqingyun/article/details/97565652
- 文件地址:https://pan.baidu.com/s/1d7TH_GEYl5nOecuNlWJJ7g 提取码:01jf 文件名:bin_video_gb28181。
四、功能特点
- 支持设备注册、注销、心跳、校时、注册认证、注销认证等。
- 设备上线后可以手动获取设备状态、设备信息、配置信息、预置位信息等。
- 设备上线后自动获取设备通道信息,包括中文通道名称。识别到通道上线离线变化,会重新获取该设备的所有通道信息。
- 支持视频点播,可以分别点播主码流和子码流,内置rtp解包线程,解包后发给视频播放组件解码播放。
- 每个设备每个通道支持点播多个视频,通过ssrc区分,支持共用端口和不同端口收流。
- 支持对某个设备下面所有通道、某个通道、某个通道对应的某个流分别关闭。
- 支持录像文件查询和回放,回放控制支持暂停播放、继续播放、倍速播放、切换播放进度。
- 支持录像文件下载,支持倍速比如8倍速下载,可同时多线程批量下载。
- 回放和下载同时支持IPC和NVR,比如摄像头自带的SD存储卡录像文件回放,NVR上的硬盘录像文件回放。
- 支持云台控制,向上、向下、向左、向右、左上、右上、左下、右下方位移动,镜头放大缩小,光圈放大缩小,镜头聚焦放焦。
- 支持预置位信息的查询、调用、添加、修改、删除等操作。
- 自动目录订阅功能,通道上线下线都有对应的信号通知。
- 内置定时读取通道信息机制,以保证通道信息是最新的,比如有些NVR是不断更新的通道信息。
- 内置订阅警情和位置移动功能,订阅后各种警情事件比如运动目标检测报警、入侵检测报警、徘徊检测报警等自动上报。
- 支持语音对讲功能,可以直接在视频窗体的悬浮条上单击语音对讲按钮,再次单击关闭对讲,对讲期间悬浮条常驻显示。
- 支持设备布防撤防,布防后警情信息会主动上报。
- 国标服务同时支持udp和tcp方式,可选只监听一种或者两种都监听,tcp方式自动处理粘包问题。
- 国标拉流同时支持udp、tcp被动、tcp主动三种方式,每个通道都可以自由选择何种拉流方式。
- 内置拉流端口池,每次拉流从中取出一个,关闭流自动回收端口号,重复利用。
- 收流端口自动纠错,自动跳过被占用的端口,不会出现端口占用导致收流失败的情况。
- 支持三种取流方式自动检测离线重连,检测到离线后,自动重启点播拉流整个流程。
- 录像文件回放,上一个完成后自动切换到下一个继续回放,直到所有回放完成。支持高达8倍速回放。
- 视频播放自适应硬解码,极低资源占用,实时性极好,带悬浮条显示视频流信息,可以直接在悬浮条单击按钮保存录像文件到本地。
- 支持几千路国标消息交互并发,实时视频流支持64路同时显示,可以拓展更多路数。
- 支持阿里云等云服务器,可以分别设置内网监听地址和外网访问地址,一般云服务器上是监听地址用内网,对外访问用外网地址。
- 支持视频分发,也就是推流,视频通道打开后可以自动推流到流媒体服务器,其他需要的地方拉流即可,支持rtsp、rtmp、hls、webrtc等方式拉流。
- 实时预览和录像回放都支持推流,推流支持叠加文字和图片水印以及各种ffmpeg支持的滤镜效果,支持多个水印同时叠加。
- 同时支持gb28181-2011、gb28181-2016、gb28181-2022以及后续可能的所有协议版本。
- SIP解析和交互采用纯Qt底层代码实现,udp/tcp通信交互,祖传原创代码解析,不依赖任何第三方。
- 代码量少,gb28181交互部分共几千行代码,注释详细,接口友好,使用极其简单,提供非常详细的使用示例。
- 支持海康、大华、宇视、华为、天地伟业等所有国标设备,包括一些没有ssrc的设备。
- 支持所有Qt版本和编译器以及操作系统,包括但不限于win、linux、mac、android、嵌入式linux、树莓派香橙派、国产os等。
五、相关代码
#include "frmvideoplayback.h"
#include "ui_frmvideoplayback.h"
#include "qthelper.h"
#include "videoutil.h"
#include "gb28181server.h"
#include "gb28181helper.h"frmVideoPlayback::frmVideoPlayback(QWidget *parent) : QWidget(parent), ui(new Ui::frmVideoPlayback)
{ui->setupUi(this);this->initForm();this->initConfig();
}frmVideoPlayback::~frmVideoPlayback()
{delete ui;
}void frmVideoPlayback::closeAll()
{this->setId("", "");ui->listWidget->clear();ui->btnStop->click();
}void frmVideoPlayback::setServer(GB28181Server *server)
{this->server = server;ui->gb28181Widget->setServer(server);
}void frmVideoPlayback::setId(const QString &deviceId, const QString &channelId)
{this->deviceId = deviceId;this->channelId = channelId;
}void frmVideoPlayback::initForm()
{server = NULL;ui->sliderPosition->setRange(0, 0);ui->gb28181Widget->setBgText("视频回放");ui->gb28181Widget->setProperty("onSync", AppConfig::RecordOnSync);connect(ui->btnPlay, SIGNAL(clicked(bool)), this, SLOT(playControl()));connect(ui->btnStop, SIGNAL(clicked(bool)), this, SLOT(playControl()));connect(ui->sliderPosition, SIGNAL(clicked()), this, SLOT(playControl()));connect(ui->cboxSpeed, SIGNAL(currentIndexChanged(int)), this, SLOT(playControl()));connect(ui->gb28181Widget, SIGNAL(sig_receivePlayStart(int)), this, SLOT(receivePlayStart(int)));connect(ui->gb28181Widget, SIGNAL(sig_receivePlayFinsh()), this, SLOT(receivePlayFinsh()));//进度定时器timer = new QTimer(this);connect(timer, SIGNAL(timeout()), this, SLOT(setPosition()));timer->setInterval(300);
}void frmVideoPlayback::initConfig()
{//ui->cboxSpeed->setEnabled(false);VideoUtil::loadSpeed(ui->cboxSpeed);ui->cboxSpeed->setCurrentIndex(ui->cboxSpeed->findData(AppConfig::RecordSpeed));connect(ui->cboxSpeed, SIGNAL(currentIndexChanged(int)), this, SLOT(saveConfig()));ui->dateStart->setDateTime(QDateTime::fromString(AppConfig::RecordStart, "yyyy-MM-ddThh:mm:ss"));connect(ui->dateStart, SIGNAL(dateTimeChanged(QDateTime)), this, SLOT(saveConfig()));ui->dateEnd->setDateTime(QDateTime::fromString(AppConfig::RecordEnd, "yyyy-MM-ddThh:mm:ss"));connect(ui->dateEnd, SIGNAL(dateTimeChanged(QDateTime)), this, SLOT(saveConfig()));
}void frmVideoPlayback::saveConfig()
{AppConfig::RecordSpeed = ui->cboxSpeed->itemData(ui->cboxSpeed->currentIndex()).toString();AppConfig::RecordStart = ui->dateStart->dateTime().toString("yyyy-MM-ddThh:mm:ss");AppConfig::RecordEnd = ui->dateEnd->dateTime().toString("yyyy-MM-ddThh:mm:ss");AppConfig::writeConfig();
}void frmVideoPlayback::setPosition()
{qint64 pts = ui->gb28181Widget->getPts();VideoUtil::setPosition(ui->labPosition, ui->sliderPosition, pts * 100);
}void frmVideoPlayback::receivePlayStart(int)
{//取出时间QListWidgetItem *item = ui->listWidget->currentItem();QString startTime = item->data(Qt::UserRole + 1).toString();QString endTime = item->data(Qt::UserRole + 2).toString();//计算时长qint64 duration = GB28181Helper::getDuration(startTime, endTime) * 1000;VideoUtil::setDuration(ui->labDuration, ui->sliderPosition, duration);
}void frmVideoPlayback::receivePlayFinsh()
{timer->stop();ui->btnPlay->setText("暂停");VideoUtil::resetDuration(ui->labDuration, ui->labPosition, ui->sliderPosition);//暂停期间不用继续if (ui->btnPlay->text() == "播放") {return;}//如果还有下一个自动触发双击播放/过滤下刚刚关闭触发的播放结束int row = ui->listWidget->currentRow();qint64 offset = lastTime.msecsTo(QDateTime::currentDateTime());if (offset > 1000 && row < ui->listWidget->count() - 1) {ui->listWidget->setCurrentRow(row + 1);on_listWidget_itemDoubleClicked(ui->listWidget->currentItem());}
}void frmVideoPlayback::playControl()
{QString ssrc = ui->gb28181Widget->getSsrcVideo();if (!server || ssrc.isEmpty()) {return;}QObject *obj = sender();if (obj == ui->btnPlay) {if (ui->btnPlay->text() == "暂停") {ui->btnPlay->setText("播放");server->playControl(deviceId, channelId, PlayControl_Pause, 0, ssrc);} else {ui->btnPlay->setText("暂停");server->playControl(deviceId, channelId, PlayControl_Play, 0, ssrc);}} else if (obj == ui->btnStop) {lastTime = QDateTime::currentDateTime();ui->gb28181Widget->stop();} else if (obj == ui->sliderPosition) {timer->stop();timer->start();ui->btnPlay->setText("暂停");qint64 sec = ui->sliderPosition->value() / 1000;server->playControl(deviceId, channelId, PlayControl_Position, sec);} else if (obj == ui->cboxSpeed) {float speed = ui->cboxSpeed->itemData(ui->cboxSpeed->currentIndex()).toFloat();server->playControl(deviceId, channelId, PlayControl_Scale, speed, ssrc);}
}void frmVideoPlayback::receiveStatus(GB28181Status status)
{if (status.deviceId != deviceId || status.channelId != channelId || status.notifyType != 121) {return;}//不是当前窗体产生的不用处理if (ui->gb28181Widget->getSsrcVideo() == status.ssrc) {ui->gb28181Widget->stop();}
}void frmVideoPlayback::receiveRecord(const QList<GB28181Record> &records)
{if (!this->isVisible()) {return;}foreach (GB28181Record record, records) {QString startTime = record.startTime;QString endTime = record.endTime;QString date = startTime.mid(0, 10);QString start = startTime.mid(11, 5);QString end = endTime.mid(11, 5);QListWidgetItem *item = new QListWidgetItem;item->setData(Qt::UserRole + 1, startTime);item->setData(Qt::UserRole + 2, endTime);item->setText(QString("%0 %1 - %2").arg(date).arg(start).arg(end));ui->listWidget->addItem(item);}
}void frmVideoPlayback::on_btnQueryRecord_clicked()
{ui->listWidget->clear();QDateTime dateStart = ui->dateStart->dateTime();QDateTime dateEnd = ui->dateEnd->dateTime();if (dateStart >= dateEnd) {QtHelper::showMessageBoxError("开始时间必须小于结束时间, 请重新选择!");return;}server->queryRecord(deviceId, channelId, dateStart, dateEnd);
}void frmVideoPlayback::on_listWidget_itemDoubleClicked(QListWidgetItem *item)
{//取出时间QString startTime = item->data(Qt::UserRole + 1).toString();QString endTime = item->data(Qt::UserRole + 2).toString();//停止播放lastTime = QDateTime::currentDateTime();ui->gb28181Widget->stop();qApp->processEvents();timer->start();//启动播放ui->gb28181Widget->initPara(AppConfig::ScaleMode, AppConfig::VideoMode, AppConfig::VideoCore, AppConfig::DecodeType, AppConfig::Hardware, AppConfig::ReadTimeout, false, false);ui->gb28181Widget->setPara(AppConfig::RecordSpeed.toFloat(), AppConfig::RecordProfile, (TransmitMode)AppConfig::TransmitMode, AppConfig::ServerIp, AppConfig::RecordPush, GB28181Widget::PlayType_Playback);ui->gb28181Widget->setTime(startTime, endTime);ui->gb28181Widget->openVideo(deviceId, channelId);
}