检索结果-内蒙古大学图书馆

A Double Deep Learning-Based Solution for Efficient Event Data coding and Classification

IEEE ACCESS 2025年 13卷 48703-48719页

作者： Seleem, Abdelrahman Guarda, Andre F. R. Rodrigues, Nuno M. M. Pereira, Fernando Univ Lisbon Inst Super Tecn P-1049001 Lisbon Portugal Inst Telecomunicacoes P-1049001 Lisbon Portugal South Valley Univ Fac Comp & Informat Qena 83523 Egypt Politecn Leiria ESTG P-2411901 Leiria Portugal

Event cameras have the ability to capture asynchronous per-pixel brightness changes, usually called "events", offering advantages over traditional frame-based cameras for computer vision tasks. Efficiently coding event data is critical for practical transmission and storage, given the very significant number of events captured. This paper proposes a novel double deep learning-based solution for efficient event data coding and classification, using a point cloud-based representation for events. Moreover, since the conversions from events to point clouds and back to events are key steps in the proposed solution, novel tools are proposed and their impact is evaluated in terms of compression and classification performance. Experimental results show that it is possible to achieve a classification performance for decompressed events which is similar to the one for original events, even after applying a lossy point cloud codec, notably the recent deep learning-based JPEG Pleno point cloud coding standard, with a clear rate reduction. Experimental results also demonstrate that events coded using the JPEG standard achieve better classification performance than those coded using the conventional lossy MPEG Geometry-based point cloud coding standard for the same rate. Furthermore, the adoption of deep learning-based coding offers future high potential for performing computer vision tasks in the compressed domain, which allows skipping the decoding stage, thus mitigating the impact of compression artifacts.

关键词： Encoding point cloud compression Transform coding Standards Cameras Correlation Vision sensors Three-dimensional displays Spatial resolution Loss measurement Deep learning event data event data coding event data classification point cloud coding

来源：评论

学校读者我要写书评

暂无评论

DEEP LEARNING-BASED COMPRESSED DOMAIN point cloud CLASSIFICATION 30

DEEP LEARNING-BASED COMPRESSED DOMAIN POINT CLOUD CLASSIFICA...

引用

30th IEEE International Conference on Image Processing (ICIP)

作者： Seleem, Abdelrahman Guarda, Andre F. R. Rodrigues, Nuno M. M. Pereira, Fernando Inst Telecomunicacoes Lisbon Portugal Univ Lisbon Inst Super Tecn Lisbon Portugal ESTG Politecn Leiria Leiria Portugal South Valley Univ Qena Egypt

ISBN: (纸本)9781728198354

Deep learning (DL) based tools have recently reached performance levels similar to state-of-the-art hand-crafted methods for point cloud (PC) coding and classification. In 2022, JPEG issued a Call for Proposals for a Learning-based PC coding (PCC) standard that envisions a unified representation, targeting both human visualization and computer vision tasks. This paper proposes the first DL-based Compressed Domain PC CLassifier (CD-PCCL), built on the pointGrid classifier, for geometry-only PCs coded with the current DL-based JPEG Pleno PCC Verification Model. The performance of compressed domain PC classification is studied against using voxel domain classification, notably for original, voxelized, and decompressed PCs. Experimental results with the ModelNet40 PC dataset show the proposed CD-PCCL can achieve significant PC classification gains regarding decompressed domain classification, while reducing the PC classifier complexity.

关键词： point clouds deep learning point cloud coding point cloud classification compressed domain classification

来源：评论

学校读者我要写书评

暂无评论

Subjective Quality Evaluation of point clouds Using a Head-Mounted Display

Subjective Quality Evaluation of Point Clouds Using a Head-M...

引用

2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

作者： Prazeres, Joao Rodrigues, Rafael Pereira, Manuela Pinheiro, Antonio M.G. Universidade da Beira Interior Instituto de Telecomunicacoes Covilha Portugal Universidade da Beira Interior NOVA LINCS Covilha Portugal

ISBN: (纸本)9798350368741

Preparing subjective evaluations for point cloud quality assessment using 2D or 3D planar displays typically requires rendering uncompressed videos, which demands large volumes of data storage and processing, particularly at high resolutions. This paper describes a subjective quality evaluation of point clouds using a head-mounted display (HMD), which allows the direct 3D content depiction and thus eliminates the need for video rendering. The test dataset included six static point clouds encoded with the MPEG codecs V-PCC and G-PCC, the learning-based codec RS-DLPCC, and the Draco codec. The obtained Mean Opinion Scores (MOS) were compared with two other studies using the same dataset but with different displays, notably a 2D display and a 3D stereoscopic display. The reported results indicate that the three studies are highly correlated, with Pearson and Spearman correlation coefficients above 0.9. Moreover, a multi-way ANOVA shows that changing the display does not have a significant effect on the obtained MOS. © 2025 IEEE.

关键词： Learning-based codecs point cloud coding Subjective evaluation

来源：评论

学校读者我要写书评

暂无评论

Video coding of dynamic 3D point cloud data

引用

APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING 2019年第1期8卷

作者： Schwarz, Sebastian Sheikhipour, Nahid Sevom, Vida Fakour Hannuksela, Miska M. Nokia Technol Hatanpaan Valtatie 30 Tampere 33100 Finland Tampere Univ Technol Korkeakoulunkatu 6 Tampere 3372O Finland

Due to the increased popularity of augmented (AR) and virtual (VR) reality experiences, the interest in representing the real world in an immersive fashion has never been higher. Distributing such representations enables users all over the world to freely navigate in never seen before media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today's networks. Thus, efficient compression technologies are in high demand. This paper proposes an approach to compress 3D video data utilizing 2D video coding technology. The proposed solution was developed to address the needs of "tele-immersive" applications, such as VR, AR, or mixed reality with "Six Degrees of Freedom" capabilities. Volumetric video data is projected on 2D image planes and compressed using standard 2D video coding solutions. A key benefit of this approach is its compatibility with readily available 2D video coding infrastructure. Furthermore, objective and subjective evaluation shows significant improvement in coding efficiency over reference technology. The proposed solution was contributed and evaluated in international standardization. Although it is was not selected as the winning proposal, as very similar solution has been selected developed since then.

关键词： point cloud coding Volumetric video Immersive media AR

来源：评论

学校读者我要写书评

暂无评论

SUBJECTIVE QUALITY EVALUATION OF point cloudS WITH 3D STEREOSCOPIC VISUALIZATION 29

SUBJECTIVE QUALITY EVALUATION OF POINT CLOUDS WITH 3D STEREO...

引用

IEEE International Conference on Image Processing (ICIP)

作者： Prazeres, Joao Pereira, Manuela Pinheiro, Antonio M. G. Inst Telecomunicacoes Covilha Portugal

ISBN: (数字)9781665496209

ISBN: (纸本)9781665496209

In this paper, a subjective evaluation of static point clouds encoded with several codecs is described. Unlike other studies, a stereoscopic 3D display was used to visualize the 3D representation. A set of six point clouds were encoded using a set of state of the art point cloud coding solutions, notably the two MPEG codecs V-PCC and G-PCC, a deep learning solution RS-DLPCC that was the response to a call for evidence on point cloud coding of JPEG Pleno, and the popular DRACO codec. The results of this subjective quality evaluation using a 3D representation visualized in a stereoscopic display were compared with a previous subjective study that used the same content visualized in a 2D display. For that, the results of both tests were compared with the Pearson correlation, Spearman rank order correlation, the root mean square error and the outlier ratio. Moreover, the two subjective evaluation results were statistically analysed to seek for any statistical difference. The two subjective evaluations reveal a very high level of similarity.

关键词： point cloud quality Subjective quality evaluation point cloud coding

来源：评论

学校读者我要写书评

暂无评论

A generalized Hausdorff distance based quality metric for point cloud geometry 12

A generalized Hausdorff distance based quality metric for po...

引用

12th International Conference on Quality of Multimedia Experience (QoMEX)

作者： Javaheri, Alireza Brites, Catarina Pereira, Fernando Ascenso, Joao Univ Lisbon Inst Super Tecn Inst Telecomun Lisbon Portugal

ISBN: (纸本)9781728159652

Reliable quality assessment of decoded point cloud geometry is essential to evaluate the compression performance of emerging point cloud coding solutions and guarantee some target quality of experience. This paper proposes a novel point cloud geometry quality assessment metric based on a generalization of the Hausdorff distance. To achieve this goal, the so-called generalized Hausdorff distance for multiple rankings is exploited to identify the best performing quality metric in terms of correlation with the MOS scores obtained from a subjective test campaign. The experimental results show that the quality metric derived from the classical Hausdorff distance leads to low objective-subjective correlation and, thus, fails to accurately evaluate the quality of decoded point clouds for emerging codecs. However, the quality metric derived from the generalized Hausdorff distance with an appropriately selected ranking, outperforms the MPEG adopted geometry quality metrics when decoded point clouds with different types of coding distortions are considered.

关键词： point cloud coding point cloud geometry objective quality assessment subjective quality assessment Hausdorff distance

来源：评论

学校读者我要写书评

暂无评论

IMPROVING PSNR-BASED QUALITY METRICS PERFORMANCE FOR point cloud GEOMETRY

IMPROVING PSNR-BASED QUALITY METRICS PERFORMANCE FOR POINT C...

引用

IEEE International Conference on Image Processing (ICIP)

作者： Javaheri, Alireza Brites, Catarina Pereira, Fernando Ascenso, Joao Univ Lisbon Inst Super Tecn Lisbon Portugal Inst Telecomunicacoes Aveiro Portugal

ISBN: (纸本)9781728163956

An increased interest in immersive applications has drawn attention to emerging 3D imaging representation formats, notably light fields and point clouds (PCs). Nowadays, PCs are one of the most popular 3D media formats, due to recent developments in PC acquisition, namely with new depth sensors and signal processing algorithms. To obtain high fidelity 3D representations of visual scenes a huge amount of PC data is typically acquired, which demands efficient compression solutions. As in 2D media formats, the final perceived PC quality plays an importance role in the overall user experience and, thus, objective metrics capable to measure the PC quality in a reliable way are essential. In this context, this paper proposes and evaluates a set of objective quality metrics for the geometry component of PC data, which plays a very important role on the final perceived quality. Based on the popular PSNR PC geometry quality metric, novel improved PSNR-based metrics are proposed by exploiting the intrinsic PC characteristics and the rendering process that must occur before visualization. The experimental results show the superiority of the best proposed metrics over state-of-the-art, obtaining an improvement up to 32% in the Pearson correlation coefficient.

关键词： point cloud coding objective quality assessment PSNR intrinsic resolution density precision

来源：评论

学校读者我要写书评

暂无评论

Graph-Based Static 3D point clouds Geometry coding

引用

IEEE TRANSACTIONS ON MULTIMEDIA 2019年第2期21卷 284-299页

作者： Rente, Paulo de Oliveira Brites, Catarina Ascenso, Joao Pereira, Fernando Univ Lisbon Inst Super Tecn P-1049001 Lisbon Portugal Inst Telecomunicacoes P-1049001 Lisbon Portugal

Recently, 3D visual representation models such as light fields and point clouds are becoming popular due to their capability to represent the real world in a more complete and immersive way, paving the road for new and more advanced visual experiences. The point cloud representation model is able to efficiently represent the surface of objects/scenes by means of a set of 3D points and associated attributes and is increasingly being used from autonomous cars to augmented reality. Emerging imaging sensors have made it easier to perform richer and denser point cloud acquisitions, notably with millions of points, making it impossible to store and transmit these very high amounts of data without appropriate coding. This bottleneck has raised the need for efficient point cloud coding solutions in order to offer more immersive visual experiences and better quality of experience to the users. In this context, this paper proposes an efficient lossy coding solution for the geometry of static point clouds. The proposed coding solution uses an octree-based approach for a base layer and a graph-based transform approach for the enhancement layer where an Inter-layer residual is coded. The performance assessment shows very significant compression gains regarding the state-of-the-art, especially for the most relevant lower and medium rates.

关键词： point cloud coding graph-based transform octree coding rendering point cloud quality assessment

来源：评论

学校读者我要写书评

暂无评论

Emerging MPEG Standards for point cloud Compression

引用

IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS 2019年第1期9卷 133-148页

作者： Schwarz, Sebastian Preda, Marius Baroncini, Vittorio Budagavi, Madhukar Cesar, Pablo Chou, Philip A. Cohen, Robert A. Krivokuca, Maja Lasserre, Sebastien Li, Zhu Llach, Joan Mammou, Khaled Mekuria, Rufael Nakagami, Ohji Siahaan, Ernestasia Tabatabai, Ali Tourapis, Alexis M. Zakharchenko, Vladyslav Nokia Technol Tampere 33100 Finland Inst Mines Telecom F-75014 Paris France EVATech I-00149 Rome Italy Samsung Elect Richardson TX 75025 USA Ctr Wiskunde & Infomart NL-1098 XG Amsterdam Netherlands Google Mountain View CA 94043 USA Simon Fraser Univ Sch Engn Sci Burnaby BC V5A 1S6 Canada 8i Wellington 6011 New Zealand BlackBerry Ltd Waterloo ON N2K 0A7 Canada Univ Missouri Dept Comp Sci & Elect Engn Kansas City MO 64110 USA Technicolor F-35576 Cesson Sevigne France Apple Inc Cupertino CA 85014 USA Unified Streaming & Point Cloud Compress NL-1054 Amsterdam Netherlands Sony Corp Tokyo 1080075 Japan Futurewei Technol Inc Santa Clara CA 95050 USA

Due to the increased popularity of augmented and virtual reality experiences, the interest in capturing the real world in multiple dimensions and in presenting it to users in an immersible fashion has never been higher. Distributing such representations enables users to freely navigate in multisensory 3D media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today's networks. Efficient compression technologies well adopted in the content chain are in high demand and are key components to democratize augmented and virtual reality applications. Moving Picture Experts Group, as one of the main standardization groups dealing with multimedia, identified the trend and started recently the process of building an open standard for compactly representing 3D point clouds, which are the 3D equivalent of the very well-known 2D pixels. This paper introduces the main developments and technical aspects of this ongoing standardization effort.

关键词： point cloud coding 3D data coding immersive video coding

来源：评论

学校读者我要写书评

暂无评论

Improved Patch Packing for the MPEG V-PCC Standard 21

Improved Patch Packing for the MPEG V-PCC Standard

引用

IEEE 21st International Workshop on Multimedia Signal Processing (MMSP)

作者： Costa, Afonso Dricot, Antoine Brites, Catarina Ascenso, Joao Pereira, Fernando Univ Lisbon Inst Telecomunicacoes Inst Super Tecn Lisbon Portugal

ISBN: (纸本)9781728118178

point cloud representation is an emerging visual data technology, targeting immersive 3D experiences in the context of multiple applications scenarios, notably entertainment, geographical information systems, medicine, architecture, and robotics. Since a point cloud may easily involve millions of points, and thus an enormous amount of data, its effective storage and transmission critically asks for efficient coding solutions. With this purpose in mind, several point cloud coding (PCC) solutions have been proposed in the literature;special emphasis is due to the recent MPEG standards, which target interoperability in this domain, notably the MPEG V-PCC standard. The objective of this paper is to improve the V-PCC standard compression efficiency by proposing novel solutions for the V-PCC packing module without compromising in any way the V-PCC stream (syntax and semantics) and decoder compliance. In this context, several patch packing solutions are proposed, including new packing algorithms and associated sorting and positioning metrics;for the metrics, both absolute and relative approaches are proposed. The RD performance results show BD-Rate savings up to 0.8% for the best packing solution regarding the V-PCC benchmark. Moreover, the packing map size reductions can go up to 12%, on average.

关键词： point cloud coding V-PCC standard patch packing sorting metric positioning metric

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：