检索结果-内蒙古大学图书馆

30th ACM SIGSAC Conference on Computer and Communications Security (ACM CCS)

作者： Naseh, Ali Krishna, Kalpesh Iyyer, Mohit Houmansadr, Amir Univ Massachusetts Amherst Amherst MA 01003 USA

ISBN: (纸本)9798400700507

A key component of generating text from modern language models (LM) is the selection and tuning of decoding algorithms. These algorithms determine how to generate text from the internal probability distribution generated by the LM. The process of choosing a decoding algorithm and tuning its hyperparameters takes significant time, manual effort, and computation, and it also requires extensive human evaluation. Therefore, the identity and hyperparameters of such decoding algorithms are considered to be extremely valuable to their owners. In this work, we show, for the first time, that an adversary with typical API access to an LM can steal the type and hyperparameters of its decoding algorithms at very low monetary costs. Our attack is effective against popular LMs used in text generation APIs, including GPT-2, GPT-3 and GPT-Neo. We demonstrate the feasibility of stealing such information with only a few dollars, e.g., $0.8, $1, $4, and $40 for the four versions of GPT-3.

关键词： Hyperparameter stealing language models decoding algorithms

来源：评论

学校读者我要写书评

暂无评论

AN ANALYSIS OF THE EFFECTS OF decoding algorithms ON FAIRNESS IN OPEN-ENDED LANGUAGE GENERATION

AN ANALYSIS OF THE EFFECTS OF DECODING ALGORITHMS ON FAIRNES...

引用

IEEE Spoken Language Technology Workshop (SLT)

作者： Dhamala, Jwala Kumar, Varun Gupta, Rahul Chang, Kai-Wei Galstyan, Aram Amazon Alexa AI Cupertino CA USA Univ Calif Los Angeles Los Angeles CA USA Univ Southern Calif Inst Informat Sci Los Angeles CA USA

ISBN: (纸本)9798350396904

Several prior works have shown that language models (LMs) can generate text containing harmful social biases and stereotypes. While decoding algorithms play a central role in determining properties of LM generated text, their impact on the fairness of the generations has not been studied. We present a systematic analysis of the impact of decoding algorithms on LM fairness, and analyze the trade-off between fairness, diversity and quality. Our experiments with top-p, top-k and temperature decoding algorithms, in open-ended language generation, show that fairness across demographic groups changes significantly with change in decoding algorithm's hyper-parameters. Notably, decoding algorithms that output more diverse text also output more texts with negative sentiment and regard. We present several findings and provide recommendations on standardized reporting of decoding details in fairness evaluations and optimization of decoding algorithms for fairness alongside quality and diversity.

关键词： Language Models Fairness Bias Natural Language Generation decoding algorithms

来源：评论

学校读者我要写书评

暂无评论

Research on encoding and decoding algorithms of non-binary LDPC code and FPGA implementation

引用

JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING 2020年第1期20卷 167-175页

作者： Wang, Zhongxun Liu, Baojun Zhang, Min Lou, Yang Yantai Univ Sch Optoelect Informat Sci & Technol Yantai 264005 Shandong Peoples R China

Low density parity check (LDPC) code is a kind of linear block code with excellent performance which is proposed by Dr. Gallager. It overcomes the shortcomings of other error correcting codes and it is the nearest channel code from Shannon limit at the present discover. The decoding algorithms of LDPC code can reduce the decoding delay by the parallel decoding structure, so this has caused great concern in many fields. In recent years more and more scholars begin to study LDPC code, this makes the coding and decoding algorithms of LDPC code improved continuously. LDPC code has been widely used in many fields such as optical fiber communication, digital watermarking, underwater communication and deep space communication because of its excellent performance. Non-binary LDPC code has better performance compared with binary LDPC code. In this paper, FFT-BP decoding algorithm of non-binary LDPC code is studied, and on this basis, we proposed an improved FFT-BP algorithm. The improved decoding algorithm can effectively reduce the average iteration number. Finally, we achieved encode and decode algorithm of non-binary LDPC code with FPGA.

关键词： LDPC code decoding algorithms modelsim FPGA

来源：评论

学校读者我要写书评

暂无评论

Two decoding algorithms for Goppa Codes

Two Decoding Algorithms for Goppa Codes

引用

作者： Ochoa, Esperanza San Diego State University

学位级别：M.A., Master of Arts

The McEliece cryptographic system is one of the finalists of the second round of the NIST Post-Quantum Cryptography Standardization Process. As such, it will likely be used in many instances to ensure secure communications over the Internet when quantum computers become practical. The selection of the new system, which will replace the widely used RSA cryptographic system, should be announced by 2025. The McEliece cryptographic system is code-based, which means that it uses an error-correcting code as its basis, typically a Goppa code; it is the random insertion of errors in the original message that guarantees the security of the system. Presumably, only the legitimate user is capable of correcting those errors, thereby retrieving the message for which it is intended. As a result, an efficient decoding algorithm is required. In this work, we study two decoding algorithms for Goppa codes, namely, the Euclidean and Patterson, implement them in Magma, and compare their performances considering several code parameters. Lastly, a modification to Patterson's algorithm is proposed to handle certain cases where the Goppa polynomial is reducible.

关键词： decoding algorithms Goppa codes Quantum computing Coding theory Linear codes Cryptography

来源：评论

学校读者我要写书评

暂无评论

Research on Encoding and decoding algorithms of LDPC Codes

Research on Encoding and Decoding Algorithms of LDPC Codes

引用

2017 2nd International Conference on Materials Science,Machinery and Energy Engineering(MSMEE 2017)

作者： Yifeng He Zhemin Duan Electronic Information College Northwestern Polytechnical University

The LDPC code, namely low density parity check code, is essentially a linear block code. Its decoding performance is closer to the Shannon limit than the Turbo code. The definition and description of LDPC codes are introduced in this paper. LDPC coding method includes the Algorithm of LU decomposable encoding and the algorithm of partitioned iterated encoding. the algorithm of message passing, the algorithm of minimum-sum decoding and the algorithm of bit-flipping decoding are the common decoding algorithms of the LDPC codes. The concept and features of the encoding and decoding algorithms are explored in this paper to provide some references for the relative researchers.

关键词： Encoding algorithms decoding algorithms LDPC codes

来源：评论

学校读者我要写书评

暂无评论

Code Construction and decoding algorithms for Semi-Quantitative Group Testing With Nonuniform Thresholds

引用

IEEE TRANSACTIONS ON INFORMATION THEORY 2016年第4期62卷 1674-1687页

作者： Emad, Amin Milenkovic, Olgica Univ Illinois Urbana IL 61801 USA

We analyze a new group-testing scheme, termed semi-quantitative group testing, which may be viewed as a concatenation of an adder channel and a discrete quantizer. Our focus is on non-uniform quantizers with arbitrary thresholds. For the most general semi-quantitative group-testing model, we define three new families of sequences capturing the constraints on the code design imposed by the choice of the thresholds. The sequences represent extensions and generalizations of Bh and certain types of super-increasing and lexicographically ordered sequences, and they lead to code structures amenable for efficient recursive decoding. We describe the decoding methods and provide an accompanying computational complexity and performance analysis.

关键词： Bh sequences decoding algorithms disjunct codes group testing lexicographically ordered sequences quantized adder channel semi-quantitative group testing super-increasing sequences

来源：评论

学校读者我要写书评

暂无评论

decoding algorithms and spatial resolution Monte Carlo simulation of cross strip anode for UV Astronomy

Decoding algorithms and spatial resolution Monte Carlo simul...

引用

International Conference on Photonics and Optical Engineering (icPOE)

作者： Zhu Xiangping Deng Guobao Chinese Acad Sci Xian Inst Opt & Precis Mech State Key Lab Transient Opt & Photon Xian 710119 Peoples R China Chinese Acad Sci Grad Univ Beijing 100049 Peoples R China

ISBN: (纸本)9781628415650

The development decoding algorithms of two-dimensional cross strip anodes image readouts for applications in UV astronomy are described. We present results with Monte Carlo simulation by GEANT4 toolkit, the results show that when the cross strip anode period is 0.5mm and the electrode width is 0.4mm, the spatial resolution accuracy is sufficient to reach better than 5 mu m, the temporal resolution accuracy of the event detection can be as low as 100 ps. The influences of the cross strip detector parameters, such as the anode period, the width of anode fingers (electrode), the width of the charge footprint at the anode (determined by the distance and the field between the MCP and the anode), the gain of the MCP and equivalent noise charge (ENC) are also discussed. The development decoding algorithms and simulation results can be useful for the designing and performance improvement of future photon counting imaging detectors for UV Astronomy.

关键词： decoding algorithms cross strip readout microchannel plate detectors Monte Carlo method GEANT4

来源：评论

学校读者我要写书评

暂无评论

Performances Analysis of Polar Codes decoding algorithms over Variant Binary-Input Channels 5

Performances Analysis of Polar Codes Decoding Algorithms ove...

引用

IEEE International Conference on Signal Processing, Communications and Computing ICSPCC 2015

作者： Xie, Wenjiao Tian, Ruifu Li, Lixin Bao, Tao Zhang, Huisheng Northwestern Polytech Univ Sch Elect & Informat Xian Peoples R China Shanghai Inst Aerosp Elect Technol Shanghai 201109 Peoples R China

ISBN: (纸本)9781479989201

In this paper, the performance of state of the art decoding methods of polar codes, such as the SC (Successive Cancellation), BP (belief propagation), LP (Linear Programming), LSC(List Successive Cancellation) and ML(Maximum Likelihood) decoding, over different binary-input discrete memoryless channels (B-DMCs) are presented. Simulation results indicate that decoding algorithms of polar codes have the performances of the estimated bit error rate (BER) below the order of 10-5. In addition, we came to the conclusion that BP algorithm outperforms SC at the cost of computational complexity. The performance of LP decoder is better than BP and the complexity is less than BP scheme, however, it can only be used in binary erasure channels (BECs). ML decoder has the best performance, but its high complexity makes it act as a reference to reveal the gap between ML and other algorithms. In order to remedy the performance deficiencies without any significant increase in decoding complexity, we further study the concatenated polar codes-the polar-LDPC(Low Density Parity Check) concatenation scheme, which is substantially outperforms ML decoding. What's more, the concatenated Polar-LDPC codes can remedy the error floor of LDPC codes. We firmly believed that the concatenated scheme of polar-LDPC would be a prominent technique in 5G (5th-generation) to support the more reliable transmission demand.

关键词： Polar codes decoding algorithms binary input channels error floor 5th-generation

来源：评论

学校读者我要写书评

暂无评论

Quaternary Neural Belief Propagation decoding of Quantum LDPC Codes With Overcomplete Check Matrices

引用

IEEE ACCESS 2025年 13卷 25637-25649页

作者： Miao, Sisi Schnerring, Alexander Li, Haizheng Schmalen, Laurent Karlsruhe Inst Technol KIT Commun Engn Lab CEL D-76187 Karlsruhe Germany German Aerosp Ctr DLR Inst Solar Res Almeria 04005 Spain

Quantum low-density parity-check (QLDPC) codes are promising candidates for error correction in quantum computers. One of the major challenges in implementing QLDPC codes in quantum computers is the lack of a universal decoder. In this work, we first propose to decode QLDPC codes with a belief propagation (BP) decoder operating on overcomplete check matrices. Then, we extend the neural BP (NBP) decoder, which was originally studied for suboptimal binary BP decoding of QLPDC codes, to quaternary BP decoders. Numerical simulation results demonstrate that both approaches as well as their combination yield a low-latency, high-performance decoder for several short to moderate length QLDPC codes.

关键词： Quantum error correction quantum low-density parity-check codes neural networks neural networks channel coding channel coding decoding algorithms decoding algorithms decoding algorithms

来源：评论

学校读者我要写书评

暂无评论

Channel-Aware Gradient Descent Bit-Flipping Algorithm for LDPC Codes

引用

IEEE COMMUNICATIONS LETTERS 2025年第4期29卷 809-813页

作者： Min, Woohong Yang, Kyeongcheol Pohang Univ Sci & Technol POSTECH Dept Elect Engn Pohang Si 37673 Gyeongsangbuk D South Korea

The gradient descent bit-flipping with momentum (GDBF-w/M) and probabilistic GDBF-w/M (PGDBF-w/M) algorithms significantly improve the decoding performance of the bit-flipping (BF) algorithm. In this letter, we propose a channel-aware GDBF-w/M algorithm which operates deterministically based on the received values from the additive white Gaussian noise (AWGN) channel. Numerical results show that the proposed algorithm does not only mitigate the error-floor phenomenon of the GDBF-w/M algorithm, but it also has better decoding performance than the PGDBF-w/M algorithm without the need for a random number generator. Furthermore, the complexity of the proposed algorithm is slightly higher than that of the GDBF-w/M algorithm.

关键词： decoding Probabilistic logic Iterative decoding Vectors AWGN channels Indexes Training Reliability Optimization Maximum likelihood decoding LDPC codes bit-flipping algorithm decoding algorithms

来源：评论

学校读者我要写书评

暂无评论

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案：

请选择收藏分类：

通借通还

建议与咨询 留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

时间限定

文献类型

馆藏选择

核心期刊

语言

文献类型

帮助

文字说明：

检索规则说明：

检索范例：

分类表

所选分类

限定检索结果

文献类型

馆藏范围

日期分布

学科分类号

主题

机构

作者

语言

请选择保存的检索档案： 新增检索档案 确定 取消

请选择收藏分类： 新增自定义分类 确定 取消

通借通还

建议与咨询留下您的常用邮箱和电话号码，以便我们向您反馈解决方案和替代方法

请选择保存的检索档案：

请选择收藏分类：