This paper proposes a jointvariable-based gradient descent algorithm (joint-GD) and a variable projection (VP)-based gradient descent algorithm (VP-GD) for separable nonlinear models. The VP algorithm takes advantage...
详细信息
This paper proposes a jointvariable-based gradient descent algorithm (joint-GD) and a variable projection (VP)-based gradient descent algorithm (VP-GD) for separable nonlinear models. The VP algorithm takes advantage of the separability property of variables to reduce the dimensionality of the parameters, which makes the convergence rates faster. In order to speed up the convergence of the gradient descent algorithm, the Aitken acceleration technique is introduced in the algorithms, which is second-order convergent. Moreover, the Aitken-based methods are robust to the step-size, therefore they can be widely used in engineering practices. The numerical simulation shows the effectiveness of the proposed algorithms.
暂无评论