Stochastic interpretation for the Arimoto algorithm

Sergey Tridenski; Ram Zamir

doi:10.1109/ITW.2015.7133141

Stochastic interpretation for the Arimoto algorithm

Sergey Tridenski
, Ram Zamir

Tel Aviv University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

The Arimoto algorithm computes the Gallager function max_Q E₀(ρ, Q) for a given channel P (y / x) and parameter ρ, by means of alternating maximization. Along the way, it generates a sequence of input distributions Q₁(x), Q₂(x),⋯, that converges to the maximizing input Q∗(x). We propose a stochastic interpretation for the Arimoto algorithm. We show that for a random (i.i.d.) codebook with a distribution Q_k(x), the next distribution Q_k+1(x) in the Arimoto algorithm is equal to the type (Q′) of the feasible transmitted codeword that maximizes the conditional Gallager exponent (conditioned on a specific transmitted codeword type Q′). This interpretation is a first step toward finding a stochastic mechanism for on-line channel input adaptation.

Original language	English
Title of host publication	2015 IEEE Information Theory Workshop, ITW 2015
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781479955268
DOIs	https://doi.org/10.1109/ITW.2015.7133141
State	Published - 24 Jun 2015
Externally published	Yes
Event	2015 IEEE Information Theory Workshop, ITW 2015 - Jerusalem, Israel Duration: 26 Apr 2015 → 1 May 2015

Publication series

Name	2015 IEEE Information Theory Workshop, ITW 2015

Conference

Conference	2015 IEEE Information Theory Workshop, ITW 2015
Country/Territory	Israel
City	Jerusalem
Period	26/04/15 → 1/05/15

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Keywords

Arimoto-Blahut algorithm
Gallager error exponent
channel input adaptation
natural type selection

Access to Document

10.1109/ITW.2015.7133141

Cite this

@inproceedings{34d9042bad674034811bfee23f0fc7a7,

title = "Stochastic interpretation for the Arimoto algorithm",

abstract = "The Arimoto algorithm computes the Gallager function maxQ E0(ρ, Q) for a given channel P (y / x) and parameter ρ, by means of alternating maximization. Along the way, it generates a sequence of input distributions Q1(x), Q2(x),⋯, that converges to the maximizing input Q∗(x). We propose a stochastic interpretation for the Arimoto algorithm. We show that for a random (i.i.d.) codebook with a distribution Qk(x), the next distribution Qk+1(x) in the Arimoto algorithm is equal to the type (Q′) of the feasible transmitted codeword that maximizes the conditional Gallager exponent (conditioned on a specific transmitted codeword type Q′). This interpretation is a first step toward finding a stochastic mechanism for on-line channel input adaptation.",

keywords = "Arimoto-Blahut algorithm, Gallager error exponent, channel input adaptation, natural type selection",

author = "Sergey Tridenski and Ram Zamir",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 2015 IEEE Information Theory Workshop, ITW 2015 ; Conference date: 26-04-2015 Through 01-05-2015",

year = "2015",

month = jun,

day = "24",

doi = "10.1109/ITW.2015.7133141",

language = "אנגלית",

series = "2015 IEEE Information Theory Workshop, ITW 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2015 IEEE Information Theory Workshop, ITW 2015",

address = "ארצות הברית",

}

TY - GEN

T1 - Stochastic interpretation for the Arimoto algorithm

AU - Tridenski, Sergey

AU - Zamir, Ram

PY - 2015/6/24

Y1 - 2015/6/24

N2 - The Arimoto algorithm computes the Gallager function maxQ E0(ρ, Q) for a given channel P (y / x) and parameter ρ, by means of alternating maximization. Along the way, it generates a sequence of input distributions Q1(x), Q2(x),⋯, that converges to the maximizing input Q∗(x). We propose a stochastic interpretation for the Arimoto algorithm. We show that for a random (i.i.d.) codebook with a distribution Qk(x), the next distribution Qk+1(x) in the Arimoto algorithm is equal to the type (Q′) of the feasible transmitted codeword that maximizes the conditional Gallager exponent (conditioned on a specific transmitted codeword type Q′). This interpretation is a first step toward finding a stochastic mechanism for on-line channel input adaptation.

AB - The Arimoto algorithm computes the Gallager function maxQ E0(ρ, Q) for a given channel P (y / x) and parameter ρ, by means of alternating maximization. Along the way, it generates a sequence of input distributions Q1(x), Q2(x),⋯, that converges to the maximizing input Q∗(x). We propose a stochastic interpretation for the Arimoto algorithm. We show that for a random (i.i.d.) codebook with a distribution Qk(x), the next distribution Qk+1(x) in the Arimoto algorithm is equal to the type (Q′) of the feasible transmitted codeword that maximizes the conditional Gallager exponent (conditioned on a specific transmitted codeword type Q′). This interpretation is a first step toward finding a stochastic mechanism for on-line channel input adaptation.

KW - Arimoto-Blahut algorithm

KW - Gallager error exponent

KW - channel input adaptation

KW - natural type selection

UR - https://www.scopus.com/pages/publications/84938914942

U2 - 10.1109/ITW.2015.7133141

DO - 10.1109/ITW.2015.7133141

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84938914942

T3 - 2015 IEEE Information Theory Workshop, ITW 2015

BT - 2015 IEEE Information Theory Workshop, ITW 2015

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2015 IEEE Information Theory Workshop, ITW 2015

Y2 - 26 April 2015 through 1 May 2015

ER -

Stochastic interpretation for the Arimoto algorithm

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this