ieee information theory society newsletter · 2018-11-27 · why convolutional ldpc ensembles...

28
IEEE Information Theory Society Newsletter Vol. 63, No. 3, September 2013 Editor: Tara Javidi ISSN 1059-2362 Editorial committee: Ioannis Kontoyiannis, Giuseppe Caire, Meir Feder, Tracey Ho, Joerg Kliewer, Anand Sarwate, Andy Singer, and Sergio Verdú The main annual awards of the IEEE Information Theory Society were announced at the 2013 ISIT in Istanbul this summer. The 2014 Claude E. Shannon Award goes to János Körner. He will give the Shannon Lecture at the 2014 ISIT in Hawaii. The 2013 Claude E. Shannon Award was given to Katalin Marton in Istanbul. Katalin presented her Shannon Lecture on the Wednesday of the Symposium. If you wish to see her slides again or were unable to attend, a copy of the slides have been posted on our Society website. The 2013 Aaron D. Wyner Distinguished Service Award goes to Daniel J. Costello. The 2013 IT Society Paper Award was given to Shrinivas Kudekar, Tom Richardson, and Rüdiger Urbanke for their paper “Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 The 2013 IEEE Communications Society and Information Theory Society Joint Paper Award goes to two papers: 1) B. Nazer, M. Gastpar, “Compute-and-Forward: Harnessing Interference Through Structured Codes”, IEEE Trans. Inform. Theory, Oct. 2011 2) S. Avestimehr, S. Diggavi, D. Tse, “Wireless Network Information Flow: A Deterministic Approach”, IEEE Transactions on Information Theory, Apr. 2011 • The 2013 Chapter of the Year Award goes to the Sweden Chapter. • 2013 IEEE Jack Keil Wolf ISIT Student Paper Awards were selected and announced at the banquet of the Istanbul Symposium. The winners were the following: 1) Mohammad H. Yassaee, for the paper “A Technique for Deriving One-Shot Achiev- ability Results in Network Information Theory”, co- authored with Mohammad R. Aref and Amin A. Gohari 2) Mansoor I. Yousefi, for the paper “Integrable Communication Channels and the Nonlinear Fourier Transform”, co-authored with Frank. R. Kschischang • Several members of our community became IEEE Fellows or received IEEE Medals, please see our web- site for more information: www.itsoc.org/honors The Claude E. Shannon Award honors “consistent and pro- found contributions to the field of information theory” and it is the most prestigious honor of our Society. János Körner is the recipient of the award. János Körner has been a Professor in Computer Science at “Sapienza” University of Rome since 1993. He obtained his Degree in Mathematics from Loránd Eötvös University, Budapest in 1970. From 1970 to 1992 he worked at the Mathematical Institute of the Hungarian Academy of Sciences. During these years he had two peri- ods of leave: from 1981 to 1983 working at Bell Laboratories, Murray Hill, NJ, and for the academic year 1987–88 work- ing at ENST, Paris, France. He is an Associate Editor of IEEE Trans. Information Theory and a member of the Hungarian Academy of Sciences. He is the coauthor of by now a clas- sic textbook on information theory and is a winner of many awards and recognition. Annual Awards Announced continued on page 5 Daniel Costello János Körner

Upload: others

Post on 10-Mar-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

IEEE Information Theory Society Newsletter

Vol. 63, No. 3, September 2013 Editor: Tara Javidi ISSN 1059-2362

Editorial committee: Ioannis Kontoyiannis, Giuseppe Caire, Meir Feder, Tracey Ho, Joerg Kliewer, Anand Sarwate, Andy Singer, and Sergio Verdú

The main annual awards of the IEEE Information Theory Society were announced at the 2013 ISIT in Istanbul this summer.

• The 2014 Claude E. Shannon Award goes to János Körner. He will give the Shannon Lecture at the 2014 ISIT in Hawaii.

• The 2013 Claude E. Shannon Award was given to Katalin Marton in Istanbul. Katalin presented her Shannon Lecture on the Wednesday of the Symposium. If you wish to see her slides again or were unable to attend, a copy of the slides have been posted on our Society website.

• The 2013 Aaron D. Wyner Distinguished Service Award goes to Daniel J. Costello.

• The 2013 IT Society Paper Award was given to Shrinivas Kudekar, Tom Richardson, and Rüdiger Urbanke for their paper “Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011

• The 2013 IEEE Communications Society and Information Theory Society Joint Paper Award goes to two papers:

1) B. Nazer, M. Gastpar, “Compute-and-Forward: Harnessing Interference Through Structured Codes”, IEEE Trans. Inform. Theory, Oct. 2011

2) S. Avestimehr, S. Diggavi, D. Tse, “Wireless Network Information Flow: A Deterministic Approach”, IEEE Transactions on Information Theory, Apr. 2011

• The 2013 Chapter of the Year Award goes to the Sweden Chapter.

• 2013 IEEE Jack Keil Wolf ISIT Student Paper Awards were selected and announced at the  banquet of the Istanbul Symposium. The winners were the following:

1) Mohammad H. Yassaee, for the paper “A Technique for Deriving One-Shot Achiev -ability Results in Network Information Theory”, co-authored with Mohammad R. Aref and Amin A. Gohari

2) Mansoor I. Yousefi, for the paper “Integrable Communication Channels and the Nonlinear Fourier Transform”, co-authored with Frank. R. Kschischang

• Several members of our community became IEEE Fellows or received IEEE Medals, please see our web-site for more information: www.itsoc.org/honors

The Claude E. Shannon Award honors “consistent and pro-found contributions to the field of information theory” and it is the most prestigious honor of our Society. János Körner is the recipient of the award. János Körner has been a Professor in Computer Science at “Sapienza” University of Rome since 1993. He obtained his Degree in Mathematics from Loránd Eötvös University, Budapest in 1970. From 1970 to 1992 he worked at the Mathematical Institute of the Hungarian Academy of Sciences. During these years he had two peri-ods of leave: from 1981 to 1983 working at Bell Laboratories, Murray Hill, NJ, and  for the academic year 1987–88 work-ing at ENST, Paris, France. He is an Associate Editor of IEEE Trans. Information Theory and a member of the Hungarian Academy of Sciences. He is the coauthor of by now a clas-sic textbook on information theory and is a winner of many awards and recognition.

Annual Awards Announced

continued on page 5

Daniel CostelloJános Körner

Page 2: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

2

IEEE Information Theory Society Newsletter September 2013

2

Table of Contents

Annual Awards Announced . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

From the Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

President’s Column . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

The Historian’s Column. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

IT Society Members Honored . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

IT Society Members Received 2014 IEEE Technical Field Awards . . . . . . 5

A conversation with Robert Fano. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

IEEE Information Theory Society Board of Governors Meeting Minutes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Golomb’s Puzzle ColumnTM: Combinatorial Counting . . . . . . . . . . . . . . 13

Golomb’s Puzzle ColumnTM: Word Puzzles Solutions . . . . . . . . . . . . . . . 14

Report on the 2013 European School of Information Theory (ESIT) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Report on the Sixth Annual North American School of Information Theory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Call for Papers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Call for Workshops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Conference Calendar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

Dear IT Society members,

As usual we start the September issue with a report on various awards announced at ISIT 2013 in Istanbul. The September issue of 2013 contains a very nice interview with Robert Fano conducted by Sergio Verdú. I believe you will all enjoy reading this as much as I did. In this issue, we con-gratulate Imre Csiszár, Tamer Basar, John M. Cioffi, and Balaji Prabhakar on their recognitions and awards as well as Bin Yu on her election to the American Academy of Arts and Sciences. I would like to thank Edmund Yeh, for preparing and submit-ting the BoG meeting minutes, in addition to our popular and regular contributors Tony Ephremides and Solomon Golomb. Finally we end this issue with reports from the 2013 European and North American IT schools, kindly prepared by Petar Pop-ovsky and Brent Ladd, respectively.

From the EditorTara Javidi

As a reminder, announcements, news and events intend-ed for both the printed newsletter and the website, such as award announcements, calls for nominations and upcom-ing conferences, can be submitted via the IT Society website http:// www.itsoc.org/, using the quick links “Share News” and “Announce an Event.” Articles and columns also can be e-mailed to me at [email protected] with a subject line that includes the words “IT newsletter.” The next few deadlines are:

Issue DeadlineDecember 2013 October 10, 2013March 2014 January 10, 2014June 2014 April 10, 2014

Please submit plain text, LaTeX or Word source files; do not worry about fonts or layout as this will be taken care of by IEEE layout specialists. Electronic photos and graphics should be in high resolution and sent as separate files. I look forward to hear your suggestions (especially regarding the new column) and contributions.

IEEE Information Theory Society Newsletter

IEEE Information Theory Society Newsletter

(USPS 360-350) is published quarterly by the

Information Theory Society of the Institute of

Electrical and Electronics Engineers, Inc.

Headquarters: 3 Park Avenue, 17th Floor,

New York, NY 10016-5997.

Cost is $1.00 per member per year (included

in Society fee) for each member of the

Information Theory Society. Printed in the

U.S.A. Periodicals postage paid at New York,

NY and at additional mailing offices.

Postmaster: Send address changes to IEEE

Information Theory Society Newsletter,

IEEE, 445 Hoes Lane, Piscataway, NJ 08854.

© 2013 IEEE. Information contained in this

newsletter may be copied without permis-

sion provided that the copies are not made or

distributed for direct commercial advantage,

and the title of the publication and its date

appear.

IEEE prohibits discrimination, harassment, and bullying. For more information, visit http://www.ieee.org/web/aboutus/whatis/policies/p9-26.html.

FPO

Page 3: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

3

September 2013 IEEE Information Theory Society Newsletter

President’s ColumnGerhard Kramer

The president’s third column of the year is often written shortly after ISIT, and this one is no ex-ception. The annual Symposium is our society’s main event and in early June there was concern about how the protests in Istanbul would de-velop. Fortunately, they did not escalate and the Symposium ran smoothly. The latter outcome can be attributed to the excellent organization by ISIT co-chairs Erdal Arikan and Elza Erkip, and their team.

Some of the many highlights of ISIT were the beautiful and historic city of Istanbul, the Shan-non lecture by Katalin Marton, and the four ple-nary lectures. As usual, there were numerous award presentations and announcements. IEEE President Peter Staecker presented Erdal Arikan with the IEEE W.R.G. Baker Award, for the most outstanding paper published in any IEEE archival publications during a three to five year win-dow prior to 2013. Then there were the surprise announcements of the winners of the 2013 IT Paper Award and the 2013 IEEE Jack Keil Wolf ISIT Student Paper Awards. Next, just before ISIT we learned that Imre Csiszár was selected as the recipient of the 2013 Dobrushin International Award. Please see this newsletter and our website for more information. Finally, and most important for next year, the 2014 Shannon Award winner was announced to be János Körner from Sapienza Universitá di Roma. It was clearly a great year for our members from Hungary who are associated with the Alfréd Rényi Institute of Mathematics in Budapest in one way or another.

The Monday evening of ISIT marked a sad occasion: a memorial event was held for James L. Massey who died on June 16. Jim’s passing is a great loss for our Society, for the other scientific com-munities in which he was active, and for everyone who was for-tunate enough to know him. The funeral was held in Copenhagen on June 22 and many of his former doctoral students attended. Please refer to our website for more information about Jim’s life, career, and influence.

For example, Jim was one of our society’s most international fig-ures. This was in part because of his career path, but even more so because of his personality, his interest in and care for people irre-spective of where they came from, and because of his gift for mak-ing information theory accessible to the uninitiated. In this context, I will point out that this year there were several new information the-ory events worldwide. For example, in February the first European Training School in Network Coding was held in Barcelona; in April the first Workshop on Entropy and Information Inequalities was held in Hong Kong; in May the first Iran Workshop on Communi-cation and Information Theory was held in Tehran; and in July the

first International Black Sea Conference on Com-munications and Networking was held in Batumi. I was fortunate to be able to attend the Iran Work-shop at Sharif University and was impressed by the quality of the students and faculty. I especially appreciated their generosity and kindness during my visit. I was also able to attend the Black Sea conference in Georgia, unfortunately only briefly. All these events serve their communities by mo-tivating the current and next generation of engi-neers, mathematicians, and scientists to consider studying and applying tools of information the-ory. The desire to develop international contacts is, naturally, especially strong in countries that are isolated geographically or politically.

As in previous columns, I will close by drawing attention to outstanding volunteer work by our members. First, the Publi-cations Committee is now chaired by Editor-in-Chief Yiannis Kontoyiannis. Yiannis deserves great appreciation for taking on this demanding task, and I am grateful for his commitment to our society.

Second, the Student Committee has been mentioned often in past columns, and this time I would like to highlight the work of the committee chairs. Aylin Yener was chair from 2007 until 2011, and she put much energy and enthusiasm into her work. Elza Erkip and Sriram Vishwanath became committee chairs in 2012. Earlier this year, Deniz Gunduz replaced Elza who now chairs the Conference Committee. The Student Committee continues to be very active under the leadership of Sriram and Deniz. For example, during ISIT Daniela Tuninetti and Deniz organized a “Meet the Shannon Awardee” lunch event with Katalin Marton. The meeting was a great success and is planned for future ISITs. I encourage you to attend in 2014; the event is a valuable oppor-tunity to get to know the most recent Shannon Award winner a little better.

Third, the Outreach Committee organizes a mentoring program and outreach events at ISITs and workshops. The current chair is Joerg Kliewer. I invite you to browse our society webpage to learn about the programs this committee offers. For example, the Women in Information Theory (WITHITS) program was headed by Christina Fragouli until the end of 2012. The program is now run by Negar Kiyavash who is actively planning a video initiative that I expect you will hear about soon.

Finally, the 2013 Information Theory Workshop will be held in Se-villa, Spain, in September. This newsletter will likely reach you only after the workshop is completed. I hope that you were able to attend and enjoy ISIT, and that you had a good summer.

Page 4: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

4

IEEE Information Theory Society Newsletter September 2013

The Historian’s ColumnAnthony Ephremides

It is the mark of time and the destiny of humankind. One by one, the people we know and love or loathe are passing away until our own time comes. Throughout human history, philosophers, artists, scientists, and plain folk have ruminated about death only to be left with unanswered questions. Religions have tried to “ex-plain” the passing and soothe the living. But no matter how we come to terms with our fate, when death strikes the feeling of loss is heavy and rekindles all the questions and anxieties about it that we harbor. Especially when the deceased is a special person, someone we love, respect, or admire.

In the last few years, our Community has lost some of its most luminary members. The ink is still fresh from the eulogies we de-livered for our giants colleagues Jack Wolf and Tom Cover. And of course, if we look further back we will remember the untimely passing of Aaron Wyner and the loss of Peter Elias and many oth-ers. Before we could recover, we had to confront the news of Jim Massey’s death. One cannot make comparisons in the ever after, but Jim was truly special. In addition to being one of the brilliant scientists who solidified Information Theory as the foundation of our Information era and who can be counted in the fingers of a single hand, Jim had some other qualities as a human being that are simply truly rare. His smiling face was a staple for all our gath-erings. His generous disposition was a kindling of good will for all. His wit was a source of delight. His company and fellowship during relaxing after-work gatherings was irreplaceable. His pres-entations were standing-room only events. His crisscrossing of the world as an apostle of Information Theory cannot be duplicated. Beloved by all his colleagues, students, co-workers, friends, and family, he was one of those rare human beings whom one can con-fidently elevate to the pedestal of the ultimate “role-model”.

In the last ISIT in Istanbul a hastily organized memorial service (barely a week or so after his funeral) drew hundreds among those who knew him or simply had heard about him to hear words of celebration of his life and contributions to science and the human spirit. The outpouring of warm remembrances lasted well into the night. Cataloguing Jim’s virtues brought his spirit back amongst us.

Jim was one of the dwindling set of colleagues who had the privilege of knowing Claude Shannon and working with him.

Inspired by his example, Jim led a life that was true to the mission he set out for himself; namely, to spread the allure of Information Theory to the world. After he moved to Europe in the early eighties, Jim engaged in a whirlwind tour of the world energizing every corner of intellectual activity at Universities and Institutions and making converts every day. He was truly Information Theory’s ambassador to the world. Perhaps not with the zeal of Aaron Wyner but with a similar commitment and dexterity he created a global following for our field that has grown beyond the level of a critical mass. He earned the first Aaron Wyner Award for exceptional Leadership and Service to our Society as a fitting complement to his legion awards for his scientific accomplishments.

Jim was a very generous man. He had only praise for everyone. He could pick the best that everyone carried within and put it up front. I never heard him say an ill word for anyone (including many who deserved it). He was helpful, kind, considerate, civi-lized, broadly educated, knowledgeable in many fields outside his profession, and a superb conversationalist. His Irish back-ground elicited in him joviality and eagerness to sing, celebrate, and sip a fine whiskey. He adored his miniature dogs and made light of all their misdeeds. His sense of humor was a sheer de-light. Who doesn’t remember his “quip” during his Shannon Lecture in Kobe, when he playfully introduced the “concept” of the “Minimum Likelihood” Receiver? When the audience burst into laughter, he went on with “why are you laughing? I will patent this concept and start a new company called “Sink-a-bit”, with the marketing slogan of “Sink a Buck in Sink-a-bit””, clear-ly making an unparalleled metaphor for Linkabit and the slogan “link a Buck to Linkabit”.

On another occasion when the discussion was raging on the need for a proof to be rigorous he quipped “rigor is great, provided it does not become rigor mortis”. And the ultimate example to me of his unique wit was the occasion when I told him my unhappy experience of buying a leg of prosciutto from the Rome airport on my way back to New York. Upon arrival, the customs officer confiscated my purchase arguing that it was not permitted into the country. He proceeded to place it in a drawer. When I asked him what he would do with it, he responded that he would destroy it. As I told this to Jim, I added that I had the suspicion that he prob-ably took it home for consumption instead of destroying it. Upon which, Jim said “if he took it home, it would be ordinary human corruption; if he destroyed it, it would be uncivilized behavior”!

Jim has simply left an indelible memory to our collective con-science. It will live in us and will guide us. For everyone who knew him, Jim will not be forgotten. How could he? To me at least he epitomized the idea of a “Role Model”. May you rest in peace, Jim! You shaped our thinking, you shaped our Field, and you shaped our lives. Farewell.Photo courtesy of Sergio Verdú

Page 5: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

5

September 2013 IEEE Information Theory Society Newsletter

IT Society Members Honored

IT Society Members Received 2014 IEEE Technical Field Awards

Bin Yu, Chancellor’s Professor, Departments of Statistics and EECS, University of California at Berkeley, has been elected to the American Academy of Arts and Sciences in the Mathematics, Ap-plied Mathematics and Statistics section.

Election to the academy honors individual accomplishment and calls upon members to serve the public good, said academy pres-ident Leslie C. Berlowitz. “We look forward to drawing on the knowledge and expertise of these distinguished men and women to advance solutions to the pressing policy challenges of the day.”

Imre Csiszár, Alfred Renyi Institute of Mathematics, Hungarian Academy of Sciences, has been awarded the 2013 Dobrushin In-ternational Award.

Dobrushin International Award was established in 2008 and is handed in on July 20, the birthday of Dobrushin. The prize is awarded to outstanding researchers for the totality of their work in the domains of Dobrushin’s research interests, including prob-ability theory, mathematical and computer linguistics, information theory and statistical physics.

Tamer BasarUniversity of Illinois at Urbana- Champaign2014 IEEE Control Systems Award

“For seminal contributions to dynamic games, stochastic and risk-sensitive control, control of networks, and hierarchical decision making.”

John M.Cioffi Stanford University2014 IEEE Leon K. Kirchmayer Graduate Teaching Award

“For educating a stellar array of graduate students in digital communications and for inspiring them to make a difference.”

Balaji PrabhakarStanford University2014 IEEE Innovation in Societal Infrastructure Award

“For his demonstration of the innovative use of information technology and distributed computing systems to solve long-standing societal problems, in areas ranging from transportation to healthcare and recycling.”

The Aaron D. Wyner Distinguished Service Award honors “indi-viduals who have shown outstanding leadership in, and provided long-standing exceptional service to, the Information Theory Com-munity”. Daniel Costello has been selected as the recipient of this award for 2013. He has been a reliable supporter of the IEEE Infor-mation Theory Society for over four decades, serving as its President in 1986, three times as ISIT co-chair, three times as board member; chair of many committees including the Conferences, Fellows, and Hamming medal committees as well as Associate Editor for the IEEE Information Theory and Communications Transactions. Dan is the co-author of a popular textbook on coding and winner of several IEEE paper prizes. We are lucky to have such distinguished and dedicated members as leaders of our Society.

The Information Theory Society Paper Award is given annually “for an outstanding publication in the fields of interest to the Society appearing anywhere during the preceding two calendar years”. The Awards Committee must receive at least 5 nomina-tions for the Best Paper Award from the Publications Committee. Nominations received in previous years for papers that remain eligible are also considered. Of these, the Awards Committee sub-mits up to three to the Board of Governors. The BoG voted be-fore ISIT in Istanbul to recommend the paper by S. Kudekar, T. J. Richardson, and R. L. Urbanke, “Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform So Well over the BEC,” IEEE Transactions on Information Theory, Vol. 57, Issue 2, pp. 803-834, Feb. 2011. If you are curious to find out more about the selection procedure, please refer to the IT Society Bylaws at http://www.itsoc.org/people/organization

The IEEE Communications Society and Information Theory Soci-ety Joint Paper Award recognizes outstanding papers “appearing in any publication of the IEEE Communications Society or the IEEE In-formation Theory Society in the previous three calendar years”. For this award, each Society has an internal process to choose among nominated papers to forward to the joint committee. This year, each Society put forward 3 nominations and the joint committee selected the winners. The 2013 Award went to two 2011 papers in network information theory: one on the deterministic approach to wireless channels by Salman Avestimehr, Suhas Diggavi, and David Tse and the other on compute-and-forward via structured codes by Bobak Nazer and Michael Gastpar. Congratulations to all the winners!

The 2012 Chapter of the Year Award was presented to the Swe-den Chapter at ISIT in Cambridge. The Membership and Chapters Committee selected the winner based on chapter-related activities during 2012 and 2013, including scientific events, student events, web presence, and recruiting efforts.

The IEEE Jack Keil Wolf ISIT Student Paper Award is a relatively new award of our Society that is intended to encourage and recognize stu-dent work. The Award is “given annually for up to three outstanding papers at the ISIT for which the student is the principal author and presenter”. This year the ISIT Technical Program Committee assigned the Awards Committee 12 papers from which the Awards Commit-tee chooses up to 6 as finalists for presentations to judge. Our Bylaws specifies that the Awards Committee should announce the winner(s) at the ISIT banquet. The two winners were Mohammad H. Yassaee and Mansoor I. Yousefi. Congratulations to both winners!

Annual Awards Announced continued from page 1

Page 6: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

6

IEEE Information Theory Society Newsletter September 2013

A conversation with Robert FanoSergio Verdú

I met with Robert Fano on June 14, 2013 in his residence in Con-cord, Massachusetts. What follows is an edited and condensed transcript of our conversation.

SV: Bob, at 95 you seem to be in great shape.

RF: I lost the vision in one eye a few years ago and I have some dizziness in the morning but, otherwise, I cannot complain.

SV: You were born a year after Claude Shannon.

RF: Yes, in Torino. Italy. I grew up in an academic environment. My father, Gino, was a Professor of Mathematics at the Univer-sity of Torino. He had worked with Felix Klein. He died in 1952. My older brother, Ugo, became a theoretical physicist and worked with Fermi and Heisenberg. He became a professor at the Univer-sity of Chicago and died in 2001; My cousin Giulio Racah, was also a theoretical physicist. He eventually became rector of the Hebrew University of Jerusalem.

SV: What are your memories of Torino?

RF: I have very happy memories of my life in Torino. I did moun-tain climbing on skis in winter and early spring and, rock climbing with ropes and pitons in the Dolomites during the summer. My happy life ended abruptly in 1938 when I turned 21 and Mussolini decided to join Hitler in a campaign against Jews, in spite of the fact that there was no sentiment against Jews in the country. Sud-denly, a committee of “experts” decided that there was an identifi-able Italian race of which Jews were not part. That was the begin-ning of the racial laws. These laws had become serious enough by fall that my family decided that we should leave Italy. My parents went to Switzerland; my father would not go to any country that might be at war with Italy. My brother decided to come the US. He was already in Paris and arrived in the US in the Summer of 1939 after picking up his wife in Argentina where she had gone earlier with her family. I decided to complete my fourth year of engineer-ing in Torino, but not the fifth one, before emigrating.

SV: So you decided to come to the US because your brother was here...

RF: No, I too wanted to come to the US. I had visited the US with my parents in the summer 1932 and I had a great memory of it. I took the exams of the 4th year of Engineering and joined my parents in July 1939 with the intent of getting the visa to the US in Switzerland.

SV: Was that electrical engineering?

RF: In Italy, Engineering was a very broad program with the spe-cialization occurring in the last year. For reasons I don’t remember I was always interested in electrical engineering.

RF: Back to the visa to the US. I had to make several trips to the US consulate in Zurich. On August 31 I was told that my visa was just waiting for the quota number from Washington. Upon leaving the

consulate, I saw in the newspaper that Germany and Russia had signed a non-aggression treaty, which meant that the war was go-ing to start the next day. And in fact it did. Now my problem was to get to the US. I could not leave from Italy because Mussolini did not approve emigration to the US. I had to leave through France, which was already at war and required that all visas be approved in Paris. Fortunately, I was traveling with a cousin from Rome who had family diplomatic connections leading to the French am-bassador. I got though him the visa to get aboard the Manhattan in Bordeaux. I arrived in New York in late October 1939. My brother Ugo was there to greet me.

SV: How was your English?

RF: I had learned English in Italy but I had trouble with local accents, particularly in Washington where I spent my first two months. My first task was to complete my undergraduate engi-neering degree. Initially, I did not apply to MIT because I thought I had no chance of being admitted to such a famous school. But my sister-in-law, who had a sharp tongue, insisted that not ap-plying was a sure way of not being admitted! So I did apply, and MIT was not only the first school to admit me but also the one that gave me the most credits for my studies in Italy, includ-ing for the humanities that I had taken in high school. It turned out that MIT was very friendly to foreign students. I started at MIT in February 1940 and, by attending the summer term, I com-pleted the requirements for the SB degree by February 1941. I received top grades in all subjects except for the first laboratory. I mention this because I was well aware that my personal standing would not cross the Atlantic with me and I would have to rebuild it in the US.

SV: You worked extra hard.

RF: I did. My thesis was on the feedback control of the speed of an electric motor. The executive officer of the EE department asked me if I would be interest in a teaching assistantship. I said no, because at that time I wanted to go to work in industry. Un-fortunately, the electrical industry was already on a war footing and the jobs that I was offered turned out to require a military clearance that I could not get because I was not a US citizen. The only job that did not require a clearance was in a General Mo-tors stamping and welding plant in Grand Rapids, Michigan. Unfortunately, the job turned out to be very different from what I had expected and rather unpleasant. I informed MIT that I had changed my mind. The offer of a teaching assistantship arrived at the beginning of the fall term and two days later I was on my way back to MIT.

Teaching assistants were expected to devote half of their time to the tasks assigned to them and the other half to their graduate studies so that they could qualify for an SM degree by the end of the second year. My first year went according to this plan, but by the beginning of the second year, September 1942, the US was at war and several members of the faculty had left for war duties and teaching assistants had to take over their classes. I had the opportunity to attend the classes of a subject that I had to teach

Page 7: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

7

September 2013 IEEE Information Theory Society Newsletter

the next term. Otherwise I had to learn the material just ahead of my students. That kind of teaching became a major part of my graduate education. Apparently my performance was good enough to merit my promotion to the rank of instructor. In addi-tion I was put in charge of a pair of graduate subjects on micro-waves and antennas that, of course, I had never taken. This time I was really two weeks ahead of my students and they were aware of it. We learned together. I was encouraged to accept that tasks by my mentor, Ernst Guillemin, the “guru” of network theory who told me that he had started out by being asked to teach a subject on filters about which he knew nothing. Did you know about Guillemin?

SV: Sure I did. As an undergraduate in Barcelona we had a full course on network synthesis. We learned all about Guillemin, Cauer, and Hurwitz polynomials.

RF: By the way, what does Verdú mean?

SV: Nothing. It is the name of a town in Catalonia.

RF: Fano is the name of a town on the Adriatic coast. Some Pope had decreed that Jews had to adopt the name of their town of origin.

SV: Yes, also in Spain.

RF: Back to MIT. By the summer of 1944, Italy was out of the war and I was cleared to join the Radiation Lab since I was no longer a citizen of an enemy nation. I became a “microwave plumber” and designed a variety of components for radar systems. I also became a coauthor of two chapters on microwave filters in volume 9 of the Radiation Laboratory series. I completed the manuscript of those chapters in April 1946 just when the leftover of the Ra-diation Laboratory became the beginning of the Research Labora-tory of Electronics. I became a Research Associate in the Electrical Engineering Department, resumed my teaching, and turned my attention to completing my doctorate.

The doctoral thesis was the major task confronting me. Most of my time at the Radiation Laboratory was spent “broadbanding” some microwave component and I often wondered whether there was a fundamental limit to how broad a band could be achieved. I decid-ed to tackle that problem in the simpler case of a two-terminal net-work of LCR components, with antennas being special cases. The problem had been solved by Hendrik Bode for simple RL and RC impedances. I didn’t get anywhere until Christmas. I was walking to the train station to go to Washington when I saw the light. The rest was just a lot of mathematics in the complex plane. The thesis titled “Theoretical Limitations on the Broadband Matching of Ar-bitrary Impedances” was completed in time for my receiving my ScD in June 1947.The graduation ceremony that took place (for the last time) in Boston’s Symphony Hall was attended by my parents. My appointment to Assistant Professor started shortly thereafter on July 1, 1947.

My interest turned at that point to the field of communication in which there was considerable activity in RLE, mostly centered on the book by Norbert Wiener entitled “Extrapolation, Interpola-tion, and Smoothing of Stationary Time Series”.

SV: Had you already met Claude Shannon?

RF: I had heard of him from Jerry Wiesner who was an under-graduate with him at the University of Michigan and because Shannon’s Masters thesis was famous at MIT. Jerry had told me that Shannon was developing some sort of theory of communica-tions. I had no idea what it was. Norbert Wiener had the habit of wandering into friends’ MIT offices, making some statement and then leaving without waiting for an answer. One morning he came into my office with his cigar and said “You know: Information is Entropy” and walked out without any further comment. I never found out where he had gotten that idea but it excited my curios-ity and I kept thinking about it. Again, while walking to the train station to attend the IRE meeting in New York, it occurred to me that that relation might have to do with the representation of mes-sages with binary digits. By the time I arrived to New York I had defined the entropy of a set of messages and proved the coding theorem for noiseless channels.

SV: In fact, Shannon describes your idea in his paper.

RF: Wait a minute. At the IRE meeting the next day I buttonholed Shannon after the presentation of his paper, and asked him per-mission to visit him in his office the next day. Obviously, he didn’t like the idea but he was nice to me and he agreed to see me. The next morning, I went to Murray Hill and he received me in his of-fice with the same bored face. But when I started telling him what I had done on the train his face lit up: I had duplicated the initial part of his work. Shannon was kind enough to make reference to my work in his famous BSTJ paper that appeared in the fall 1948. I was very embarrassed when Shannon asked me for a reference to my work. I had not yet put it on paper. I gave him the first unused number in the series of reports of the Research Laboratory of Elec-tronics and got busy writing the report.

SV: When you first saw Shannon’s paper, were you already famil-iar with the language of probability, random processes? It was not yet common in the toolbox of engineers.

RF: I was generally familiar with it, but there was still a lot to learn. The basic and most important notion in Shannon’s work is that information is transmitted in the form of selections from finite sets of messages. This was very different from the previous goal of ac-curate transmission of waveforms. I accepted Shannon’s statement that it was possible to transmit information at any rate smaller than channel capacity with a vanishing small probability of error. How-ever I was not satisfied with Shannon‘s original proof. I challenged a physics student looking for a thesis topic to provide a solid proof. He did it in a very short time but I had a very hard time getting him to write a thesis acceptable by the physics department. He had the mind of a mathematician and not that of a physicist.

SV: Was this Feinstein?

RF: Yes. He was a very bright fellow but there was something strange about him. I don’t know what happened to him.

SV: He wrote a book and translated Pinsker’s book into English. He is one of the people in information theory I always felt was most underrated. Wolfowitz, Ahlswede, that mathematical branch of in-formation theory, was very much influenced by Feinstein’s work.

RF: He disappeared. The last time I saw him was at an information theory meeting at Lake Como.

Page 8: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

8

IEEE Information Theory Society Newsletter September 2013

SV: Did you keep in touch with Claude Shannon? What was he like?

RF: Oh Yes! He was a wonderful and interesting person. He had the strangest ideas. He built an aerial tramway in his backyard to the lake. He bought a school bus and transformed it into a travel home. He learned how to ride a monocycle…etc. He came to MIT as a visiting professor and then accepted a permanent chair. How-ever he never acted as a regular professor. He lectured for a while; he was a wonderful speaker. Then slowly faded away. When I be-came director of Project MAC I put a time-sharing terminal in his home hoping that he would do something interesting, but only Betty used it. Claude was very photogenic; I was given a portrait of Claude around 1965, and it is still adorning my office.

SV: So true. Also Shannon had the fortune to be photographed by some of the giants of XXth century photography: Henri Cartier-Bresson, Alfred Eisenstaedt.

SV: Your course on information theory must have been the first course on the subject anywhere.

RF: Yes, I believe so. The first time I offered the subject in 1950 I presented in class all I knew about the subject, just a little more than the content of Shannon’s paper. I could not think of prob-lems for the students to solve so I asked them to write term papers on some pertinent subjects. Dave Huffman, who was in my class, invented the procedure for constructing the most efficient codes.

SV: He was your PhD student?

RF: No, I believe his thesis was on switching networks.

SV: Going back to Wiener, did you ever talk with him?

RF: Yes, but always about what interested him.

SV: Did he know you were teaching “Information Theory”?

RF: Possibly. However I doubt he knew what I meant by informa-tion theory. Wiener was a bit professionally self-centered; also he was getting old and had vision problems. I doubt that he ever read Shannon’s 1948 paper.

SV: Peter Elias. He also became interested in Information Theory.

RF: I gave a talk at Harvard and he came to speak with me. I thought he was very smart and I invited him to come to MIT as an assistant professor. He did some very good work in information theory and eventually became Department Head. He died very suddenly in 2001.

SV: You came up with the name “mutual information”.

RF: Yeah. It’s not generally known that I did. I am surprised you know that.

SV: How did Fano’s inequality came about? Did you notice there was a gap in the converse in Shannon’s paper?

RF: No. I felt that entropy measures did not provide a physical understanding of the process of communication in the presence

of noise. Noise causes errors and the probability of error is what counts. So I thought it would be nice to relate the entropy loss caused by noise to the probability of error.

SV: You never published it.

RF: By that time I didn’t worry about publishing. My information theory output was primarily in my class notes and my textbook.

SV: Let’s talk about your next phase: computers. At some point you decided you had enough of information theory.

RF: My textbook “Transmission of Information” evolved in the form of class notes over a decade and appeared in print in 1961. I was de-veloping at the same time class notes for an undergraduate subject on electromagnetism which led to the textbook “Electromagnetic Fields, Energy, and Forces” that appeared in print at about the same time. I decided to take a vacation from teaching in the form of a sab-batical leave at the MIT Lincoln Laboratory over the academic year 1961–62. My intention was to look around for something else to do but my mind kept going back to information theory and I ended up inventing the sequential decoding algorithm that I described at the end of my invited paper “A Heuristic Discussion of Probabilistic Decoding”. It was a good idea, but it could not be used in practice at that time. A few years later, however, Irwin Jacobs mentioned my algorithm while introducing me at an IEEE meeting, pulled a chip out of his pocket and said “here it is”! Indeed, chip technology made a big impact on the evolution of information theory.

SV: By the way, you gave one of the first Shannon lectures.

RF: Yes, the third: Shannon, Slepian and me. By that time I had been away from information theory for several years and I must have talked about on-line computation and time-sharing systems. I got involved with computers and became the founding direc-tor of Project MAC, a laboratory that has evolved into the present “Computer Science and Artificial Intelligence Laboratory”.

Project MAC originated from work done at the MIT Computation Center toward the two goals that eventually led to the present In-ternet: providing personal access to computers and providing it to the population at large in the form of a computer utility. In the fall 1962, a branch of the Advanced Research Projects Agency of the Department of Defense directed by J.C.R. Licklider was offering large financial support for work toward these goals. MIT was in an excellent position to obtain it because of the work already in prog-ress at the Computation Center. What was missing was an indi-vidual willing to pull together the MIT resources, write a proposal and, if accepted, lead the research effort. I felt very strongly that MIT should not miss this opportunity particularly because I be-lieved that Computer Science was going to become an important new discipline. Unfortunately the right person was not available. I had no management experience, and I was not, by nature, a multi-tasker. In the end, I closed my eyes and jumped in. Fortunately I had the full support of the MIT administration and the whole-hearted participation of the Computation Center. Project MAC started on July 1, 1963 and I was its Director until the Fall of 1968.

SV: That must have been quite a job managing the logistics of such a large scale project. A lot of headaches.

RF: Yes. I had a lot of those.

Page 9: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

9

September 2013 IEEE Information Theory Society Newsletter

SV: How long did the project last?

RF: Still exists. Just changed its name. At the beginning I didn’t want to call it a Laboratory because I needed the participation of people from the whole of MIT. Later on it became the Laboratory for Computer Science.

SV: Tell me a bit about your family.

RF: I met my wife at a dance on Valentine’s Day 1948. We got mar-ried in the Spring break in 1949. Our first girl was born in 1950, the second girl in 1955. Our boy was born in 1960. He recently decided to change sex so now I have three daughters. I have five grand children. They are all doing fine. I lost my wife in August 1998 to ovarian cancer.

SV: Well, Bob it has been a pleasure meeting with you and listening to so many fascinating stories.

RF: Let me just add that I formally re-tired in 1984, but I still have an office in CSAIL, which I share with my col-league J.F. Corbató. I still drive to MIT periodically.

SV: Bob, you are so fortunate that your mind is so sharp. Stay healthy! One more thing: Would you mind if I take your picture?

RF: Oh sure.

IEEE Information Theory Society Board of Governors Meeting MinutesCatamaran Resort, San Diego, CA, 02.10.2013, 1–6 pm

Edmund Yeh

Present

Jeff Andrews, Matthieu Bloch, Giuseppe Caire, Michelle Effros, Abbas El Gamal, Elza Erkip, Michael Honig, Tara Javidi, Negar Kiyavash, Joerg Kliewer, P. Vijay Kumar, Urbashi Mitra, Alon Orlitsky, Petar Popovski, Paul Siegel, Emina Soljanin, David Tse, Rudiger Urbanke, Sergio Verdu, Alex Vardy, Emanuele Viterbo, Edmund Yeh, Aylin Yener.

The meeting was called to order at 1:10 pm by the Information Theory Society (ITSoc) President, Gerhard Kramer, who wel-comed the Board of Governors (BoG).

1. Motion: The minutes of the BoG Meeting at ITW 2012 held at Lausanne, Switzerland, were approved.

2. Motion: The agenda was approved.

3. Gerhard Presented the President’s Report: Gerhard welcomed the new members of the BoG: Jeff Andrews, Michael Honig, P. Vijay Kumar, Emina Soljanin, Rudiger Urbanke, and Ram Zamir.

Major honors for IT Society members were celebrated: Sol Golomb (recipient of U.S. National Medal of Science), Abbas El Gamal (elected Member of the U.S. National Academy of Engineering), Shlomo Shamai (Shitz) (elected Foreign Associate of the U.S. National Academy of Engineering), Irwin Jacobs (recipient of the IEEE Medal of Honor), Robert Calderbank (recipient of the Ham-ming Medal), Erdal Arikan (recipient of the W.R.G. Baker Prize Paper Award), Vahid Tarokh, Hamid Jafarkhani, Siavash Alamouti (recipients of the Eric E. Sumner Award).

Congratulations to the new IEEE Fellows from IT Society: Jeff An-drews, Andrew Barron, Gerard Cohen, Max Costa, Suhas Diggavi,

Anders Host–Madsen, Kenneth Kreutz-Delgado, Tamas Linder, Daniel Palomar, Erchin Serpedin, Antonia Tulino, Pramod Viswa-nath, Tsachy Weissman, Feng Wu.

Gerhard noted that the IEEE Technical Activities Board (TAB) meeting will take place February 15–16. The IT Society Review will take place on Thursday, Feb. 14. He expressed thanks to Mu-riel for organizing the society review, and to the following con-tributors for providing text: Bruce, Helmut, Abbas, Sriram, Elza, Joerg, Negar, Prakash, Frank, Tara, Matthieu, Aylin.

4. Aylin Presented the Treasurer’s Report: Aylin first summa-rized some recent conference closings. The 2011 North American IT School held in Austin, Texas, ended with no surplus (and with $25,008 society support). The 2011 ISIT ended with a surplus of $118,074. The 2012 North American IT School, Cornell, ended with a surplus of $6,939. Conferences which have not started the clos-ing process include the 2012 European IT School, Turkey, April 2012, and the 2012 ISIT, MIT, July 2012.

With regards to conference closings, Aylin held up ITW 2012 as a great example. The conference generated a surplus of $8,453. It was held September 2012 in Lausanne. As of February 7, 2013, it was ready to close within a week. The overall process took only five months from the conclusion of the conference (inclusive of the audit).

Aylin continued onto the 2013 budget. The budget was prepared in May 2012, approved in July 2012, and finalized in Novem-ber 2012. The initial projected surplus for 2013 was $131k (ap-proved by Aylin). The surplus was then decreased to $2k due to an increase in the page budget of IT Transactions pages to 8000. Then, in September, the budget was updated to have a surplus of $179.4k. The explanation given by the IEEE is that this was due

Photo courtesy of Sergio Verdú

Page 10: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

10

IEEE Information Theory Society Newsletter September 2013

to additional income for 2012 from “ASPP India (AICTE) agree-ment.” As a result of this, Aylin requested an immediate increase from $100k to $120k for committee budgets. This was approved by TAB. The final projected surplus for 2013 is $159.4k.

Aylin continued onto the 2012 budget. The forecast for the 2012 budget at the preparation stage was a surplus of $84.7k (finalized in 2011). As of May 2012, the end-of-year surplus was forecasted to be $119k. During the summer, the forecast went down signifi-cantly (to as low as $0.7k). By late October, thanks to revenues and reducing the original increase in the Transactions page budget, the surplus was back up to $66k. As of October 22, the surplus remained at $66k and the situation was regarded as “unfavor-able” by IEEE. However, the surplus has now climbed to $219k. The additional $153k seems to have come again from “ASPP India (AICTE) agreement.” Aylin commented that forecasts appear to be less than informative, and that we should try to plan the budget as best as we can (at least the parts we can control) and then go about spending it to benefit the Society.

Aylin emphasized that the time to plan the 2014 budget is now. The major components of the budget are 1) committee allocations (Schools, Online, M&C [Distinguished lecturers], Student, Out-reach), 2) Transactions page budget (EiC) and 3) Print subscription fees. Current proposed committee allocations are: Schools: $40k, Student: $10k, Outreach: proposed increase from $1.5k to $3k. WITHITS: proposed increase from $1.5k to $3k. Budgets for the Online and DL committees are yet to be determined.

Gerhard noted that there is no need to vote on small committee budget allocation increases. The Treasurer is authorized to imple-ment the increases.

Motion: Increase the print subscription fee for IT Transactions to $100 for IT Society members.

The current cost of print transactions is $147 per subscription. We currently charge $65. Other societies have already crossed the $100 mark (Example: SP was $69 and increased to $104).

Discussions on the motion followed. Some BoG members noted that many members receive print versions of the Transactions, and since the Society currently has a surplus, there is no need to in-crease print subscription fees significantly. Others contended that the Society should not subsidize wasteful paper copies.

Motion: Friendly Amendment: increase the print subscription fee for IT Transactions to $80 for IT Society members. Motion was passed.

Aylin ended with a note regarding reimbursement of expenses.

5. Giuseppe Caire Presented the Nominations & Appointments (N&A) Committee Report: The 2013 N&A has the following mem-bers: Giuseppe Caire (SPP, ex-officio Chair), Muriel Medard (JPP, ex-officio), G. David Forney, Jr., David Neuhoff, and Shlomo Shamai.

As of Fall 2012, Elza Erkip was nominated (by the N&A Commit-tee) to be Chair of the Conference Committee. Sriram Vishwanath and Elza Erkip have co-chaired the Student Committee in 2011-2012. Given Elza’s new appointment, the N&A Committee decid-ed to nominate Sriram as the sole chair of the Students Committee.

Motion: Vote to approve Elza as Chair of the Conference commit-tee. Motion was passed.

The 2013 Awards Committee consists of Abbas El Gamal (ex of-ficio, Chair), Michelle Effros (ex officio), continuing members Mi-chael Gastpar, Alex Grant, Igal Sason, Emanuele Viterbo, Aaron Wagner, Randall Berry, Ubli Mitra, new members Merouane Deb-bah, Andreas Winter, Vijay Kumar, Pascal Vontobel, Young-Han Kim, and outgoing members [SPECIAL THANKS] include Ian Blake, Emina Soljanin, David Tse, Greg Wornell.

The 2013 External Nominations Committee consists of Gerhard Kramer, with continuing members Alon Orlitsky, Han Vinck, new members Helmut Bolcskei, Dick Blahut, and outgoing members [SPECIAL THANKS]: Prakash Narayan, Max Costa. The chair is to be elected by the committee itself, Gerhard Kramer will lead the process.

The 2013 Wyner Service Award Committee consists of Gerhard Kramer (Chair, ex officio), Muriel Medard (ex officio), continu-ing members Rolf Johannesson, H. Vincent Poor, new member Ian Blake, and outgoing member [SPECIAL THANKS] Anthony Ephremides.

The 2013 Shannon Award Committee consists of Gerhard Kramer (Chair, ex officio), Abbas El Gamal (ex officio), Michelle Effros (ex officio) continuing members Sergio Verdu, Raymond Yeung, new members Sol Golomb, Imre Csiszar, and outgoing members [SPE-CIAL THANKS]: Dick Blahut and Jacob Ziv.

In Fall 2012, the N&A Committee chaired by Frank Kschischang selected Yannis Kontoyiannis to be the next Editor in Chief of the IEEE Transactions on Information Theory, succeeding to Helmut Bolcskei. Yannis was contacted by the committee and agreed.

Motion: To approve Yannis Kontoyiannis as the next EiC of the Transactions. Motion was passed.

6. Matthieu Bloch Presented the Online Committee Report: Mat-thieu noted that the Society website had been running smoothly and consistently until February 5th, when it experienced significant slowdowns and errors (error 504). The problem has been fixed on February 8th, with the website running up again, but the fundamen-tal cause of the problem has not been precisely identified yet. The de-velopers have scheduled additional time to fix the issue next week, and the Online Committee will provide more information then.

Following the discussion during the BoG meeting in Lausanne, the Online Committee has investigated the possibility of using an online version of the newsletter to complement the paper version. Matthieu presented a sample online newsletter based on the De-cember 2012 newsletter. The benefits of having an online newslet-ter include: a timely dissemination of the articles, the possibility of publishing articles online as they are received – readers can be kept informed of updates by subscribing to a specific rss feed improved visibility of articles (e.g. the articles discussing recently awarded papers, etc.) The Online Committee recommends the porting of the next newsletter online as an experiment. This could be achieved with coordination between the newsletter and the online editor.

Following the suggestion of the BoG, the Online Committee has also investigated the possibility of introducing online Discussion

Page 11: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

11

September 2013 IEEE Information Theory Society Newsletter

papers. A feature for posting comments is already available in the website infrastructure and an example of discussion has been set-up online. As suggested by Nick Laneman, a possibility would be to have students post review papers or summaries from seminars. The Online Committee suggests that we identify student volun-teers to test the current setup.

A discussion followed on online discussion papers. It was noted that currently, only award papers and fundamental papers are available for online discussion. It was suggested that something similar to the Communications Society Digest can be implemented, whereby a subset of papers are presented for reading and discussion.

Matthieu continued: the Online Committee has also investigated options to more actively push the table of content of the latest is-sue of the Transactions. Presently, it is already possible to subscribe to a feed on IEEEXplore: feed://ieeexplore.ieee.org/rss/TOC18.XML. Several options are then available to advertise a new issue: 1) Encourage members of the IT community to register to the feed by providing detailed instructions on the subscription process; 2) Create a “mailing list” (through feedburner) to which users can register, which would push the latest table of content to emails; 3) Pull the content of the feed from the IEEEXplore feed and dis-play it on the website; one can imagine complementing this with a news item once the latest TOC is available. Options 1 and 2 can be implemented with minimal effort and without extra development. Option 3 would require some development time (to be estimated).

ToDo: The Online Committee will submit a proposal for effec-tive and attractive dissemination of the Society newsletter and IT Transactions Table of Contents.

Finally, Matthieu presented recent analytics on website use and statistics on the Society mailing list.

7. Reports from Schools: Petar Popovski presented the report on the European School of Information Theory (ESIT) 2013 in Ohrid, Republic of Macedonia, April 22–26, 2013. Lecturers for ESIT 2013 include Suhas Diggavi, Stark Draper, Bane Vasic, Angel Lozano, Osvaldo Simeone, and Christina Fragouli. The School is located in an accessible location and expects to receive many students from the Balkans. The Society has supported the school with US$20k. The School registration deadline is Feb 15, 2013.

Sergio Verdu presented the report on the 2013 North American School of Information Theory at Purdue University, West Lafay-ette, IN, June 4–7, 2013. The School is organized by the Center for Science of Information, a National Science Foundation Science and Technology Center, and is sponsored by the IT Society. This year the school will introduce several interdisciplinary topics in the emerging field of science of information. Although the focus is on information theory, interdisciplinary topics are welcome, e.g., topics related to mathematics, physics, biology, control, network-ing, etc. Invited speakers include Scott Aaronson, Michelle Effros, Mehmet Koyuturk, P.R. Kumar and Padovani Lecturer Emina Soljanin. Registration deadline is May 15, 2013.

On behalf of Vitaly Skachek, Gerhard Kramer presented the re-port on European School of Information Theory 2014 in Estonia. The School will be held in a resort/hotel along the northern coast, around 1 hour drive from Tallinn. The School will involve about 80 students/post-docs/researchers, with 4 hours of lectures for five

days, and students talks or posters in the afternoon. The School will take place in May 2014, with registration in January–February 2014. The Institute of Computer Science, the University of Tartu, will provide administrative support. The European School of In-formation Theory 2014 asks for $20,000 from the IEEE IT Society. The funds will be used to pay invited speakers, and to cover ad-ministrative costs, rented equipment, buses, activities, etc.

Motion: Approval of funding for the European School of Informa-tion Theory 2014. The motion was passed.

There is an upcoming proposal for the 2014 North American school to take place at Toronto. It will take place at the University of Toronto campus, organized by Stark Draper, tentatively sched-uled for mid June 2014. The full proposal will be presented at the ISIT BoG meeting in Istanbul.

A discussion followed on whether there should be IT Schools in China, including Beijing and Hong Kong.

8. Joerg Kliewer Presented the Outreach Committee Report: The main activity since the last report at ISIT 2013 is an attempt to recruit more mentors for the mentoring program. Other activities for 2013 include an ITA panel discussion “How to navigate the job market,” co-organized with Student Committee, and an ISIT 2013 mentoring event. There are plans to address issues for junior faculty: tenure track, research questions, student recruitment, and proposal writ-ing. Activities for 2014 include a panel discussion at ITA and a men-toring event at ISIT 2014. Joerg noted that we may not be able to cover all activities with our current budget of $1.5k. Joerg ended by presenting an outline application form for the mentoring program.

9. Negar Kiyavash Presented the WITHITS Committee Report: Recent events include afternoon tea with Katalin Marton at ITW Lausanne. Upcoming events include informal lunch and discus-sion at ITA 2013, and luncheon and panel discussion at ISIT 2013. The WITHITS website is being overhauled, with content being moved from the EPFL to the IEEE host, and additional historical notes on women in IT, as well as videos and interviews.

10. Alon Orlitsky Presented the External Nominations Com-mittee (ENC) Report on Behalf of Prakash Narayan: The ENC, a new committee formed in February 2012, consisted of Max H. M. Costa, Muriel Medard, Alon Orlitsky, A. J. Han Vinck and Prakash Narayan (Chair) as its members for 2012.

The ENC is described by the Society bylaws as follows: “The Exter-nal Nominations Committee shall consist of the External Nomina-tions Committee Chair, the Society President and three additional members. The Chair and other members are appointed by the Nominations and Appointments Committee. Typically the mem-bers of the Committee will serve for two years, with staggered terms. The Committee will be responsible for the solicitation, pro-cessing and submission on behalf of the Society of nominations for appropriate IEEE awards (such as, for example, the IEEE W. R. G. Baker Award) and, as applicable, for awards outside of the IEEE.”

The ENC submitted a successful nomination for the 2013 IEEE W. R. G. Baker Award: E. Arikan, Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Bina-ry-Input Memoryless Channels, IEEE Transactions on Information Theory, Volume: 55, Issue: 7, Year: 2009, pages: 3051–3073.

Page 12: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

12

IEEE Information Theory Society Newsletter September 2013

The ENC also submitted or coordinated nominations for the IEEE Medal of Honor and the IEEE Hamming Medal for 2013. Also, poten-tial nominees and corresponding nominators have been identified for the IEEE Founders and von Neumann Medals, as also for the Marco-ni, Kyoto and Okawa Prizes; these nominations are to be considered for submission in 2013. In addition, the ENC helped generate nomi-nations, with deadlines in early 2013, for the following: IEEE Kirch-mayer Graduate Teaching Award, IEEE Kobayashi Computers and Communications Award, IEEE Sumner Award, and the Japan Prize (in the field of Electronics, Information and Communication).

11. Michelle Effros Presented the Report of the Ad Hoc Commit-tee on Outreach and Education: The committee was formed in 2011, with members Michelle Effros (chair), Gerhard Kramer, Ubli Mitra,Vince Poor, Paul Siegel, and Lizhong Zheng. The commit-tee’s charge is to consider a range of outreach goals and activities, and to advise the BoG on possible roles for the Society. Possible outreach goals include raising financial support for the communi-ty, influencing funding agencies, and stimulating funding at other agencies. Possible outreach activities include workshops, publica-tions/presentations to general media, and actively encouraging service at the NSF (by setting up a society nominating committee). Current committee priorities include influencing funding agen-cies, gaining visibility and recognition, and connecting with other communities. As a first experiment, an IT video contest is being run by the Student Committee for the purpose of producing IT-related video aimed at a broad audience.

In a discussion which followed, it was suggested that the Soci-ety lobby the U.S. Postal Service for a commemorative stamp for Shannon’s centenary.

12. Elza Erkip Presented the Student Committee Report on Be-half of Sriram Vishwanath: Elza is the outgoing coordinator (huge thanks). Student coordinators include Galen Reeves, Mustafa El-Halabi, and Alex Dytso. Recent activities include organized Pic-tionary at Allerton 2012. The committee (jointly with the Outreach committee) will sponsor a jobs/mentorship panel for students and postdocs at ITA 2013. Panelists will include Giuseppe Caire, Elza Erkip, Dongning Guo, Bobak Nazer, and John Smee (Qualcomm).

The Committee proposes an IT video contest. Applicants would post short (<10 min) videos on Youtube. The theme of the video is to introduce basic information theory concepts (ex: how your phone works, basic coding concepts). A website, which will con-tain good video examples, will be used to advertise the contest. The contest is timed to conclude during ISIT 2013, with the an-nouncement made on Monday (lunch). Judging criteria will be rating on Youtube. Prizes will include Shannon’s collected works, and will be handed out on Thursday (lunch). The committee re-quests a budget of $500 for the awards.

In a discussion that followed, it was suggested that the video con-test be turned into an initiative, and that the prize amounts be increased.

13. Michelle Effros Presented the Report of the Ad Hoc Commit-tee on the Role of the Membership and Chapters Committee: The committee was formed at ISIT 2012, with members Michelle Effros (chair), Abbas El Gamal, Elza Erkip, Michael Gastpar, Negar Ki-yavash, Joerg Kliewer, Sriram Vishwanath, and Lizhong Zheng. The committee’s charge is to advise the BoG on a proposal to combine

the Membership & Chapters Committee (MCC) with Student and Outreach Committees, as well as to define the charge of the new Membership Committee to reflect the activity of the combined com-mittee. The current bylaws on the Membership & Chapters Com-mittee and the Student Committee were presented. The proposed updated bylaws on the Membership Committee, with the two standing Student and Outreach sub-committees, were presented.

In the discussion which followed, it was suggested that the purposes of the committee versus the subcom- mittees were not clear enough, and that the proposed bylaw language is not specific enough.

ToDo: The Constitution and Bylaws Committee will review the proposed bylaws change, and submit text to the BoG three weeks prior to the ITW 2013 Seville meeting.

14. Paul Siegel presented the report of the Ad-hoc Committee on New Awards: The committee members are Abbas El Gamal, Alex Vardy, Andrea Goldsmith, Frank Kschischang, Giuseppe Caire, Sergio Verdu, Paul Siegel, along with Gerhard Kramer, Muriel Medard, and Dave Forney.

Paul described the steps involved in the establishment of a new award, along with possible funding sources. Paul summarized the existing IT awards, and then discussed the Thomas M. Cover Dis-sertation Award. This new award was approved by the IT Society BoG in July 2012. It is to be funded by the IT Society, with an initial gift from Abbas (other gifts are welcome). The next required steps are to 1) approve the proposed IT Society Bylaw with a dollar amount and to 2) submit a completed form for TABARC/TAB ap-proval. Paul presented the language of the proposed bylaw for the Cover dissertation award, with the dollar amount of the honorari-um unspecified. Paul also presented the proposed BoG resolution.

Paul continued with the ISIT Student Paper Award. This award was established in 2010 (TAB approved), and is funded by IT Society. A name change was proposed at ITW 2012. The next required steps are to 1) approve with bylaw change and 2) notify IEEE Technical Activi-ties Operations for approval by TABARC/TAB. Paul presented the language of the proposed bylaw for the Jack Keil Wolf ISIT Student Paper Award. Paul also presented the proposed BoG resolution.

A discussion on the Cover dissertation award followed. At issue is the wording of the proposed bylaw. Some felt that the evaluation committee should consist of people who have advised many the-ses. Others felt that the workload on the Awards committee (which would be charged with choosing the winners of the award) would be too high. It was noted that there may be overlap between the best dissertation award and the best paper award. It was also noted that such overlaps routinely occur in other fields. After some discussion, Gerhard made an executive decision to postpone the vote for the approval of the Bylaws change for the Cover Dissertation Award.

ToDo: The Ad-hoc Committee on New Awards will reconsider the text of the bylaws change for the Cover Dissertation Award in co-ordination with the Constitution and Bylaws Committee.

Motion: Approval of renaming and Bylaws change for the Jack Keil Wolf ISIT Student Paper Award. Motion was passed.

Paul raised the issue of whether to endow IT society awards. An endowment ensures long-term funding (in perpetuity) and

Page 13: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

13

September 2013 IEEE Information Theory Society Newsletter

provides a framework and psychological incentive for gifts. The IEEE Foundation, which manages the endowment, requires $20k minimum corpus. The honorarium comes from interest income on the corpus. Administration fees may apply.

Finally, Paul mentioned that the TABARC form for the Padovani Lectureship should be submitted before March 2013 for TAB ap-proval.

15. Elza Erkip presented the Conference Committee report: She thanked outgoing committee members Bruce Hajek (who will stay on for one more year to ease the transition), Joao Barros, and Mar-tin Bossert. The current members are Gerhard Kramer, Abbas El Gamal, Aylin Yener, Paul Siegel, and Lars Rasmussen.

Motion: Approve new Conference Committee members Bruce Hajek (one year only), Alon Orlitsky, Rudi- ger Urbanke. Motion was passed.

Elza gave updates on ISIT 2012, MIT (successfully completed), ITW 2012, Lausanne (very positive response), ISIT 2013, Is-tanbul (987 submitted papers, all papers forwarded to TPC). Update on ITW 2013, Sevilla: the workshop will take place September 9–13, with a paper deadline of April 1. The bud-get has been submitted. Currently, the surplus is around 7%, lower than the recommended 10%. This is partly due to ple-nary speaker expenses and honorarium. Organizers will look for other funds.

Motion: Approval of ITW 2013 budget. Motion was passed.

Giuseppe Caire presented the proposal for ITW 2015 in Jeju Island, Korea. The workshop is to take place October 12–15, 2015. General

co-chairs are Hong-Yeop Song and Giuseppe Caire. The program co-chairs are Sae-Young Chung, Rudiger Urbanke, and Pramod Viswanath. Giuseppe presented the background on the conference location, venue, transportation, tentative program, social events, registration fees, and potential sponsors.

Motion: Approval of ITW 2015 proposal. Motion was passed.

Elza discussed plans for future ISITs (2017 and beyond). For 2017, Interested groups include Stockholm (contact: Lars Rasmussen), Aachen (contact: Rudolf Mathar), Melbourne (contact: Emanuele Viterbo), New York (contact: Aaron Wagner, Roy Yates). In terms of future ITWs, there is interest from Gurgen Khachatryan for holding an ITW in Armenia.

Finally, Elza raised technical co-sponsorship proposals for Net-Cod 2014 (ITSoc has provided technical co-sponsorship for Net-Cod since 2008), and ISITA 2014 (ITSoc has provided technical co-sponsorship for ISITA since 2008).

Motion: Approval of technical co-sponsorship for NetCod 2014 and ISITA 2014. Motion was passed.

16. Standing Items: Aylin calls for more ideas for initiatives and proposals to spend 50% of the Society surplus.

Tony Ephremides has proposed a competition of a technical na-ture, in which the winner would gain custody of the notes left by David Middleton. In the discussion that followed, it was suggest-ed that the notes should be made publicly available, perhaps after expert reviewing by an ITSoc member.

The meeting was adjourned at 5:43 PM.

GOLOMB’S PUZZLE COLUMNTM

Combinatorial CountingSolomon W. Golomb

1) When (w + 2x + 3y + 4z)4 is multiplied out, what is the coefficient of wxyz?

2) In how many ways can a set S of 8 distinct elements be partitioned into three non-empty subsets? (Each element of S must be put in one and only one of the three subsets; and which subset is which does not matter.)

3) A sequence {an} is defined recursively by a0 = 0, a1 = 1, and an+1 = 2an – an–1 for n $ 1. What is the value of a2013?

4) Balls labeled from 1 to 15 are on a billiard table. The rules of a particular game of pool require that the first

ball to go off the table can be any of these 15 balls; but thereafter, each new ball to go off the table must have a number consecu-tive (above or below by one) with a ball already off the table. (The balls labeled 1 and 15 are not considered consecutive.) In how many differ-ent sequences can all 15 balls go off the table?

5) Each of four players, A, B, C, and D, holds ten $1 chips. Each player in turn (first A, then B, etc.) must contribute at least one chip to a “kitty” which must end up with exactly $27 in chips. How many different sequences of their four “antes” are possible?

Page 14: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

14

IEEE Information Theory Society Newsletter September 2013

GOLOMB’S PUZZLE COLUMNTM

Word Puzzles SolutionsSolomon W. Golomb

A. BIT-WORDS

As a noun, BIT has several meanings, ranging from a small amount of anything to the strap in the mouth of a saddled horse. The two technical meanings, distinct but often confused, are either a binary digit, or Shannon’s unit of information. As a verb, BIT is the past tense of BITE. Words may contain the three consecutive letters B-I-T for a variety of reasons, most of which are unrelated to the meanings just listed. Here is a lengthy sample, in alphabetical order.

AMBITAMBITIONARBITERARBITRAGEARBITRARYARBITRATEBITANGENTBITCHBITEBITEMPORALBITHEISMBITT

BITTERBITTERNBITTERSBITUMENCOHABITCUBITDEBITEMBITTEREDEXHIBITFLEABITTENFROSTBITEGAMBIT

HABITHABITABLEHOBBITINDUBITABLYINHABITINHIBITITSY-BITSYITTY-BITTYOBITER DICTUMOBITUARYORBITOVERBITE

PHLEBITISPROBITYPROHIBITQUBITRABBITRAREBITSUBITOTIDBITTITBITTRILOBITEUNDERBITTENWEATHERBITTEN

Proper nouns, with BIT, include brand names (ROBITUSSIN, NESBITT’S, SORBITOL); Biblical designations (CALEBITE, MO-ABITE, TISHBITE); TOBIT, a book of the Apocrypha; and the surname BABBITT and forename TABITHA. Did you notice the “BIT-RATE” in ARBITRATE? (It’s also in barBITuRATE.)

B. HIDDEN NUMBERS

In my preferred format:

1. a. PIONEER1. b. PHONEME1. c. STONERS

2. a. NETWORK2. b. BATWOOD2. c. CUTWORM

8. a. FREIGHTER9. a. BONINESS9. b. PUNINESS

9. c. ZANINESS10. a. ANTENNA10. b. EXTENDS

Other uninterrupted:

1. d. ATONEMENT1. e. THRONES2. d. BATWOMAN2. e. CATWOMAN

8. b. WEIGHTED8. c. HEIGHTS8. d. SLEIGHT9. d. ASININE

9. e. CANINES9. f. CANNINESS10. c. CONTENDER10. d. INTENTION

11. a. TELEVENDING80. a. WEIGHTY1. - 2. BIONETWORK

With letters inserted:

0. a. CRUZEIRO3. a. THREATEN3. b. THREADED3. c. THRESHER

4. a. FOUNDER4. b. FAVOUR4. c. FERVOUR4. d. FLAVOUR

5. a. FESTIVE5. b. FICTIVE5. c. FURTIVE6. a. SPHINX

6. b. ASTERIX7. a. STEVEN30. a. THIRSTY100. a. THUNDERED

There are a great many more, notably for ONE, NINE, and TEN. Chemical terms ending in –NINE include ADENINE, ALA-NINE, GUANINE, etc, and there are also the APPENINE mountains. For SEVEN, there is also the SEVERN River. While BAT-WOMAN, CATWOMAN, and ASTERIX are cartoon characters, a BATWOMAN is also a position in the British military. The CRUZEIRO is the Brazilian unit of currency. Words 4.b., 4.c., and 4.d are the preferred British spellings. Finally, TELEVEND-ING is my proposed synonym for telemarketing. Other number words can be found in short phrases, with the consecutive letters separated only by spaces, e.g. “PAT WENT YONDER” for TWENTY.

Page 15: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

15

September 2013 IEEE Information Theory Society Newsletter

Report on the 2013 European School of Information Theory (ESIT)

Petar Popovski

The 2013 Edition of the European School of In-formation Theory (ESIT) took part from April 22–26 in Ohrid, the Republic of Macedonia. The format and the number of participants contin-ued the trend from the past two editions of ESIT in Barcelona, Spain (2011) and Antalya, Turkey (2012). The school featured lectures from very experienced information- and communication theorists, each of them well-known for her or his fundamental contributions to the field. The lec-ture topics were in the core areas of information theory, including channel coding, source coding, network coding, and wireless communication theory. There were dedicated poster sessions in which the students had the opportunity to pres-ent their work and involve in scientific interac-tion with the lecturers as well as the other senior scientist that attended the school, including the organizers and the guests. The social program of the School targeted to create more opportunities for networking among the participants, as well as a visit of World Heritage sites in the region of Ohrid.

The total number of participants at the school was 63, including lecturers, students, organizers and guests. The original plan was to have six lecturers in the regular program and Jim Massey as a distinguished lecturer, but eventually ESIT had seven (excellent!) lecturers. Jim Massey had initially kindly agreed to participate, but in the last moment he was prevented due to illness, which unfortunately turned out to be a terminating one in June 2013. The participating students were from many different countries in Europe, and there were even Ph.D. students from the USA. The School was very well attended by graduate students from the Balkan countries and their participation was supported by partial travel grants, made possible by the financial support provided by the IEEE Information Theory Society. The school had as a guest Vitaly Skachek, who is organizing ESIT 2014 in Estonia.

The school started on Monday, April 22, by a brief opening speech from Gerhard Kramer, the president of the IT Society. The morning lecture was by Suhas Diggavi in the area of approximation models for wireless network. The Monday afternoon lecture was given by Start Draper in the area of error exponents and non-asymptotic results for channel coding. The second day had one lecture in the morning, in which Bane Vasic spoke about recent advances in the area of codes on graphs and iterative decoding, and two poster sessions in the afternoon. On Wednesday there were two lectures in the morning, while the afternoon was dedicated to the excur-sion. The first lecture was by Angel Lozano, who gave a talk on the role and limitations of the assumptions and models in wireless communication theory and practice. This lecture was followed by a talk on short message network coding by Gerhard Kramer. Similar to the second day, on Thursday there was a morning lec-ture and two poster sessions in the afternoon. The Thursday lec-ture was given by Osvaldo Simeone, titled “Source coding with side information.” The school concluded with a Friday morning

Page 16: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

16

IEEE Information Theory Society Newsletter September 2013

lecture “Network Coding Theory and Applications” by Christina Fragouli.

The social program had multiple events, starting with a speaker & organizer dinner, excursion and three informal (but organized) evening events. The excursion featured samples of the cultural and natural heritage of Ohrid and the Ohrid lake, boat trip to the

10th century monastery of St. Naum and finished with a joint din-ner, where the participants could try the local food and fish.

ESIT 2013 was a success, which certainly owes to a number of people. First the team of organizers who, in addition to the under-signed, consisted of Zoran Utkovski, Liljana Gavrilovska, Venc-eslav Kafedziski and Dejan Vukobratovic. The school benefited a lot from the advisory board, consisting of Gerhard Kramer and Deniz Gunduz. The poster preparations and sessions were very efficiently handled by Valentin Rakovic and Daniel Denkovski, graduate students from the Doctoral School at the University “Sts. Cyril and Methodius.” Many thanks to all! And special thanks to Vitaly Skachek for making the photos.

ESIT 2013 has confirmed the mission to expose the students in communication engineering to the ideas, tools, and methods of in-formation theory, and thereby attract more talented researchers to work in this fundamental engineering area. Furthermore, the level of participation has removed any doubt whether this should be an (bi)annual event—it will stay as an annual event. The planning for ESIT 2014 in Estonia has already started and we are looking forward to the next successful edition of ESIT.

Page 17: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

17

September 2013 IEEE Information Theory Society Newsletter

Report on the Sixth Annual North American School of Information Theory

The sixth annual North American School of Information Theory took place June 4-7, 2013 on

the campus of Purdue University. Hosted by the Center for Science of Information (http://soihub.org), 140 total students, postdocs, faculty, and professional staff took part in the school this year. A concurrent workshop for faculty and postdocs on teaching science of information courses brought faculty from across the nation who also attended the lectures at the school. The school provides a venue where doctoral and postdoctoral students can meet to learn from distinguished professors in information theory, and form friendships and collaborations. This year the school introduced several interdisciplinary topics in the emerging field of science of information.

The school format has courses by distinguished scientists followed by student poster presentations. The five featured speakers this year were Michelle Effros (Cal-Tech) who explained “Information Theory for Large Networks”, Scott Aaronson (M.I.T.) gave an enthusiastic tutorial on “Quantum Computing and Information”, P.R. Kumar (Texas A&M) and postdoctoral scholar Jonathan Ponniah co-presented “A Clean Slate Approach to Security of Wireless Networks”, Mehmet Koyuturk, gave a survey on “Complex Diseases and Information Theory”. Emina Soljanin (Bell Labs), gave the Padovani Lecture

on “The Secret Lives of Codes: From Theory to Practice and Back”. Videos and slides of the lectures are viewable on the Science of Information Channel via http://soihub.org/summerschool, as well as on the IEEE IT Society 2013 School page http://www.itsoc.org/north-american-school-2013

Students gave fast-paced overviews of their research during the traditional “one minute madness” series of presentations that was enjoyed by all. Three poster sessions took place during the school. There was a broad scope of topics presented, and many students commented that the interdisciplinary nature of the posters presented provided much insight and helpful discussions. Many connections were made between the students and several mentioned possible future collaborations. Several students offered to lead open problem discussions in the evenings following dinner, and a

professional development session on biases and diversity in hiring was also offered to the students one evening.

Brent T. Ladd, Director of Education, Center for Science of Information

Page 18: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

18

IEEE Information Theory Society Newsletter September 2013

We had the most perfect weather we could have asked for during the week of the school, with blue skies and temperatures in the mid 70’s. Built into the schedule were lunches and dinners that allowed ample time for students to network and discuss issues in their respective fields. The social program included a sit-down roundtable dinner on the first evening of the school, with an outdoor BBQ cookout on Wednesday evening (with veggie sandwiches and frisbee games too!).

Many people helped make the 2013 school a success. Wojtek Szpankowski and Brent Ladd put the program together, Mike Atwell took care of the many web and print media duties, Kiya Smith and Erica Wilson assisted with organizing meals, lodging, lecture hall, and t-shirts, Bob Brown served as treasurer and organized key sponsorships, Barbara Gibson organized student diversity components including a session on recognizing biases in hiring. Sergio Verdu presented our school proposal and updates to the IT BoG, and the Center for Science of Information Executive Committee provided overall support. Erin Blakeslee, Mike Atwell, and Bob Brown all took great photographs - a full school album available at https://www.facebook.com/media/set/?set=a.477580742319450.1073741827.132095200201341&type=3 . Robynne McCormick assisted with financial items, and Andy Thompson tirelessly ran video equipment and edited the final lectures. Deepak Kumar and Mark Ward facilitated a workshop for faculty interested in teaching science of information courses.

A big thank you to all of the sponsors that made the 2013 school possible. In particular, IEEE Information Theory Society, Center for Science of Information, Purdue Computer Science Department, and Vice President for Research, Princeton Electrical Engineering Department, UC Berkeley Departments of Electrical Engineering & Computer Sciences, Statistics, and ERSO, Bryn Mawr College Computer Science Department, and Texas A&M Electrical & Computer Engineering.

We close this brief report with feedback and representative quotes from students and faculty. In addition to gaining experience presenting their research to their peers, students report a 3.7/4 on obtaining useful feedback to their research from talking with other students and faculty, and a 3.4/4 that they were able to start some level of professional connection with their peers for possible collaborations.

“The poster sessions were a great opportunity to see the variety of information-theoretic research that is going on. They facilitated meaningful conversations. I hope to continue discussing my research with some of these students. The one-minute madness sessions were useful, too.”

“Sharing my research and getting to see what the other students’ research was certainly valuable. It is also good to speak to someone in the same stage of career and talk about practical aspects of the PhD life, questions that you would not feel so comfortable to ask to your advisor, in general.”

“I think the summer school was a big success. I enjoyed the talks very much. The poster sessions were very interesting. I had several deep discussions with other researchers about my (and their) research which was very helpful for me.”

“The best thing about the summer school for me is getting to know students from other universities, learn about their research and share ideas with them. And even talk about future collaborations!”

“I will look forward to attending this conference again, especially if the accommodations and food are as decent as they were at Purdue. Thank you.”

“Great Summer School!! Thank you for a really well organized and enriching event!”

Page 19: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

19

September 2013 IEEE Information Theory Society Newsletter

CALL FOR PAPERSIEEE JSAC Special Issue on Full-duplex Wireless Communications and Networks

With the recent system-centric demonstrations of full-duplex wireless, where a node can send andreceive at the same time in the same frequency band, another avenue has opened up for increasingthe capacity of future wireless networks. One of the key challenges in full-duplex wireless isself-interference. Depending on device dimensions, the amount of self-interference and the extentto which it can be cancelled can vary greatly, thereby impacting the performance at different nodesin the network differently. Thus, to translate the promising preliminary results into practical networkgains, it is crucial that self-interference be adequately modeled based on the problem context.Towards that end, there is an urgent need for a concerted effort by the research community toaddress the diverse set of challenges regarding all aspects of full-duplex network design, theory,and development. The following areas are of particular interest for this special issue:

1. Modeling of hardware and propagation effects relevant to the design and analysis offull-duplex wireless systems, especially those relating to the issue of self-interference.

2. Analysis of system performance and of theoretical performance limits, includingchannel capacity, network capacity, and latency for a variety of practical full-duplex wirelesssystem topologies (e.g., SISO, MIMO, relay, multi-user, multi-hop).

3. Design of modulation schemes, channel codes, signal processing algorithms, and networkprotocols that facilitate the practical implementation of full-duplex wireless systems.Relevant network design topics include resource management, medium access control,scheduling, and cross-layer design for practical full-duplex systems.

4. Experimental evaluation of full-duplex system implementations that quantify the actualgains achievable with modern design techniques.

Submission GuidelinesAuthors should refer to the submission rules specified in the “Information for Authors” section of theJSAC guidelines (www.jsac.ucsd.edu/Guidelines/info.html) to prepare their papers. Papers shouldbe submitted through EDAS (http://www.edas.info) according to the following schedule:Tentative ScheduleManuscript Submission: October 1, 2013First Review Notification: February 1, 2014Second Review Complete/Notification Letters: April 1, 2014Final Manuscript Due: June 1, 2014Publication: 4th quarter, 2014Guest Editors

1. Prof. Ashutosh Sabharwal, Rice University, USA ([email protected])2. Prof. Philip Schniter, The Ohio State University, USA ([email protected])3. Prof. Dan Bliss, Arizona State University, USA ([email protected])4. Prof. Dongning Guo, Northwestern University, USA ([email protected])5. Prof. Risto Wichman, Aalto University, Finland ([email protected])6. Dr. Sampath Rangarajan, NEC Labs America ([email protected])

Page 20: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

20

IEEE Information Theory Society Newsletter September 2013

The Fifty-First Annual Allerton Conference on Communication, Control, and Computing will be held from Wednesday, October 2 through Friday, October 4, 2013, at Allerton House, the conference center of the University of Illinois. Allerton House is located twenty-six miles southwest of the Urbana-Champaign campus of the University in a wooded area on the Sangamon River. It is part of the fifteen-hundred acre Robert Allerton Park, a complex of natural and man-made beauty designated as a National natural landmark. Allerton Park has twenty miles of well-maintained trails and a living gallery of formal gardens, studded with sculptures collected from around the world. Papers presenting original research are solicited in the areas of communication systems, communication and computer networks, detection and estimation theory, information theory, error control coding, source coding and data compression, network algorithms, control systems, robust and nonlinear control, adaptive control, optimization, dynamic games, multi-agent systems, large-scale systems, robotics and automation, manufacturing systems, discrete event systems, multivariable control, computer vision-based control, learning theory, cyber-physical systems, security and resilience in networks, VLSI architectures for communications and signal processing, and intelligent transportation systems.

Information for authors: Regular papers suitable for presentation in twenty minutes are solicited. Regular papers will be published in full (subject to a maximum length of eight 8.5” x 11” pages, in two column format) in the Conference Proceedings. Only papers that are actually presented at the conference can be included in the proceedings, which will be available after the conference on IEEE Xplore. For reviewing purposes of papers, a title and a five to ten page extended abstract, including references and sufficient detail to permit careful reviewing, are required. Manuscripts must be submitted by Tuesday, July 9, 2013, following the instructions at the Conference website: http://www.csl.uiuc.edu/allerton/. Authors will be notified of acceptance via e-mail by August 7, 2013, at which time they will also be sent detailed instructions for the preparation of their papers for the Proceedings.

Final versions of papers to be presented at the conference will need to be submitted electronically by October 6, 2013.

s Conference Co-Chairs: Tamer Ba ar and Olgica Milenkovic Email: [email protected] URL: www.csl.illinois.edu/allerton/

University of Illinois at Urbana-Champaign

FIFTY-FIRST ANNUAL

ALLERTON CONFERENCE

ON COMMUNICATION, CONTROL, AND COMPUTING

October 2–4, 2013

Call for Papers

COORDINATED SCIENCE LABORATORY AND THE DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING

Page 21: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

21

September 2013 IEEE Information Theory Society Newsletter

ICITS 20137th International Conference on Information Theoretic Security

Singapore, November 28–30, 2013http://www.spms.ntu.edu.sg/mas/conference/icits2013/

Call for Papers

This is the seventh in a series of conferences that aims to bring together the leading researchers inthe areas of information theory, quantum information theory, and cryptology. Papers on all technicalaspects of information-theoretic security and quantum information-theoretic security are solicited forsubmission to ICITS 2013. Areas of interest include, but are not restricted to:

Unconditional securityQuantum cryptographyAuthentication codesWiretap channelsRandomness extractionCodes and cryptography

Lattices and cryptographySecret sharingMultiparty ComputationBounded storage modelOblivious transferNonlocality and nonsignaling

Quantum information theoryNetwork coding securityPhysical models & assumptionsPhysical layer security

Two types of contributed presentations will take place in ICITS 2013. The Conference Track willact as a traditional conference, consisting of original papers with published proceedings in the LectureNotes in Computer Science series. The Workshop Track will operate more like an informal workhsop,with papers that have appeared elsewhere or that consist of work in progress.

Important Dates

Conference Track submissions deadline Friday, July 5, 2013, 13.00 GMTConference Track notification Friday, August 30, 2013Proceedings version Friday, September 20, 2013

Workshop Track submissions Deadline Friday, August 2, 2013, 13.00 GMTWorkshop Track notification Thursday, September 19, 2013

Conference Organization

General Chairs Frederique Oggier (NTU, Singapore) and Miklos Santha (CQT, Singapore)Program Chair Carles Padro (NTU, Singapore)

Page 22: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

22

IEEE Information Theory Society Newsletter September 2013

Page 23: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

23

September 2013 IEEE Information Theory Society Newsletter

Page 24: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

24

IEEE Information Theory Society Newsletter September 2013

ISITA2014 — the International Symposium on Information Theory and Its Applications — will be held in Melbourne, Australia from 26 to 29 October 2014. This biennial event, first held in 1990, is a leading conference in the information theory community. ISITA2014 features world-class speakers, plenary talks and technical sessions on a diverse range of topics within the field of information theory.

Call for PapersInterested authors are invited to submit papers describing novel and previously unpublished results on topics in information theory and its applications, including, but not limited to:

• Error Control Coding• Coded Modulation• Communication Systems• Detection and Estimation• Spread Spectrum Systems• Signal Processing• Rate-Distortion Theory• Stochastic Processes• Network Coding• Shannon Theory

Paper SubmissionAuthors should submit papers according to the guidelines on the conference web site:

www.isita2014.orgThis link points to the permanent site http://www.isita.ieice.org/2014/. Submissions will be selected on the basis of a full paper, reviewed by subject-matter experts. Accepted papers will appear in the symposium proceedings. To be published in the symposium proceedings and IEEE Xplore, an author of an accepted paper must register at a non-student rate and present the paper. IEEE does not guarantee inclusion in IEEE Xplore.

Schedule

Paper submission deadline 6 April 2014

Acceptance notification 22 June 2014

Final paper submission 20 July 2014

Further information on the technical program, plenary talks, social events, and registration will be posted on the symposium web site.

The IEEE Information Theory Workshop (ITW2014) will be held from 2 to 5 November 2014 in nearby Hobart, Tasmania, Australia.

Symposium CommitteeGeneral Co-Chairs Hiroyoshi Morita U. of Electro-Communications

Emanuele Viterbo Monash University

Symposium AdvisorsAdriaan J. van Wijngaarden Bell Labs

Kin-ichiroh Tokiwa Osaka Sangyo University

Toshihisa Nishijima Hosei University

General SecretariesTadashi Wadayama Nagoya Institute of Tech.

Mitsugu Iwamoto U. of Electro-Communications

Shun Watanabe University of Tokushima

FinanceMakoto Suzuki Shonan Institute of Tech.

Robby McKilliam University of South Australia

PublicityShigeaki Kuzuoka Wakayama University

Brian M. Kurkoski JAIST

PublicationsMikihiko Nishiara Shinshu University

Yi Hong Monash University

RegistrationHidetoshi Saito Kogakuin University

Terence Chan University of South Australia

Local ArrangementTetsuya Kojima Tokyo National College of Tech.

Jamie Scott Evans Monash University

International Advisory Committee Co-Chairs

Hirosuke Yamamoto University of Tokyo

A. J. Han Vinck University of Duisburg-Essen

Ezio Biglieri Pompeu Fabra University, Barcelona

Technical ProgramCommitteeTechnical Program CommitteeCo-Chairs

Hidetoshi Yokoo Gunma University

Stephen Hanly Macquarie University

SecretaryHideki Yagi University of Electro-Communications

• Coding Theory and Practice • Data Compression and Source Coding• Data Storage• Mobile Communications• Pattern Recognition and Learning• Speech/Image Coding• Multi-Terminal Information Theory• Cryptography and Data Security• Applications of Information Theory• Quantum Information Theory

Technical Co-SponsorIEEE Information Theory Society

2 6 – 2 9 O c t o b e risita2014

SponsorResearch Society of Information Theory

and Its Applications, IEICE

MelbourneMelbourne

image by R. Michalski

6 April 2014

22 JJJJJJJ 2222222014

Page 25: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

25

September 2013 IEEE Information Theory Society Newsletter

General Co-Chairs Jamie Evans Monash University

Yi Hong Monash University

TPC Co-Chairs Urbashi Mitra

University of Southern California

Emanuele Viterbo

Monash University

Financial Chair Robby McKilliam University of South Australia

Publications Parastoo Sadeghi Australian National University

Local Arrangements JC Oliver University of Tasmania

Gottfried Lechner University of South Australia

Publicity Brian M. Kurkoski Japan Advanced Institute of

Science and Technology (JAIST)

images: ccdoh1, Jyot Boparai

• Graph-based codes and iterative decoding • Cooperation in wireless systems • Sequences and coding • Secure communication and cryptography • Compressed sensing • Coding applications: optical communications,

smart grid, underwater, etc. • Information theoretic security

IEEE Information Theory WorkshopHobart, Tasmania, Australia | 2–5 November

ITW2014

Schedule Paper submission deadline: 4 May 2014Acceptance notification: 27 July 2014Final paper submission: 1 September 2014

Plenary SpeakersPresentations by plenary speakers are planned.

The 2014 IEEE Information Theory Workshop will take place 2-5 November in Hobart, Tasmania at the Hobart Function And Conference Centre. The Australian island of Tasmania varies geographically from old-growth forests and grasslands to mountains and volcanic lakes, supporting unparalleled biodiversity, with many flora and fauna species unique to the island. Tasmania’s rugged wilderness offers ample opportunities for hiking, bushwalking, kayaking, swimming and scuba. Hobart is Australia's second-oldest city, where historic buildings and districts stretch along the Derwent River. A burgeoning art and restaurant scene are complemented by fresh local seafood and established wineries.

Call for PapersITW2014 is a forum for technical exchange among scientists and engineers working on the fundamentals of information theory. The agenda is broad and will cover the diverse topics that information theory presently impacts. There will be both invited and contributed sessions. Papers for the contributed sessions are solicited in, but not limited to, the following areas:

• Source coding • Distributed source and channel coding • Joint source and channel coding • Coding for wireless systems • Coding for sensor and ad-hoc networks • Coding and biology • MIMO and space-time coding

ISITA2014 will be held nearby in Melbourne, Australia on 26-29 October 2014

Paper SubmissionInterested authors are invited to submit previously unpublished contributions. Papers for the contributed sessions, not exceeding five pages, should be submitted according to the directions which will appear on the conference website:

itw2014.jaist.ac.jpThe ITW proceedings will be published by the IEEE and will be available on IEEE Xplore.

Page 26: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

26

IEEE Information Theory Society Newsletter September 2013

Advanced technology courses, written and peer-reviewed by experts

Earn CEU and PDH continuing education credits

Relaxed, self-paced, online

IEEE is a certifi ed continuing education provider

The premier online collection of short courses and conference workshops

The IEEE eLearning Library presents a better

way to learn for technology professionals,

students and any organization who wants its

team to strive, excel and stay competitive.

www.ieee.org/go/elearning

Find out what IEEE eLearning Librarycan do for your organization:

IEEE eLearning LibraryDelivered via the IEEE Learning Management System

Page 27: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

27

September 2013 IEEE Information Theory Society Newsletter

Y O U K N O W Y O U R S T U D E N T S N E E D I E E E I N F O R M A T I O N .

N O W T H E Y C A N H AV E I T. A N D Y O U C A N A F F O R D I T.

I E E E R E C O G N I Z E S T H E S P E C I A L N E E D S O F S M A L L E R C O L L E G E S , and wants students

to have access to the information that will put them on the path to career success. Now,

smaller colleges can subscribe to the same IEEE collections that large universities receive,

but at a lower price, based on your full-time enrollment and degree programs.

Find out more–visit www.ieee.org/learning

Page 28: IEEE Information Theory Society Newsletter · 2018-11-27 · Why Convolutional LDPC Ensembles Perform So Well over the BEC”, IEEE Transactions on Information Theory, Feb. 2011 •

IEEE Information Theory Society Newsletter September 2013

28

DATE CONFERENCE LOCATION WEB PAGE DUE DATE

September 9–13, 2013 2013 IEEE Information Theory Seville, Spain http://itw2013.tsc.uc3m.es/ Passed Workshop (ITW 2013)

October 2–4, 2013 51st Annual Allerton Conference on Monticello, http://www.csl.illinois.edu/ Passed Communication, Control, Illinois, USA allerton/ and Computing

November 3–6, 2013 Asilomar Conference on Signals, Pacific Grove, http://www.asilomarssc.org/ Passed Systems, and Computers CA, USA (ASILOMAR 2013)

November 28–30, 2013 7th International Conference on Singapore http://www.spms.ntu.edu.sg/ Passed Information Theoretic Security) mas/conference/icits2013/ (ICITS 2013

December 9–13, 2013 2013 IEEE Global Communications Atlanta, GA, USA http://www.ieee-globecom.org/ Passed Conference (GLOBECOM 2013)

December 16–17, 2013 6th International Workshop on Vilnius, Lithuania http://www.macom.ws/ September 5, 2013 Multiple Access Communications (MACOM 2013)

April 27–May 4, 2014 33nd IEEE International Conference Toronto, Canada http://www.ieee-infocom. Passed on Computer Communications org/2014/ (INFOCOM 2014)

May 18–21, 2014 2014 79th Vehicular Technology Seoul, Korea http://www.ieeevtc.org/ September 16, 2013 Conference (VTC2014-Spring) vtc2013spring/

June 10–14, 2014 IEEE International Conference on Sydney, Australia http://www.ieee-icc.org/ September 15, 2013 Communications (ICC 2014)

June 29–July 4, 2014 2014 IEEE International Symposium Honolulu, Hawaii, http://www.isit2014.org/ January 19, 2014 on Information Theory (ISIT 2014) USA

October 26–29, 2014 2014 International Symposium on Melbourne, http://www.isita.ieice.org/ April 6, 2014 Information Theory and its Australia 2014/ Applications (ISITA 2014)

Major COMSOC conferences: http://www.comsoc.org/confs/index.html

Conference Calendar