A compendium to information theory in economics and econometrics
系统梳理了信息论的概念、度量和技术,展示了其在经济学、金融、统计推断等多个领域的解释力和应用价值,适合希望了解信息论在经济学中应用的学者。
An extensive synthesis is provided of the concepts, measures and techniques of Information Theory (IT). After an axiomatic description of the basic definitions of “information functions”, “entropy” or uncertainty and the maximum entropy principle, the paper demonstrates the power of IT as both an interpretive and techinically productive tool. It is argued that this power and universality is promarily due to the common need for (i) measures of distance and discrimination and, (ii) appropriate partitioning- aggregation properties. IT offers a very suggestive unification for a bewildering and arbitrary set of approaches that have evolved in different disciplines. Applications are discussed or indicated. These applications have relevance to economics, finance, industrial organization, marketing, statistical ingerence and model selection, political science and communication. A main focus of the discussion is the generative power of IT measures in statistical examinations of unknown distributions and random phe...