| 来源类型 | Article |
| 规范类型 | 其他 |
| DOI | 10.1103/PhysRevE.96.032124 |
| Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle. | |
| Thurner S; Corominas-Murtra B; Hanel R | |
| 发表日期 | 2017 |
| 出处 | Physical Review E 96 (3) |
| 出版年 | 2017 |
| 语种 | 英语 |
| 摘要 | There are at least three distinct ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a means for statistical inference on multinomial processes (Jaynes maximum entropy principle). Even though these notions represent fundamentally different concepts, the functional form of the entropy for thermodynamic systems in equilibrium, for ergodic sources in information theory, and for independent sampling processes in statistical systems, is degenerate, H(p)=−∑ipilogpi. For many complex systems, which are typically history-dependent, nonergodic, and nonmultinomial, this is no longer the case. Here we show that for such processes, the three entropy concepts lead to different functional forms of entropy, which we will refer to as SEXT for extensive entropy, SIT for the source information rate in information theory, and SMEP for the entropy functional that appears in the so-called maximum entropy principle, which characterizes the most likely observable distribution functions of a system. We explicitly compute these three entropy functionals for three concrete examples: for Pólya urn processes, which are simple self-reinforcing processes, for sample-space-reducing (SSR) processes, which are simple history dependent processes that are associated with power-law statistics, and finally for multinomial mixture processes. |
| 主题 | Advanced Systems Analysis (ASA) |
| 关键词 | Irreversible processes Nonequilibrium & irreversible thermodynamics Nonequilibrium statistical mechanics Random walks Self-organized criticality |
| URL | http://pure.iiasa.ac.at/id/eprint/14863/ |
| 来源智库 | International Institute for Applied Systems Analysis (Austria) |
| 引用统计 | |
| 资源类型 | 智库出版物 |
| 条目标识符 | http://119.78.100.153/handle/2XGU8XDN/131144 |
| 推荐引用方式 GB/T 7714 | Thurner S,Corominas-Murtra B,Hanel R. Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle.. 2017. |
| 条目包含的文件 | 条目无相关文件。 | |||||
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。
