Titlebook: Novelty, Information and Surprise; Günther Palm Book 2022Latest edition Springer-Verlag GmbH Germany, part of Springer Nature 2022 informa

acheon

Novelty, Information and Surprise978-3-662-65875-8Series ISSN 1613-9011 Series E-ISSN 2197-4128

爱国者

豪华

CRANK

Günther PalmProvides definitions of useful new concepts: description, novelty, surprise, template.Discusses new viewpoints on information theory in relation to the natural sciences.Demonstrates a method of analyz

冰河期

Prerequisites from Logic and Probability TheoryThis chapter lays the probabilistic groundwork for the rest of the book. We introduce standard probability theory. We call the elements . of the .-algebra “propositions” instead of the more common “events.” We reserve the word “event” for the elements of the probability space Ω.

承认

Improbability and Novelty of DescriptionsIn this chapter, we define the information of an event . ∈ Σ, or in our terminology, the . of a .. as −log..(.). We further define the important new concept of a . and extend the definition of . from events to .. Finally, we introduce the notions of . and . and thereby the distinction between . and ., which are opposite special cases of ..

Indecisive

Conditional and Subjective Novelty and InformationThis chapter introduces some more involved versions of the concepts of novelty and information, such as subjective and conditional novelty.

决定性

Information TransmissionThis chapter introduces the concept of a transition probability and the problem of guessing the input of an information channel from its output. It gives a first idea on the classical results of Shannon, without introducing the technicalities of stationary stochastic processes and the proof of Shannon’s theorem.

IDEAS

Stationary Processes and Their Information RateThis chapter briefly introduces the necessary concepts from the theory of stochastic processes (see for example Lamperti 1977; Doob 1953) that are needed for a proper definition of information rate and channel capacity, following Shannon.