-
Posts
4785 -
Joined
-
Days Won
55
Content Type
Profiles
Forums
Events
Everything posted by joigus
-
How can information (Shannon) entropy decrease ?
joigus replied to studiot's topic in Computer Science
@Ghideon and @studiot. I think I know what both of you are getting at. Thank you for very constructive comments that go in the direction of elucidating something central here. -------------- Qualification: The "canonical" entropy \( -\sum_{i}p_{i}\ln p_{i} \) is not the only way you can define an entropy. We should be clear about this from the get-go. There are other definitions of entropy that you can try, and they happen to be useful, like the Rényi entropy, and still others. But once you have decided what form of entropy it is that characterizes the level of ignorance about your system in terms of your control parameters, the calculation of the entropy based on your knowledge of the system should be independent of how you arrive at this knowledge. --------------- But the way you arrive at that information is not neutral as to the heating of the rest of the universe! I'm calling the particular questions your "control parameters." It's very interesting what you both point out. Namely: that the coding of the answers (and presumably the physical process underlying it) strongly depends on the questions that you ask. Suppose we agree on a different, much-less-than-optimal set of questions: 1) Is the coin in square 1,1? 2) Is the coin in square 1,2? and so on. If you happen to find the coin in square 1,1 at the first try, then you have managed to get the entropy of the system to 0 by just asking one binary question, and in Ghideon's parlance, your string would be just 1. The way in which you arrive at the answer is more or less efficient (dissipates less "heat" so to speak), in this case, if you happen to be lucky. But the strings Ghideon proposes, I think, are really coding for the thermodynamic process that leads you to final state S=0. Not for the entropy. Does that make sense? -
No. Not you. I am the middleman (an intermediary in this bussiness with nothing at stake here), trying to think rationally, but trying not to think in a desperate kind of mood. The rest of it is my lame attempt at playing with words: "straw", "giant". etc. I don't think my argument was a straw man, as @dimreepr has correctly interpreted.
-
I think it's more of a middleman with a giant hunger for thinking rationally without clutching at straws.
-
This list really boils down to: 1. Use physical violence à la Corleone (1-6) 2. Use physical violence à la Torquemada (7) Which in turn, and except for matters of stylistic approach, both boil down to: 0. Use physical violence. One might as well list among them the "technique" of throwing a dead-horse's head into someone's bed. Even this last one seems to me far more imaginative, if similarly brutal. The direction in which I would like to move, which I would more devoutly wish all of us to explore, is not one that lists every single part of a human body on which one can inflict pain. That's not a very useful list, to me at least. I said it before: Using physical pain in its manifold forms is not the only perspective we can adopt. It strikes me how how much harder fiction writers have speculatively explored this possibility: https://en.wikipedia.org/wiki/A_Clockwork_Orange_(novel)#Part_2:_The_Ludovico_Technique And how little effort we, people who love science, are willing to use to explore alternatives that could be more humane, more reasonable, and allegedly more efficient. Just a thought. It could be split to Speculations, if moderators deem it appropriate.
-
My best guess as to why this unfortunate event happened: Shark faced a bad season for favourite food, like, eg., sea lion. Pressed by hunger, tries getting nutrients from other source, even though it's not adecuate for shark's nutritional needs --humans have no blubber. I don't think the shark case is anywhere near the tiger case as to behavioural patterns. Just an educated guess on my part.
-
Very interesting. Thank you. And seems to be the closest to hard evidence that any of us has contributed so far from the pragmatic --non-ethical-- point of view. ------ And now for something completely different... As long as we're heavily involved in devising thought experiments... Let me set up a totally hypothetical scenario. Suppose enough research is done that we learn there is a procedural pathway to have a person spill the beans no matter what compelling motivation they have to keep it secret by exciting some part of their brain. This part of the brain is the nucleus accumbens, which is related to pleasure, positive reinforcement, and the like. Completely hypothetical, mind you. So, in this hypothetical scenario, we've found out that, instead of best results being obtained by ramping up the pain circuitry; they are obtained by ramping up the pleasure circuitry. Would you still do it? Remember, the guy is scum, and you're set up for giving him the time of his life. But you get to save poor little girl in dark, damp basement. Would you still do it? Answer yourselves, more importantly than answer here.
-
How can information (Shannon) entropy decrease ?
joigus replied to studiot's topic in Computer Science
This would be true in classical mechanics. Nevertheless, in classical mechanics you can still asign a measure to the phase space (space of possible states). So even in classical mechanics, which asigns a system infinitely many states, entropy is finite. Entropy is related to the measure of phase space: https://en.wikipedia.org/wiki/Entropy_(information_theory)#Measure_theory It is definitely not true when quantum mechanics makes an appearance. All systems are spatially finite. If they're finite, their momentum is quantized, and the basis of wave functions becomes a countable set. Also, there is no such a thing as non-informational DOF of a physical system. All DOF are on the same footing. There are two concepts of entropy; one is the fine-grained entropy, which corresponds to the volume (measure) of the phase space, and the coarse-grained entropy, which depends on how much information we have on the system. The total content of information is constant. It cannot be lost. INFORMATION = information - entropy = volume (phase space) Where by INFORMATION (in capitals) I mean the negative of fine-grained entropy; and by information (in lower-case letters) I mean the negative of coarse grained entropy. You're also confusing #(dimensions) with #(elements) = cardinal. Those are different things. -
How can information (Shannon) entropy decrease ?
joigus replied to studiot's topic in Computer Science
In the case you propose, entropy decreases in every step. 0) Initial entropy \[ 16\times\left(-\frac{1}{16}\log_{2}\frac{1}{16}\right)=\log_{2}2^{4}=4 \] 1) It's not in the first column (12 possibilities, assume equiprobable): \[ 4\times\left(-0\log_{2}0\right)+12\times\left(-\frac{1}{12}\log_{2}\frac{1}{12}\right)=\log_{2}12=\log_{2}4+\log_{2}3=2+\log_{2}3<4 \] 2) It's in the second column (4 possibilities, assume equiprobable): \[ 4\times\left(-\frac{1}{4}\log_{2}\frac{1}{4}\right)=\log_{2}4=2<2+\log_{2}3 \] 3) It's not in the first row (3 possibilities, assume equiprobable): \[ 3\times\left(-\frac{1}{3}\log_{2}\frac{1}{3}\right)=\log_{2}3<2+\log_{2}3 \] 4) It's in the second row (1 possibility, entropy is zero): \[ -1\log_{2}1=0<\log_{2}3 \] Entropy has decreased in every step, and there's nothing wrong with it. I'll think about this in more detail later. I think I see your point about the RAM circuit, and it reminds me of a question that somebody posed about Landauer's principle years ago. Very interesting! But I would have to go back to mentioned thread. One thing I can tell you for sure: You will have to increase the universe's entropy if you want to know where the coin is. There's no way around it: You have to look at the coins; for that you need light, and in focusing your light you will have to set some machinery in motion that will disturb the environment more than you order your system. So Shannon and Boltzmann are joined at the hip. -
How can information (Shannon) entropy decrease ?
joigus replied to studiot's topic in Computer Science
As I understand, Shannon entropy --apart from the trivial difference of being defined in base two, which makes it ln2-proportional to "physical entropy" \( -\sum_{i}p_{i}\ln p_{i} \), so that both are proportional-- is always referred to a part of the universe. A computer is always a part of the universe, so there is no problem for entropy to decrease in it. That's what Landauer's principle is telling us: When I erase a bit from a computer, I insist the certain circuit is in state 0. That makes the particular state of the circuit predictable. Its state is 0 with probability one, and thus I heat up the universe, because the entropy in my computer goes down. The entropy of a computer, whether classical (binary) or quantum (based on q-bits), or a set of N coins, or whatever other example for Shannon's entropy to be relevant, is but a part of the universe, so its entropy doesn't have to increase necessarily. I hope that's a satisfactory answer, if I understood you correctly, of course. -
Knock yourself out: https://www.scienceforums.net/search/?&q="free will"&search_and_or=or&search_in=titles&sortby=relevancy
-
I'm not an expert on this, but... I always try to formulate a rational explanation. When we are under stress, or the sensorial signals are somewhat scrambled, or both, we tend to try and make sense of what's going on. There's an ongoing dialogue between the different parts of our limbic system. In that dialogue the signals are processed in such a way that the salient information from the relational cortex --I'm kinda assuming here-- tends to be forced to fit in a dictionary of familiar words and concepts. Pareidolia may be the word?
-
Landau-Lifshitz. Theory of Elasticity. Chapter 1, page 1. (My emphasis.) When solids are subject to strains and stresses, and shear tensions, they tend to recover their original configuration in a directional way. This justifies the introduction of directional vector fields that implement this behaviour. When fluids are subject to forces, they tend to recover their original configuration in a non-directional way. This, IMO, is what's led to the separation into two different disciplines. Fluids are also characterised by velocity fields (particles making up a fluid move about quite freely; while in a solid, that's not the case: there's no convection, etc.). Of course, nothing ever's quite that simple, is it? So @studiot's caveat is probably very relevant. There are strange things that fall outside these classical (19th-century) categories, like liquid crystals, which are both fluid and non-isotropic, but that's another matter.
-
Gravitational Potential Energy in a 2 dimensional Universe
joigus replied to Vashta Nerada's topic in Classical Physics
I missed that nuance. Thanks!! -
Gravitational Potential Energy in a 2 dimensional Universe
joigus replied to Vashta Nerada's topic in Classical Physics
I couldn't agree more. While the GR discussion, as well as alternatives/generalisations/toy-models is very interesting, perhaps @Vashta Nerada is interested in another level of discussion. Markus did say "deduce," but of course we all understand what he meant. I've crossed paths with him at least once in relation to this precise matter. And it hasn't scaped my attention that his signature displays Stokes' theorem in its most general differential-form form. -
Neuroscience Teaching tools/learning materials
joigus replied to AJS's topic in Anatomy, Physiology and Neuroscience
Whirlwind tour of evolutionary, genetic, behavioural, developmental/environmental bases of behaviour (25 lectures): Enjoy! -
Gravitational Potential Energy in a 2 dimensional Universe
joigus replied to Vashta Nerada's topic in Classical Physics
You just touched my soft spot. It is an interesting possibility, that I've tackled before in the way of a suggestion: That it's just possible that both time and space are multidimensional, but we (and other physical systems) may just be constrained to perceive it as 1+3-dimensional or, IOW, 1+a bundle of the rest, that we perceive as spatial+internal. It's just a speculation, of course, but a speculation that I think can be argued in favour of within the limits of mainstream, widely-accepted science. I'm not sure if anybody has proposed anything like this. My intuition is that somebody must have, because almost any idea you can conceive of has previously been considered by someone. -
Yeah. A nice guy who now and then decides to give some people this nicest of treatments: https://rarediseases.org/rare-diseases/fatal-familial-insomnia/#:~:text=Fatal familial insomnia (FFI) is,significant physical and mental deterioration. Just because... Ooops, he wanted to play with the order of their nucleotides. This is one of the most horrible deaths you can think of. Nice going, God.
-
Zero is a number, and the big bang proves it.
joigus replied to Adelbert_Einstein's topic in Mathematics
Yeah, there were cyclic-universe models that AFAIK are not very much favoured by cosmologists today. It seems that cosmologies based on inflation (a period previous to the big-bang when extraordinary rates of expansion took place) are the preferred mechanism. That's because they have a considerable explanatory power of the present state of the universe (seeding for galaxy formation, large-scale homogeneity.) This mechanism can be easily accomodated into the dynamics of the vacuum in quantum field theory. You have to have the vacuum "sit" in some kind of scalar background (the inflaton field.) The unfortunate aspect of it is that you must make all kinds of arbitrary assumptions about this scalar (pure-number valued, not changing under rotations) field. -
Gravitational Potential Energy in a 2 dimensional Universe
joigus replied to Vashta Nerada's topic in Classical Physics
Agreed. If we adopt the basic assumption that the equation for the gravitational potential be the topologically simplest assumption (no field lines start out from the vacuum), then Laplace's equation is the rotationally-invariant version of this assumption. From the initial assumption, gravitation can be deduced now. If we go to GR, as you said, it's a different matter. I do remember that the binding of a small particle coupled to a strong spherically-symmetric gravitational field has higher-order inverse powers of the distance than 1/r2. -
Zero is a number, and the big bang proves it.
joigus replied to Adelbert_Einstein's topic in Mathematics
I don't know of any cosmological model being considered that started with a "big shrink." I don't know what "absolute zero" in mathematics means. As opposed to "relative zero"? If anything, quantum mechanics suggests that the energy of no physical system can be exactly zero. I don't know what a "virtual number" is. I don't know what the "polar opposite" of a number is. The inverse of a number is what it suggests to me. The inverse of zero is not infinity. Infinity is not a number. Zero has no inverse. I don't know what the "polar opposite" of the real character of a number could mean. -
Beautiful flowers frequently sprout from an excrement or a piece of rotting flesh. I suppose that's what's happened here.
-
Gravitational Potential Energy in a 2 dimensional Universe
joigus replied to Vashta Nerada's topic in Classical Physics
Indeed. 1+2 gravity has no local degrees of freedom. Yet people still use it as a topological theory. https://en.wikipedia.org/wiki/(2%2B1)-dimensional_topological_gravity Just a disclaimer: I wasn't thinking of GR when I asked my questions, even though we know it to be the right framework. I was thinking under the premise "if Newton's gravity were correct..." And I stand by what I said. Namely: we can't deduce any of that. We can't deduce Laplace's equation either. We can guess at it from symmetry properties. Also, I think it would be interesting, like @studiot was trying to do, to find out at what level the OP wishes the question to be answered. Maybe they're not familiar with GR. -
OK. We're reaching a stalemate here. I want to be convinced that torture would be effective so much as to grant consideration to use it as a last resort. I intuit that @dimreepr & @Peterkin agree with this particular point. You want to be convinced that torture would fail 100% of the time, as to grant consideration to use it as a last resort. If I understood them correctly, @beecee & @zapatos would abide by the latter. We've narrowed it down, it seems, to some kind of interesting but difficult burden-of-proof argument. This has to be done in such a way that this kind of evidence is obtained without experiments being performed to ascertain the matter. Ethical considerations on which we all agree being the reason. Your turn.
-
And now for something completely different... Another great: Tommy Emmanuel. His version of Merle Travis: And his version of another classic: