That's pretty disingenuous, since most files aren't just random data.
Most real files actually have rather low entropy, even if they look like random junk (e.g., executables), chiefly due to repetition of similar data and sparse values.
Exactly. It's merely our human preference for those types of files that allow them to work at all.
things get weird when we include "all possible states"
It's not a preference; it's simply the state of the system to which we may desire to apply compression.
That's pretty disingenuous, since most files aren't just random data.
Most real files actually have rather low entropy, even if they look like random junk (e.g., executables), chiefly due to repetition of similar data and sparse values.
Exactly. It's merely our human preference for those types of files that allow them to work at all.
things get weird when we include "all possible states"
It's not a preference; it's simply the state of the system to which we may desire to apply compression.