Art

Information Theory part 3: What is coding theory?



A short story about the need for digital communication and how it leads to coding theory (variable length source coding) with a lossless compression problem. Source encoding attempts to compress the data from a source in order to transmit it more efficiently.

Art of the Problem

Source

Similar Posts

46 thoughts on “Information Theory part 3: What is coding theory?
  1. I have a couple thoughts on this. First, Bob's idea is probably that they should use the absence of a signal (silence) to communicate, in addition to using the signal, or that they should use short *and* long signals to mean different things; moving their communication from base 1 to base 2. But what if some information is lost, and a signal (or a string of signals) are never sent completely? The receiver will misinterpret the message. But in practice how can this be prevented?

  2. Since the pluck travels as a wave, he might pluck the string at some other angle. This way, there is no longer any need for ties, vertical plucks could be >7 and horizontal plucks could be <7.

  3. If they can implement some sort of fret system along the wire they could assign different frequencies to different outcomes reducing it to one pluck per outcome.

  4. The new idea is binary.
    They encode the original numbers according to their frequency but they do it in binary.
    1=10
    2=01
    3=11
    4=001
    5=101
    6=011
    7=111
    8=0001
    9=1001
    10=0101
    11=1101
    it will be faster on average.

  5. Get a cellphone?
    The obvious answer is Morse code, but it is still limited by the Nyquist rate (any faster, the signals overlap)
    They should synchronize when to accept signal and when to discard it
    In another word, they should put a filter that automatically stops the vibration after certain time.
    Since the speed of wave is related to wire thickness, the machine can time when to stop vibration. This way, they can squeeze more signal in a given time, but discard the rest (or residue vibration).

  6. In a perfect system, that is possible. But the noise is going to disrupt the signal. Unless they use a filter to isolate the signal, this is hard.
    You idea is like talking Bob and Alice talking to one another (voice = frequency)

  7. use a binary code (not morse one) that is optimal for compress information of 12 numbers. Using the short (o) and long (-) and giving precedence to shorts for common numbers the best way is:
    o is 7 – is 6 oo is 8 o- is 5 -o is 9 oo is 4 ooo is 10 oo- is 3 o-o is 11 o– is 2 — is 12

  8. Perhaps a look up table. A 3×4 grid representing the numbers. The first series of plucks represents the row and the second a column. Maybe the table can be further arranged by the frequency of appearance of the totals of the dice.

  9. my guess: variable length encoding. to get rid of those annoying 11 pluck symbols, take a subset of the possible rolls and encode them as a sequence of two symbols: (1 pluck, n plucks). So 1 pluck followed by another number represents a symbol from the 'extended' symbol set (related: how Unicode works – some characters are 2 bytes, some are more)

  10. yep, i'm expecting different pluck lengths… brain having been primed with title of next vid.  though reading through answers, multiple cans sounds very good… or getting a wireless internet router… :))

  11. Have 5 or less pluck symbols….each representing a number that occurs as a result of subtracting 2 numbers between 2 and 12. (Not sure how many pluck codes there would be in actuality because I didnt do the math for the possible outcomes).

  12. sideways plucks might represent a certain number of plucks, then add regular plucks as needed (this assumes you could detect direction on opposite end). Or maybe start tapping on the line rather than plucking it…

  13. the time between the plucks maybe? If you can do 2 plucks each second the silance between the plucks can also hold info. So you can get rid of the time in between the plucks.

  14. but yeah now that I read the coments a diffrent pitch makes great sence! Adjust the lenght, diffrent pitch,12 notes! and even further the relation between the notes can also be info, math is everywhere this is brilliant!

  15. I think if pulling the string can be done in two ways then it means there are two symbols(consider them as 1 and 0) so we have 12 outcomes so we need atleast 4 bits to represent this, 12 can be represented as 0 and the least occuring one as a combinations of 4 bits of 1's and 0's

  16. Instead of one wire to transmit information, they should use two wires to transmit information, one wire for each dice, therefore they could send the result for each dice both at the same time thus cutting the time to send information.

  17. The new Idea is to use a plug and another distinguishable movement of the wire. That means to use two "symbols" instead of just one. Am I right?

  18. Well shit. I went looking into cybernetics and systems theory a bit ago, and information theory is everywhere in there. If only I'd found these sooner…

Comments are closed.

WP2Social Auto Publish Powered By : XYZScripts.com