File:Shannon entropy coins and base 2.svg

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Original file (SVG file, nominally 367 × 327 pixels, file size: 80 KB)

Captions

Captions

Demonstrating Shannon entropy with 2 coins and 3 coins.

Summary

[edit]
Description
English: A bird with 3 coins can send 8 messages, while the rat with one coin less can only send half as many. Using coins to count messages is equivalent to counting in base 2 (starting at zero in this figure.) Instead of using 2 coins, the rat has the option of flipping a single 4-sided die. This informal peek at entropy can be modified to account for surprisal by adding the assumption the not all coins are "fair".
Date
Source Own work
Author Guy vandegrift. Derivative of file:Bird_-_Oiseau_-_Vogel.svg, and file:Canusium_1.svg.

Licensing

[edit]
I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current12:20, 7 August 2021Thumbnail for version as of 12:20, 7 August 2021367 × 327 (80 KB)Guy vandegrift (talk | contribs)coins were out of order
18:01, 6 August 2021Thumbnail for version as of 18:01, 6 August 2021367 × 327 (81 KB)Guy vandegrift (talk | contribs)ce
17:23, 31 July 2021Thumbnail for version as of 17:23, 31 July 2021392 × 331 (80 KB)Guy vandegrift (talk | contribs)Uploaded own work with UploadWizard

You cannot overwrite this file.

There are no pages that use this file.

File usage on other wikis

The following other wikis use this file:

Metadata

This file contains additional information such as Exif metadata which may have been added by the digital camera, scanner, or software program used to create or digitize it. If the file has been modified from its original state, some details such as the timestamp may not fully reflect those of the original file. The timestamp is only as accurate as the clock in the camera, and it may be completely wrong.

Retrieved from "https://commons.wikimedia.org/w/index.php?title=File:Shannon_entropy_coins_and_base_2.svg&oldid=872883623"