File:Multiple attention heads.png

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Original file (870 × 1,280 pixels, file size: 269 KB, MIME type: image/png)

Captions

Captions

An illustration of multiple attention heads

Summary

[edit]
Description
English: An illustration of multiple attention heads, each having its own criteria of relevance of other tokens for one of the tokens within the scope of a context window. (For the purpose of illustration, the context window consists of only one sentence.)
Date
Source Own work
Author DancingPhilosopher
This image could be re-created using vector graphics as an SVG file. This has several advantages; see Commons:Media for cleanup for more information. If an SVG form of this image is available, please upload it and afterwards replace this template with {{vector version available|new image name}}.


It is recommended to name the SVG file “Multiple attention heads.svg”—then the template Vector version available (or Vva) does not need the new image name parameter.

Licensing

[edit]
I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current13:23, 1 August 2023Thumbnail for version as of 13:23, 1 August 2023870 × 1,280 (269 KB)DancingPhilosopher (talk | contribs)omitted the (in-picture) caption
12:48, 1 August 2023Thumbnail for version as of 12:48, 1 August 2023870 × 1,280 (365 KB)DancingPhilosopher (talk | contribs)
22:35, 29 July 2023Thumbnail for version as of 22:35, 29 July 2023855 × 1,280 (510 KB)DancingPhilosopher (talk | contribs)Uploaded own work with UploadWizard

There are no pages that use this file.

File usage on other wikis

The following other wikis use this file:

Metadata