Commons talk:WMF support for Commons/Commons Impact Metrics

I love the subject line, some Qs about the details

My crude attempt at summarizing the parts that were confusing (please correct any mistakes!):

A) This part in the intro sounds great:

• scale metrics for all movement participants
• reduce the cost to maintain existing Commons metrics tools
• increase accessibility [for current metrics tools]

(maybe also: make explicit the cost of running/maintaining such tools, and the marginal cost of running them for a new large content partner with e.g. 100K files + records)

B) This part in the details was confusing:

• Replicate existing analytics
  • and make new analytics? and clean up/refine existing analytics?
• To reach more GLAM curators... and more non-GLAM curators
  • how is reach currently measured? Is this increase in reach in theory, or in practice? How would new tools reach more people than in-use tools?
• Define new 'WMF' metrics here, distinct from existing 'community' metrics
  • ... which then have to be aligned and jointly adopted? who is defining the new metrics, if not the community groups working with GLAM partners?
• Do not maintain, nor replace and migrate, existing Commons metrics
  • this seems in conflict with A)
• Produce documentation and guidelines, dumps and APIs
  • ... for these new metrics tools, and not for existing ones?

Cheers, --SJ+ 17:27, 21 October 2023 (UTC)

Thank you for the feedback and questions. Below, I hope to clarify a few of the confusion points you mentioned:

| Replicate existing analytics

• This refers to being able to generate similar data points and metrics currently utilized in tools (ex: # of media in category, count of media views by x dimension, etc.).

| To reach more GLAM curators and more non-GLAM curators

• There are several ways which we intend to measure this:

• We can measure this by the number of GLAMs able to access metrics for their institution via existing tools. For example, the GLAM Wiki Dashboard can currently support a limited # of GLAMs and has a waiting list. We can track the # of GLAMs added to such tools to indicate expanding reach.

• When looking at reach to non-GLAM curators, we are evaluating potential measurements. Some ways we can measure reach are via usage of various Commons stats tools and consumption of the data products (includes the potential creation of new tools) that will occur as a result of this work. We are open to other thoughts and feedback on how this can be done.

| Define new 'WMF' metrics here, distinct from existing 'community' metrics

• The goal is to understand the current metrics being produced by existing tools as well as to leverage prior user research on metrics needed by the Movement to generate an initial set of metrics that we can discuss with the community. This will provide a starting point for deeper community consultations on metrics and to identify potential areas where we need further discussion and alignment across various movement participants. We want to ideally avoid situations where we use different methodologies for a given metric, when there are potentially multiple ways to calculate it.

| Do not maintain, nor replace and migrate, existing Commons metrics tools

• The keyword here is that the WMF will not be working on "tools" but rather focusing on the data and metrics that are required to support various different and potential tools that the community owns, maintains, or would like to build. It will be the responsibility of existing tool owners or the community to modify or create tools that leverage the Commons Impact metrics data products produced as a result of this work.

| Produce documentation and guidelines, dumps and APIs

• This specifically refers to documentation for the data and metrics provided, such as data definitions, calculations used for metrics, how to access the data APIs and/or dumps, etc. Documentation for specific tools (such as for GLAMorgan (glamtools.toolforge.org)) will continue to be the responsibility of the tool owners/maintainers. DAbad (WMF) (talk) 19:50, 8 November 2023 (UTC)