Processing of subcategories in FDC reporting

[JeanFred]

As a chapter, I want wm_metrics to report on all the files in subcategories of the given category to analyse, in order to get a complete report.

(This use case was submitted by the Austrian chapter, who uses subcategories and does not have a hold-all category)

[JeanFred]

Two issues here:

• one technical: recursive category exploration is expensive.
• one editorial: recursive category is indiscriminate, and may take along a lot of unwanted files

At the very least we should make it clear that fdc.py is not recursive.

[Krho]

There is category_flattening which was created for this issue but is still
very basic. Recursion within Wikimedia Commons is a complex issue and needs
some science, especially concerning loops.

Caroline

2014-08-13 0:30 GMT+02:00 Jean-Frédéric notifications@github.com:

Two issues here:

• one technical: recursive category exploration is expensive.
• one editorial: recursive category is indiscriminate, and may take
  along a lot of unwanted files

At the very least we should make it clear that fdc.py is not recursive.

—
Reply to this email directly or view it on GitHub
#11 (comment)
.

[JeanFred]

Agreed ; if we decide to support this use case I would rather try to connect to @dschwen FastCCI, not implement it ourselves.

[PierreSelim]

fdc.py is not recursive and should not be. It's a bad tracking practrice not to have categories the way I decide! :)

[JeanFred]

I agree with you @PierreSelim. I think we should

• make it clear in the documentation that wm-metrics tools are not recursive
• Offer documentation/tools/consulting service to migrate to a sane tracking practice.
• close this as WONTFIX :)

[PierreSelim]

WON'T FIX :-)

[Krho]

Hum, guys, I totally disagree with you on this and I would really have
appreciate if you at least check we me before closing this issue.

Caroline

2014-08-26 8:28 GMT+02:00 Pierre-Selim notifications@github.com:

WON'T FIX :-)

—
Reply to this email directly or view it on GitHub
#11 (comment)
.

[PierreSelim]

@Krho please subscribe to your issue and answer :)

It's reopen.

[dschwen]

I'd be happy to help (by adding all necessary APIs to FastCCI).