Help talk:FastCCI

Latest comment: 2 months ago by Prototyperspective in topic Shutdown?
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 20 days.
Technical background: “FastCCI - Taming the Commons Category Tree.” Dschwen, Wikimania 2014
Technical background: Talk: “FastCCI - Taming the Commons Category Tree.” Dschwen, Wikimania 2014

Interaction with Gadget-CategoryAboveAll

edit

The gadget interacts weirdly with MediaWiki:Gadget-CategoryAboveAll.js: the FastCCI QI boxes get added before the category bar. Not sure if this should be fixed here or over there :)

Jean-Fred (talk) 17:12, 7 January 2014 (UTC)Reply

Thanks for the bug report Jean-Fred. I'm not happy with the button box of this gadget yet. I think I'll want the buttons to go horizontally next to the category title. I'm currently focussing on backend work. I'll get back to the frontend stuff when I have important functionality completed there. --Dschwen (talk) 17:54, 7 January 2014 (UTC)Reply
Thanks for the answer Daniel. Sure, I totally understand you rather focus on the backend code :-)But I notice that the problem was solved already − thanks! Jean-Fred (talk) 00:02, 8 January 2014 (UTC)Reply

Question, bug and suggestion

edit

Anyway, great work, thanks! -mattbuck (Talk) 22:50, 12 January 2014 (UTC)Reply

  • Hi Mattbuck, I had the buttons in the bodytext initially, but they were causing conflicts with a variety of other gadgets and templates on the cat pages :-(. I'm still looking for a better solution. I think I can make the text non-selectable, which should solve your issue. However I'm on a weak hotel connection right now. --Dschwen (talk) 23:50, 12 January 2014 (UTC)Reply
  • The strength-of-match slider determines the depth in the category subtree images are taken from . Your example category does not have any subcats, so the slider does not do anything. Try it in Category:Green_in_nature for example. --Dschwen (talk) 23:55, 12 January 2014 (UTC)Reply
  • Hmm, it is possible that results from the level 7 subcats are not shown. I'm pulling 200 results now. I'll add a more... link to fetch the next 200 and so on. If you feel adventurous, use the element inspector in Chrome for example and look at the css classes on the result images. They will tell you the level. The result level value is the sum of the depths of the images in the two categories. I'm actually not sure if the count starts at 0 or 1... --Dschwen (talk) 00:25, 14 January 2014 (UTC)Reply
  • Another thought regarding the slider: I agree that the current strong/weak labeling is fuzzy. But it is deliberately so, because the meaning associated with depth in our complicated category tree is rather fuzzy as well. There is no good rule as to which separation distance in the category tree corresponds to which strength of a relation. That is why the concept of a fuzzy slider that you just pull to change the results in real time seemed attractive to me. --Dschwen (talk) 00:28, 14 January 2014 (UTC)Reply

A good test

edit

This is a good pilot project how to enable three different things:

  • optional filtering of the content of categories (see Bug 59108)
  • direct display of the content of subcategories (see Bug 43424)
  • changing and setting of the format how categories display their content (display size, suppressed filenames etc.)

All three features should be enabled for substantially broader use than only for valued images. --ŠJů (talk) 14:30, 14 January 2014 (UTC)Reply

Its not only VI but also FP and QI, but I get your point. Your first bugreport is quite a tall order! The fastcci system can and will deliver arbitrary category intersections. I am currently working on the userinterface for this! --Dschwen (talk) 16:49, 14 January 2014 (UTC)Reply
Thanks for a remark. It is too profligate to occupy the headline of all categories with 3 links to 3 various types of valued images with three different names. A tool which enables to display the best files is useful, but it's not so necessary to present a competition of three different processes of evaluation of the best images so obtrusively (the links can look as a bit snobbish from the view of the whole scope of the project: most of categories contain none such labelled image). One link can be sufficient for the future. The first linked bugreport is not so exaggerated. But it call rather for a systematic and universal solution instead of accidental and unbalanced implementation for particular and very limited purposes. I'm awaiting a more universal tool eagerly! --ŠJů (talk) 18:15, 14 January 2014 (UTC)Reply
Wow... ok... sure. --Dschwen (talk) 18:46, 14 January 2014 (UTC)Reply
Took me a while to digest your comment.. Anyhow, I did not mean to imply that the bugreport is exeggerated or unreasonable, rather that it is a lot of work to implement. The UI of the fastcci gadget is certainly not finalized. I have already thought about a single button solution. --Dschwen (talk) 20:56, 14 January 2014 (UTC)Reply
Just remember to include non-intersections, eg Category:Cats and not Category:Dead animals. -mattbuck (Talk) 22:39, 14 January 2014 (UTC)Reply
Yeah, the server code for this exists (but needs a bit more testing). --Dschwen (talk) 22:48, 14 January 2014 (UTC)Reply

Buttons don't look like buttons

edit

Hi,

The three buttons don't look like buttons to me. Firstly, they don't have a pointer cursor when hovered nor a tabindex. Though they are made with an <a> tag, that doesn't provide a pointer cursor nor does it add the element to the tabindex list (that only happens if there is an "href" attribute present, at which point the click handler needs to prevent the default action to avoid anchor jumping). Right now it might as well be a <span>. Secondly, they use styling unlike any button anywhere else (they don't look like native form buttons, not like jQuery UI buttons, not like MediaWiki UI buttons, ...).

In part due to them not looking or behaving like buttons, my first thought when I saw them (not knowing anything about this gadget, as most users would) I thought they were assessment badges (e.g. indicating that this category has been nominated or classified as being Values, Quality and Featured, which seemed most unlikely, hence I started digging looking for a bug, but finding it is by design). –Krinkletalk 23:18, 15 January 2014 (UTC)Reply

The cursor changes for me. -mattbuck (Talk) 00:04, 16 January 2014 (UTC)Reply
@Krinkle: Hm, they have a pointer cursor for me (latest Chrome and Firefox). But point taken. They need to look more buttony. I'll change the UI in any case to include more powerful category operations in a popup menu. --Dschwen (talk) 00:05, 16 January 2014 (UTC)Reply
@Dschwen: Note that I fixed the cursor thingy in Revision #114050936 (edited one minute after I posted this, about 30 minutes before the both of you replied). Depending on whether you observed it before that as well, you might've just seen the new behaviour. Either way, good now. –Krinkletalk 00:32, 16 January 2014 (UTC)Reply
Yeah, got it, but I'm sure it was a pointer before, at least in chrome. That was the reason I switched early on from span to a. --Dschwen (talk) 00:33, 16 January 2014 (UTC)Reply
Well, I'm using Chrome and it definitely wasn't showing a pointer for me when hovering. It only does that when the element has an "href" attribute (and to my knowledge always has..). Could be a bug in the platform logic (e.g. Windows/Mac difference, though one would assume this is in the platform-neutral shared code of Chromium). –Krinkletalk 00:54, 16 January 2014 (UTC)Reply

Current usage

edit

The backend currently gets about 6200 requests per day. I estimate that it could easily handle 30000-60000 per worker node. And I have a few more optimizations in mind. --Dschwen (talk) 19:24, 17 January 2014 (UTC)Reply

i18n

edit

Since this is now activated by default for everyone it would be nice if the UI messages could be translatable. If translatewiki is an issue at this stage of development then maybe just a page in the MediaWiki namespace on Commons? /André Costa (WMSE) (talk) 12:33, 23 January 2014 (UTC)Reply

And since this wasn't obvious from my initial comment... I really like this feature! Didn't know I was missing it until I spotted it =) /André Costa (WMSE) (talk) 12:34, 23 January 2014 (UTC)Reply
hi Andre. I agree about i18n. Do you have a pointer for me how to best do it? How can I get this to work efficiently with resource loader? --Dschwen (talk) 17:34, 23 January 2014 (UTC)Reply

Add button for unfiltered content

edit

It is an interesting tool but I'm not sure it's adequate to display such big buttons at every category page. Modestly estimating, only less than 1 percent of all categories contain some image of the three filtered groups of selected images. This tool is useful for the biggest top categories only, or for categories of several most interesant objects or items, not for majority of subjects and categories of Commons. Maybe, a button enabling to hide or minimalize the buttons (as a personal setting) would be useful.

However, a small improvement can made this tool useful for all categories which have at least one subcategory. The 4th button (or rather the first button) should be added which would display unfiltered all images from several/all levels of subcategories. Such button can compensate disadvantages of detailed category tree. I think, it is a realistic request which can be satisfied promptly, isn't it?

Prospectively also a customization button which would enable to choose other filters instead of the three current ones. I think, some other filters would be technically very similar to the three used now. E.g., "PD images", "images from my user gallery" or "files with coordinates". --ŠJů (talk) 15:04, 27 January 2014 (UTC)Reply

Hello ŠJů. That button could be implemented immediately (the backend supports it). But rather than adding a 4th button I would like to redesign the interface and make it more compact. Then I will also add arbitrary intersections. --Dschwen (talk) 15:35, 27 January 2014 (UTC)Reply

UI redesign

edit

I just switched over to a new user interface for the FastCCI gadget with a simplified one button solution. I figured that people who are not intimately familiar with Wikimedia Commons may not know the what our assessment projects mean. So instead of having three buttons (for "Featured pictures", "Quality images", and "Valued images") I have now one button which returns all of the above (with FPs listed first and so on).

In the results a little badge is shown for FP/QI/VI images (currently only the highest merit is displayed).

Next to the new "Easy button" is a button to open the advanced menu which includes the old way of listing FP/QI/VI separately, listing all images in a category subtree, and (coming soon) arbitrary intersections and 'not' operations.

This comes with changes on the server side, where i simplified the code a lot. --Dschwen (talk) 02:57, 4 February 2014 (UTC)Reply

Current Wikimedia bugs affecting this gadget

edit

There are two open Wikimedia bugs (I know of) that affect the operation of this gadget:

  • bugzilla:52630 Fix certificate chain issue for tools.wmflabs.org - Causing the SSL certificate of WMFLabs not to be trusted on Android devices (the gadget will habg with a Connecting... message)
  • bugzilla:60810 Thumbnails fail to generate (304 Not Modified - Error) - Responsible for some of the result thumbnails not showing up.

Cheers --Dschwen (talk) 13:55, 4 February 2014 (UTC)Reply

Some improvement proposals

edit

Hi. Thank You very much for the recent enhancement. I have some ideas what can be improved more.

  • To add a number (count) of selected (displayed) images. If the number is limited, add also the information that not all images are displayed (e.g. "200 from 1437 images displayed").
  • To add a help to the term "strong/weak match" (it's not just clear) and specify its values - a depth of subcategory levels (as a numeral scale or as a balloon help?).
  • To make possible to display the selected images in standard format how images are displayed at category pages, including a possibility to select and categorize the displayed images through Cat-a-lot etc. --ŠJů (talk) 23:37, 4 February 2014 (UTC)Reply
Thanks for the suggestions I will keep them in mind. The number is a work in progress, the server does return the necessary data (but recent work broke the number estimates). And yes the total number will have to be an estimate (ie. 200 of about 1400 images shown) for technical reasons (the processing stops once the desired number of results is found. The balloon help is a good idea. The standard display should be doable and I will look into that (Cat-a-lot support is a neat idea I haven't thought of yet). I have some higher priorities first though, adding a more... link to fetch the next bunch of results is high on the list, and I want to finish the UI for arbitrary intersections (the currently disable menu entries). --Dschwen (talk) 23:43, 4 February 2014 (UTC)Reply
Server commit for result size estimates: https://github.com/Commonists/fastcci/commit/fab11d613656ca364e9bb3dea37f350b7b4d3c77 --Dschwen (talk) 00:07, 5 February 2014 (UTC)Reply

Thank You for your answers.

As I just noticed, the result is not quite complete - the latest images are not included in the result (maybe, due to a delay of indexing - several hours, or even days?). Could you add any short warning or explanation about it to the result display? --ŠJů (talk) 00:42, 7 February 2014 (UTC)Reply

I'll document this on the help page. I would like to keep the UI as clean as possible. The DB is rebuilt every 4h. Did you find any cases where the delay is significantly higher? (an additional source of delay could be tool labs database replication lag, but I think that is currently not an issue) --Dschwen (talk) 02:17, 7 February 2014 (UTC)Reply
Oh crap, the update process hasn't run for over 12h. gunzip gives a segfault. What up?! --Dschwen (talk) 02:21, 7 February 2014 (UTC)Reply
Fixed. I might have the server return the database timestamp with the results. That might be a useful thing after all. --Dschwen (talk) 03:22, 7 February 2014 (UTC)Reply
With this commit the server now reports a timestamp. I'll still have to add this to the UI. --Dschwen (talk) 17:53, 7 February 2014 (UTC)Reply

Advanced UI - Arbitrary intersections

edit

I just activated the UI for arbitrary intersections and 'not' operations. Try for example going to Category:Wyoming and doing an intersection with Bison. --Dschwen (talk) 18:28, 10 February 2014 (UTC)Reply

H*ly fuc*ing sh*t. This is all kinds of awesome Daniel. Seems to work like a charm.
Feature request: could the bread crumbs display both paths? for example, on File:Morning_Bison_(7467045148).jpg in your example it would display both « Wyoming → Geography of Wyoming → Jackson Hole → National Elk Refuge » and « Bison → Unidentified Bison ».
Thanks! Jean-Fred (talk) 19:01, 10 February 2014 (UTC)Reply
Yes, I have that in the back of my mind already. --Dschwen (talk) 19:32, 10 February 2014 (UTC)Reply

Bug (2)

edit

I keep encountering randomly this bug. Only logged in so maybe a fishy interaction with another gadget?

Here is the error message:

Error: https://bits.wikimedia.org/commons.wikimedia.org/load.php?debug=true&lang=fr&modules=ext.gadget.fastcci&only=scripts&skin=vector&version=20140301T093952Z&* at line 205: : 

(This was with ?debug=true. Not sure how I could get you more debugging data?)

Cheers, Jean-Fred (talk) 15:22, 1 March 2014 (UTC)Reply

That's it? Nothing after the colon? Hmm. This is odd, because line 205 only contains a comment :-/ --Dschwen (talk) 17:21, 1 March 2014 (UTC)Reply
Oh, no, wait. Line numbers are shifted by one by the resource loader. The offending line is
var ws = new WebSocket('wss:' + url + '?' + $.param(params));
Let me think what could go wrong here... --Dschwen (talk) 17:23, 1 March 2014 (UTC)Reply
may be helpful to know what the browser is supposed to do but couldn't find anything that would explain that odd error -- Rillke(q?) 14:17, 21 March 2014 (UTC)Reply
@Jean-Frédéric: Does this still happen. Which browser are you using? -- Rillke(q?) 14:17, 21 March 2014 (UTC)Reply
Firefox, latest under Linux Ubuntu. Not sure if it happens again, I’ll keep yu posted. Jean-Fred (talk) 10:47, 10 May 2014 (UTC)Reply

Wikimania 2014

edit

I've submitted a talk about FastCCI and Commons Categories for Wikimania 2014. I'd be happy about suggestions for improving the abstract. Anything in particular that might interest the potential audience? --Dschwen (talk) 20:14, 5 March 2014 (UTC)Reply

If I should be able to attend Wikimania, I would be particulary interested in the backend. How did you make it so fast? (I know it's open source but it would be very nice to get everything explained) -- Rillke(q?) 14:21, 21 March 2014 (UTC)Reply
Sure, the backend will be explained. But it is quite frankly embarrassingly simple. Surprising that this hasn't been done before... --Dschwen (talk) 14:30, 21 March 2014 (UTC)Reply
edit

Currently the interface doesn't indicate where the tool is documented, which can cause some frustration. How about linking to this Help page from an "About this tool ..." item in the righthand dropdown menu? --Avenue (talk) 05:57, 26 March 2014 (UTC)Reply

I've implemented that but I am not sure whether it fits in the author's philosophy and may be reverted as there is another help link after clicking the "Good images"-button. -- Rillke(q?) 09:49, 26 March 2014 (UTC)Reply
Thanks for doing that. I think the other help link doesn't show up if the tool fails to find any matches, which seems like a situation where it could be useful. --Avenue (talk) 11:25, 26 March 2014 (UTC)Reply

Half-hidden in hebrew.

edit
 
This is how it being shown to me.

The FastCCI don't works in the hebrew version of commons. I use Opera browser, Win7 OS.

Yikes, of course. I have to add some RTL fixes. Thanks to the note! --Dschwen (talk) 14:59, 22 April 2014 (UTC)Reply

Suggestions

edit

A number of suggestions:

  1. Add "Good pictures" to the drop-down
  2. Change the button to show the active search instead of always showing "Good pictures". ie Change it to Featured when the query is for FPs
  3. If the query is for only one of FP/QI/VI don't show the badges on the results - its implicit in those cases.
  4. If the query is for all or good images, don't just show the "highest". QI does not "outrank" VI after all - and VI may give better results depending on what the user is after.
  5. Allow the user to change the default query.
  6. Suppress the regular display of images in the category when the gadget is active (no need to show both the FastCCI-generated thumbs and the default ones), but retain other info (like parent cats).

I also think everything about the tool is playing up the "good pictures" utility too much, ignoring the "all pictures" as a result. All picture can be more useful in some cases (eg if there are no good ones). I'd suggest the pre-activation button is adjusted to something like "See related images" (emphasizing function). When it becomes active and displays "Good pictures", the user is more likely to realise the search can be broadened to include non-good images. If the good pictures query returns zero, a prompt saying "No good pictures found, do you want to see all pictures?" would be beneficial too. The documentation should also be adjusted to mention that it can be used for all images.--Nilfanion (talk) 01:04, 4 May 2014 (UTC)Reply

Bug on line 276

edit

Encountered that one: Error: https://bits.wikimedia.org/commons.wikimedia.org/load.php?debug=true&lang=fr&modules=ext.gadget.fastcci&only=scripts&skin=vector&version=20140510T083430Z&* at line 276: : Jean-Fred (talk) 10:49, 10 May 2014 (UTC)Reply

which is again
var ws = new WebSocket('wss:' + url + '?' + $.param(params)); -- Rillke(q?) 11:27, 10 May 2014 (UTC)Reply
Ugh, Error is not a super helpful error message :-). Does it show up consistently? (which browser?) --Dschwen (talk) 04:48, 11 May 2014 (UTC)Reply
See #Bug (2). Jean-Fred didn't change the browser, I think. -- Rillke(q?) 12:55, 11 May 2014 (UTC)Reply
I notice that Modernizer also tests window.WebSocket.CLOSING === 2. -- Rillke(q?) 12:55, 11 May 2014 (UTC)Reply

How often are 'Good pictures' updated?

edit

I have noticed that recently promoted VI, QI & FP are not included as 'good pictures' when clicking on the button in the relevant categories. Is this because the system is updated less regularly.58.106.242.26 02:45, 1 June 2014 (UTC)Reply

Thumbnail requests

edit

Hi,

When using pages like these, there are a lot of network requests to thumb.php such as https://commons.wikimedia.org/w/thumb.php?w=445&f=Flowers_on_tree_at_Greenway_-_geograph.org.uk_-_1355217.jpg. These seem relatively slow (200 OK instead of 304 Not Modified) and seem to bypass cache server-side cache as well (generates a new thumbnail). Thumbnail urls used by native interfaces from MediaWiki don't do this. FastCCI should use the imageinfo API to get the correct thumbnail urls (either in batches afterwards or without extra requests using generators), or use Special:Redirect to redirect to the proper thumbnail url (e.g. Special:Redirect/file/Example.svg?width=400 redirects to upload.wikimedia.org/.../commons/thumb/.../400px-Example.svg.png). –Krinkletalk 12:43, 23 June 2014 (UTC)Reply

I'm using the API already. I'll see if I can pull the ImageInfo data as well. Thanks for the pointer! --Dschwen (talk) 19:02, 23 June 2014 (UTC)Reply

Broken. Can not turn off or reset

edit

I do not see an "x" on the dropdown menu. No easy way to close the menu.

Once one clicks the top of the menu as an attempt to close it, some larger images show up. But I don't know what they are, because I don't remember what I clicked. Need a title at the top of the image stack.

Finally, I see no way to get rid of the image stack. Again, nothing intuitive like an "x".

So I am going to disable this gadget for me. I am not sure you should bother to tell me how to do these things, because I won't remember once I am away from this talk page.

I frequently notice that developers often do not know how to make things intuitive. --Timeshifter (talk) 18:12, 14 July 2014 (UTC)Reply

I remember jQuery using $(document).one(/* handler */) to allow people clicking anywhere to close a menu. -- Rillke(q?) 18:34, 14 July 2014 (UTC)Reply
I tried clicking everywhere. Nothing worked that I can remember. That's the problem; it changes depending on the gadget, infobox, menu, etc.. Just like only allowing icons at the top of menus, or in many other places. Another bad idea. Show/hide arrows come to mind. There should always be an option somewhere in preferences for minimal text to replace icons. Even for the "x". A tooltip for everything at the very minimum. And the option for text instead of icons. --Timeshifter (talk) 14:56, 15 July 2014 (UTC)Reply
Title at the image stack is going to happen soon. Adding an X to remove the results should be trivial. So would be the click anywhere to close the menu. I'll make sure not to notify User:Timeshifter! --Dschwen (talk) 22:23, 14 July 2014 (UTC)Reply
Thanks all for the rapid replies and everybody's work. But don't notify me about clicking anywhere to close the menu. That is not enough. Please notify me, and everybody else, about the "x" and the image stack caption at the top. :) --Timeshifter (talk) 14:56, 15 July 2014 (UTC)Reply

The Perennial Question

edit

Is there any way that FastCCI could be adapted (without a huge amount of work) to allow displayed images to be selected with Cat-a-lot, since it runs on Commons rather than externally? That would allow quick moves from an intersection into a subcategory (a long-desired feature, which to my knowledge has never been implemented - right now such moves have to be clunkily done from each of the original categories). Pi.1415926535 (talk) 14:22, 29 July 2014 (UTC)Reply

Currently there is no space -- so Cat-a-lot would have to capture the click event on the thumbnail or it would have to add a  . -- Rillke(q?) 15:08, 29 July 2014 (UTC)Reply
BTW, FastCCI as a data source for VisualFileChange would be great... -- Rillke(q?) 15:09, 29 July 2014 (UTC)Reply
Are you going to be at Wikimania? I won't havetime to do anything before London, but maybe we can sit down for a while. I don;t have much experience with VisualFileChange (or Cat-a-lot). I'm sure together we could implement this much faster. --Dschwen (talk) 14:35, 30 July 2014 (UTC)Reply
Sadly I'm not able to be there. I have very little coding experience but I'll dig around in cat-a-lot to see if I find anything interesting. Pi.1415926535 (talk) 15:14, 30 July 2014 (UTC)Reply
If you would submit a patch before London, I would review it. -- Rillke(q?) 15:55, 30 July 2014 (UTC)Reply

Wikimania presentation

edit
 
FastCCI - Taming the Commons Category Tree. Dschwen, Wikimania 2014
Talk: Now available under CC-By 3.0

Fantastic Wikimania presentation on FastCCI by User:Dschwen, recommended! There are Wikimania London videos on youtube, but they are hard to identify. Does anybody have a direct link to the FastCCI presentation video? That would be cool. --Atlasowa (talk) 15:16, 31 August 2014 (UTC)Reply

https://www.youtube.com/watch?v=0hcjZvateZs&list=UURXe4cgJPTVHcDH6ZGwOT3A#t=3172 - weiß aber nicht, ob das auf die Hilfe-Seite sollte. Besser eine Commons-Seite starten, denn es ging ja haupts. um den theoretischen Hintergrund und nicht um die Benutzung. -- Rillke(q?) 22:11, 31 August 2014 (UTC)Reply
@Dschwen: würdest Du einer Veröffentlichung des Videos unter einer freien Lizenz zustimmen? (Dann muss ich nur noch den Recording-Rechteinhaber fragen) :-/ -- Rillke(q?) 22:20, 31 August 2014 (UTC)Reply
Ja, logo. --Dschwen (talk) 23:54, 31 August 2014 (UTC)Reply
Danke! Schöne Präsentation, nette Beispiele... :-) Ich habe das youtube-video mal bei der Wikimania2014.wikimedia.org verlinkt. Ob das Video hier auf Help:FastCCI die user überfordert weiss ich nicht, vielleicht klein unter =TechnischerHintergrund= einbauen, dann hat ein technisch Interessierter zumindest die Chance das zu finden.
Dschwen, tausend dank für die Überschrift "and in Videos" bei FastCCI Suche :-) --Atlasowa (talk) 13:30, 2 September 2014 (UTC)Reply
Bitte sehr. Aber peinlicherweise wird die Ueberschrift eben ganau nicht geaendert, wenn man per link auf ein FastCCI Resultat geleitet wird. Das erfordert noch ein bisschen mehr Arbeit :-). --Dschwen (talk) 20:50, 2 September 2014 (UTC)Reply

Some bugs ...

edit

It seems that the results are based on data that is several weeks old. Images that have been uploaded or (re-)categorized more recently are not found. Is this a bug or is the database update scheduled so rarely? Sometimes I do not even get an empty result, but instead it keeps saying "Connecting...". Also, I have noticed an isolated character sequence "27d" under the results (if some were found). This might be a malformed unicode entity &x27D;, but then again who would want to write "ɽ" there?--Hagman (talk) 17:40, 4 October 2014 (UTC)Reply

Hello @Hagman: the string 27d is the age of the database. I'm updating it right now. I had to disable automatic updates due to a problem on the server. I'll try to fix this. --Dschwen (talk) 04:17, 5 October 2014 (UTC)Reply
Oh, so actually my second question was the answer to my first question? I simply failed to interprete the d as days unit. :) --Hagman (talk) 10:10, 5 October 2014 (UTC)Reply
This would explain why trying to intersect Category:Images from Wiki Loves Monuments 2014 in the United Kingdom and Category:Featured pictures gives three rather than five results. I thought 7d was some obscure hex code. Yes it would be helpful if it the data was more than 24 hours old, if it said "Warning: data is xx days old". I hope you manage to fix the auto update. Can you include a count of results at the top please. Thanks. -- Colin (talk) 16:54, 11 October 2014 (UTC)Reply

Number of files

edit

A very frequent use case is to have the count of files, not the list. Since FastCCI gets the list, it should be able to display the count on top?

Jean-Fred (talk) 16:22, 8 December 2014 (UTC)Reply

Ha, Jean-Fred. A very good question. But actually it is a bit like the Google search results, FastCCI does not know the exact number, because it does not fetch the entire list! It just fetches enough of the list to display to the user (and it has a well defined ordering to fetch the correct bit of the list). The FastCCI server reports exact counts when it happens to know them (small result sets) and approximate numbers in other cases. I could add exact counting for all results though (at a small CPU time cost). --Dschwen (talk) 17:03, 8 December 2014 (UTC)Reply

"Good pictures" button onclick event is not showing Thumnails in Firefox

edit

See Phabricator. Josve05a (talk) 12:02, 9 April 2015 (UTC)Reply

@The Photographer: (I hope I got the user right), the fact that the list of image frames is showing up tells me that the Websocket connection was successful. It would be helpful to see what the connections to fetch the thumbnails (those go to the standard commons servers) do. Is this reproducible for anyone? Could it have been a fluke? --Dschwen (talk) 17:07, 9 April 2015 (UTC)Reply

I dont know what happend, however, simply not working for me --The_Photographer (talk) 12:54, 10 April 2015 (UTC)Reply
Yeah, we need to get to the bottom of this. Are you on a fast connection? This is stupid, but sometimes the thumbs at the bottom of the page load first, so can you make sure no thumbnails are loading at all? In firefox you should have a context menu on the thumbs with an entry "Inspect element" (you may have to activate the developer tools). Could you check what the html of the thumbnail boxes is? In the Network tab of the firefox dev console you can see all http requests etc. Could you check if you get failed requests for the thumbs, and if so what the error is. And in the Console tab could you look for any error messages as well? --Dschwen (talk) 13:20, 10 April 2015 (UTC)Reply

Duplicate results

edit

FastCCI is showing the same results twice; since two or three wecks ago. I am using Windows Vista and Google Chrome. Thank you--JotaCartas (talk) 22:21, 30 April 2015 (UTC)Reply

Thanks for reporting this. It is very odd indeed. I will investigate this in the coming days. --Dschwen (talk) 03:54, 3 May 2015 (UTC)Reply
@JotaCartas: Does it also show a "Still Connecting..." bubble? It just saw that the communication goes not via Websockets anymore but uses a JS callback fallback. Of course the double results are a bug, but one that only manifests now as the Websocket transfer is brokem. I suspect a configuration change on Wikimedia Labs. Will investigate further. --Dschwen (talk) 04:00, 3 May 2015 (UTC)Reply
 
Middle of the page
@Dschwen: Yes, It shows the "Still Connecting..." bubble for a few seconds. As exemplified in the the three scans in Category:FastCCI bug, after 199 images, shows "4h", repeats three images, shows "more" and continued repeating until image #199. If I click the button "more" it shows new images and it seems to work perfectly from then on. Also, if I go to the top of the page and click again the "FastCCI" button, everything works OK, showing the images from the beginning and NOT repeating. I hope this will help you.--JotaCartas (talk) 04:47, 3 May 2015 (UTC)Reply
@Dschwen: At 00:25 2015.05.05 all working OK--JotaCartas (talk) 23:28, 4 May 2015 (UTC)Reply

19 days without being updated

edit

FastCCI database has not been updated since 19 days ago. Does anyone know when the gadget will work normally again? Thanks, --JotaCartas (talk) 00:22, 27 June 2015 (UTC)Reply

@Dschwen: Can you help me in this matter? --JotaCartas (talk) 17:00, 27 June 2015 (UTC)Reply
@JotaCartas: I'm working on it. I have problems accessing one of the labs instances and the database server. --Dschwen (talk) 04:14, 30 June 2015 (UTC)Reply
@Dschwen: Thank you very much, now everything is working perfectly. --JotaCartas (talk) 04:57, 30 June 2015 (UTC)Reply

Category intersection explanation

edit

It would be helpful if there were a way to show how a category intersection was generated. For instance, I just tried to find a flag of Bristol by intersecting Category:Bristol and Category:Flags. The results included the entire contents of Category:Hugo Weaving, and I am unsure why he is categorised under flags! Could there be some mouseover popup, eg for File:Bristol Balloon Fiesta 2009 MMB 38 G-GOGB.jpg you might have:

  • Bristol > Culture of Bristol > Bristol Balloon Fiesta > Bristol Balloon Fiesta 2009
  • Flags > Flags by contenbt > Flags with crosses > Union Flag > Union flag in art > Union Jack on vehicles > Union Jack on aircraft

-mattbuck (Talk) 12:22, 14 July 2015 (UTC)Reply

Yes, this is a good idea. It should not be too hard, as I already have the breadcrumbs code in place. --Dschwen (talk) 15:28, 15 July 2015 (UTC)Reply
@Mattbuck: I added a quick hack to show multiple breadcrumb trails on the image page. I believe Jean-Frédéric (talk · contribs) asked for that a while ago as well. --Dschwen (talk) 16:08, 15 July 2015 (UTC)Reply
I'm not seeing anything currently, perhaps this is due to running an older version of Firefox at work - I'll have a test at home later. -mattbuck (Talk) 09:01, 16 July 2015 (UTC)Reply
Works fine for me. Thanks for adding this, Dschwen, very interestig information … [1] --El Grafo (talk) 09:24, 16 July 2015 (UTC)Reply
On Category:Bristol, In this category and in ..., Flags, Ok, click a FastCCI thumbnail, on top of the file description page, the paths through category tree are listed as breadcrumb navigation trails. -- Rillke(q?) 09:27, 16 July 2015 (UTC)Reply

FastCCI and Cat-a-lot

edit

Hello, is it possible to use the tool Cat-a-lot on the results found by FastCCI? if no it would be great it's possible one day! --Christian Ferrer (talk) 09:05, 23 August 2015 (UTC)Reply

additional rankings

edit

what about adding rankings for

1. most to least "in use"

2. most viewed

?

Lx 121 (talk) 17:47, 23 August 2015 (UTC)Reply

Limit the recursion level

edit

Is there a way to limit recursion level? Sometimes I would like to intersect 2 categories with no recursion or one level of recursion. --Jarekt (talk) 15:37, 5 November 2015 (UTC)Reply

Is there a slider? For me, over mobile connection, it does weird things currently so I can't see it myself. -- Rillke(q?) 16:06, 6 November 2015 (UTC)Reply
No slider, just infinitely deep (I think) recursion, resulting in often surprising results. --Jarekt (talk) 16:11, 6 November 2015 (UTC)Reply

In this category and in...

edit

Hello, in a specific category, would there a way to have a list of all categories (not the parents categories) whose images are tagged? Regards, --Christian Ferrer (talk) 09:18, 15 November 2015 (UTC)Reply

Good Pictures Icon not working

edit

The "Good Pictures" icon on the "Category" pages does not appear to be working. My computer goes into a "Connecting" loop and waits. The same happens on my wife's laptop. I posted this question on Commons Help and User:LX saw the same problem. When I followed the drop-down list on the "Good Pictures" icon, I came to this page, so I checked the "FastCCI server status" and got a 502 Error (bad gateway).

Is this a Wikimewdia problem or my problem?

At the suggestion of User:LX, I am pinging @Dschwen: Martinvl (talk) 20:50, 16 February 2016 (UTC)Reply

Looks like the server is down. According to wikitech:Nova Resource:Fastcci, @Dschwen: is the only maintainer, besides the Wikitech/WMFLabs infrastructure maintainers. -- Rillke(q?) 23:50, 16 February 2016 (UTC)Reply
@Dschwen: maybe it would be a good idea to somehow output an error message. The following is visible in the browser's console: WebSocket connection to 'wss://fastcci.wmflabs.org/?c1=2718119&d1=15&s=200&a=fqv' failed: Error during WebSocket handshake: Unexpected response code: 502. -- Rillke(q?) 23:52, 16 February 2016 (UTC)Reply

Searching tool

edit

Hi, FastCCI allow more that to show only good images, as per as it is highlighted in this comment, I think the text "good pictures" should be changed to something like "Searching tool". Christian Ferrer (talk) 18:39, 25 November 2016 (UTC)Reply

Yes, it's still not obvious to our users what features hide behind that button. And those who are bothered by certain category trees with lots of subcategories and few images that, they believe, can only be seen after too many clicks, never find out that there's an easy way to display all images at once. Please, please finally change something to make this more user friendly. Instead of "good pictures", the button could be labeled "Search tool", "More options", in German: "Erweiterte Auswahl" --Sitacuisses (talk) 15:07, 8 April 2018 (UTC)Reply

Publicize the all images feature better

edit

I just found out about the "all images" feature at the 2016 Community Wishlist Survey/Categories/Multimedia [2] where it was it was pointed out that the feature provides a requested capability. While I appreciate the effort to make evaluated images easier to find, I think the all images feature might be even more useful to most editors. It should be easier to discover. One suggestion might be to change the label from "Good images" to " Find images", adding Good to the dropdown list, of course. Another simple improvement would be including an icon for All images. Here are two possibilities (the latter should be redrawn to be bolder): --agr (talk) 23:23, 27 November 2016 (UTC)Reply

 
 
This is a different approach to the same issue that Christian Ferrer adressed in the previous section. Still this seems to be ignored? --Sitacuisses (talk) 15:13, 8 April 2018 (UTC)Reply

Is FastCCI down?

edit

The tool hasn't been working for me for the past couple weeks... has it been down? Ed [talk] [majestic titan] 10:01, 15 January 2017 (UTC)Reply

Ping Dschwen. :-) Ed [talk] [majestic titan] 01:35, 18 January 2017 (UTC)Reply
Its working for me. Just checked now. Jee 03:44, 18 January 2017 (UTC)Reply
It's still not working for me. It gets stuck while looking through the files or, like right now, on "computing..." Ed [talk] [majestic titan] 00:00, 26 January 2017 (UTC)Reply
Got now. It stuck in big categories like Category:Computing. Showing "Digging through 37490997 files..." I don't know Dschwen is active now. Pinging Rillke too. Jee 02:51, 26 January 2017 (UTC)Reply
Thanks for the help, Jkadavoor! Ed [talk] [majestic titan] 05:44, 28 January 2017 (UTC)Reply
@Dschwen and Rillke: This tool is still getting stuck for me in medium and large categories on an occasional basis. Is there any chance of getting a fix, if there is one to be had? Thanks very much! Ed [talk] [majestic titan] 01:01, 17 March 2017 (UTC)Reply
Looking into it. --Dschwen (talk) 20:53, 17 March 2017 (UTC)Reply
Oh, yikes, it segfaults on the server. --Dschwen (talk) 20:56, 17 March 2017 (UTC)Reply
I'm trying to get some access issues sorted out. Then I'll start the server in a debugger. I should be able to fix this. --Dschwen (talk) 21:38, 17 March 2017 (UTC)Reply
This might take a while. I hope I can sort it out over the weekend. The segfault is in the websocket library. I need to debug this locally. --Dschwen (talk) 02:24, 18 March 2017 (UTC)Reply
I have disabled WebSockets support for now. It looks like that is what's broken on the server. For now the gadget should work again. I'll continue working on it in the meantime. --Dschwen (talk) 02:49, 18 March 2017 (UTC)Reply
  Done. I re-enabled websockets support. I think I fixed the crash bug (although I'm not entirely sure why it appeared in the first place)> Please let me know if any issues persist! --Dschwen (talk) 00:03, 19 March 2017 (UTC)Reply
@Dschwen: It works! Thank you so much. This is a great tool, one that I use more days than not. Ed [talk] [majestic titan] 15:39, 21 March 2017 (UTC)Reply
Hey @Dschwen: , I've been running into problems again recently with the tool getting stuck in the "Connecting..." phase—and when it does work, I'm stuck waiting in line for others. Any thoughts? Thank you again! Ed [talk] [majestic titan] 20:16, 27 July 2017 (UTC)Reply
Yeah, I'm getting emails from the uptime service that checks FastCCI. I'll work on this in the next few days. There is redundancy in teh backend, so if it doesn't work you should be able to try again. I'll make that thing smarter, so that it automatically tries the next server if one is down. --Dschwen (talk) 03:23, 28 July 2017 (UTC)Reply
@Dschwen: It looks like the tool is down again. :-( Ed [talk] [majestic titan] 15:57, 15 September 2017 (UTC)Reply
I think I spoke too soon. It's working for me right now. Ed [talk] [majestic titan] 16:48, 19 September 2017 (UTC)Reply

For the past several months I find that it has a ~25% of working at any given point. Usually, it hangs on "Connecting...". Leaving it alone to "connect" for a long period of time doesn't seem to help (i.e. either it loads quickly or doesn't load at all). Once in a while, reloading will help, I think, but usually I try it several times (usually on more than one category just to make sure that's not a factor) and give up. Size of the category doesn't seem to matter. The up/down reported in this thread makes me think that either my impression is due to the tool being regularly unavailable to all, or that other people are having the same individual issues I am... — Rhododendrites talk22:33, 28 November 2017 (UTC)Reply

Ping Dschwen? I've found ways around this over the last month or so when it times out "(Connecting..."), but it'd be really cool if there's an easy fix for this. :-) Ed [talk] [majestic titan] 14:57, 8 January 2018 (UTC)Reply

I've also been having trouble getting it to work. I usually get an endless "Connecting..." and sometimes something like "Waiting in line. 6 ahead of us." Only very rarely do I see the number of files being sorted, and most rarely does the gallery of good pictures pop up. Same issue on both Chrome and Firefox, FWIW. Just now I tried searching Category:Falconidae, it worked! and then I tried again and got "Connecting". Animalparty (talk) 07:22, 8 February 2018 (UTC)Reply

Same with me, I still can't use FastCCI, it always responde as "connecting..." and loading forever. Hope people can fix soon, this is one of Commons' great tools. --minhhuy (talk) 08:13, 22 February 2018 (UTC)Reply
down today? --Atamari (talk) 17:48, 7 April 2018 (UTC)Reply
Try to reload. There is a ticket on GitHub. I need to work on it. --Dschwen (talk) 19:10, 7 April 2018 (UTC)Reply
Yeah, it's been periodically up and down for me over the last few months as well, including today. :-( Ed [talk] [majestic titan] 15:52, 18 April 2018 (UTC)Reply
@Dschwen: Have you made any progress on this? We haven't heard from you in over a month, are you ok?   — Jeff G. ツ please ping or talk to me 07:04, 24 May 2018 (UTC)Reply
@Jeff G.: et al, maybe we should temporary disable this function in the interface until fixed? --Steinsplitter (talk) 15:25, 27 May 2018 (UTC)Reply
@Steinsplitter: That makes good sense. Is there anyone available with the expertise and access to fix it?   — Jeff G. ツ please ping or talk to me 22:25, 27 May 2018 (UTC)Reply

fastcci1.wmflabs.org/status says "502 Bad Gateway"

edit

Just wanted to mention that https://fastcci1.wmflabs.org/status returns "502 Bad Gateway"

Also, clicking "Good pictures" on a Commons category page makes "Connecting..." appear and then it stays like this, seemingly forever. Pressing F12 in Firefox reveals that wss://fastcci2.wmflabs.org/?c1=63023201&d1=15&s=200&a=fqv also ends up in a 502 error.

Thanks :-) Syced (talk) 09:44, 8 May 2018 (UTC)Reply

https://github.com/Commonists/fastcci/issues is the place to report issues with this gadget.   — Jeff G. ツ please ping or talk to me 17:10, 23 May 2018 (UTC)Reply

T:12, is it "to insert category", not intersect?

edit

At T:12, it says: "The advanced interface is accessible through the dropdown menu activated by the right part of the button. Through this menu operations like arbitrary category intersections can be performed. "
For the second sentence, do you mean:

  • current sentence: Through this menu operations like arbitrary category intersections can be performed.
  • suggested edit: Through this menu, you can perform operations such as to insert category arbitrarily.

My question is to clarify as I am translating this page. --Omotecho (talk) 12:43, 29 November 2018 (UTC)Reply

@Omotecho: Thank you for translating the page! The sentence does inded mean intersection − ie, finding all images that are both in Category:A and Category:B. Jean-Fred (talk) 21:21, 29 November 2018 (UTC)Reply
@Jean-Fred: , appreciate your prompt reply, and I see, we are talking about sorting images that are under two categories, or intersection. Yes, a Math vocaburary. :) Issue solved for me, thank you so much and going back to translation. Cheers, --Omotecho (talk) 17:12, 30 November 2018 (UTC)Reply

T:20 Please mark for translation

edit

I tried to mark for translation by adding tvar tags, but it seems not to work. Under ”External links”, the third dagger needs to be marked for translation, which reads:

  • FastCCI - Taming the Commons Category Tree Dschwen, Wikimania 2014 presentation (PDF-slides, video on YouTube)

--Omotecho (talk) 17:26, 30 November 2018 (UTC)Reply

Down again?

edit

Hey @Dschwen: , the tool isn't progressing past "Connecting..." for me. :-/ Ed [talk] [majestic titan] 17:51, 7 March 2019 (UTC)Reply

Same here. Stuck on "Connecting". It hasn't worked for weeks as far as I can see. Why is this? Cnbrb (talk) 15:27, 10 April 2019 (UTC)Reply
@The ed17 and Cnbrb: I was able to duplicate the problem and I reported it at https://github.com/Commonists/fastcci/issues/8.   — Jeff G. please ping or talk to me 15:43, 10 April 2019 (UTC)Reply
Doesn't seem like it's worked in quite some time for me. Dschwen doesn't seem to be around Commons much over the past year and a half. Maybe a good candidate for the Community Wishlist next time? — Rhododendrites talk21:11, 11 April 2019 (UTC)Reply
Same. FWIW, this is the kind of error I get in the console when I click on 'Good pictures' or one of the other dropdown links: [Report Only] Refused to connect to 'https://fastcci1.wmflabs.org/?c1=64207500&d1=15&s=200&a=fqv' because it violates the following Content Security Policy directive: "default-src 'self' data: blob: https://upload.wikimedia.org meta.wikimedia.org *.wikimedia.org *.wikipedia.org *.wikinews.org *.wiktionary.org *.wikibooks.org *.wikiversity.org *.wikisource.org wikisource.org *.wikiquote.org *.wikidata.org *.wikivoyage.org *.mediawiki.org wikimedia.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback. Colin M (talk) 20:53, 18 April 2019 (UTC)Reply
Since there is no answer on github, is there anywhere to ask for a solution? This tool is very useful, and being stuck with "Connecting..." is infuriating. Gyrostat (talk) 10:37, 5 June 2019 (UTC)Reply
edit

According to the presentation, the tool should generate a breadcrumb trail that tells you why a certain image was included in a certain category, which I think would be helpful; however, I'm not getting such a breadcrumb trail. Has it been removed? Or does it need to be activated in some way? —Kri (talk) 18:34, 28 July 2019 (UTC)Reply

Enhancement - only images from Wikidata

edit

It would be great to create an option to only get the images that are in wikidata (usually the best/most representative of each category). Also requested in Commons:Village pump/Proposals#FastCCI - Enhancement - Only images from Wikidata --JotaCartas (talk) 00:28, 31 January 2020 (UTC)Reply

18 days without an update

edit

What is going on? 18 days have passed without an update. Can anyone elucidate us about this?--JotaCartas (talk) 06:57, 15 March 2020 (UTC)Reply

Today, 49 days have passed and there are no solutions or any information 😞😞😞--JotaCartas (talk) 16:31, 8 April 2020 (UTC)Reply
113 days have passed and there are no solutions or any information --JotaCartas (talk) 06:22, 18 June 2020 (UTC)Reply
Thats sad. @Dschwen: --Andrei (talk) 19:35, 25 June 2020 (UTC)Reply
@Dschwen: @Andrew J.Kurbiko: Eureka, after 8 months, started to work 🤗🤗🤗. I hope it is not a premature baby, with difficulties of survival🤔🤔🤔 --JotaCartas (talk) 07:02, 30 October 2020 (UTC)Reply

Yeah, sorry about the absence. It would be useful to have a second maintainer on that project so it does not stand or fall with me alone... --Dschwen (talk) 23:42, 4 January 2021 (UTC)Reply

Dschwen, what sort of things are you looking for? Are the current issues just something that requires periodic service restarts? I'm sure there are plenty of people willing to assist with maintaining that sort of thing (myself included!). Perryprog (talk) 23:37, 25 October 2021 (UTC)Reply

And now today

edit

Today it worked for me, but only sort of. It returns an incomplete list. Doesn't matter if it's a large category (e.g. Category:Green-Wood Cemetery, which returns maybe 20 good pictures out of, well, more than that) or a small one like Category:Birds in Green-Wood Cemetery which only finds 3 of the QIs (and an FP) in the group. — Rhododendrites talk15:11, 27 June 2020 (UTC)Reply

Not working with titles longer than +-50 characteres

edit
 
FastCCI bug

FastCCI does not work when the category title is longer than (+-50) characters. Ex. Category:Capela de Nossa Senhora da Conceição (Foz do Douro) --JotaCartas (talk) 01:13, 31 October 2020 (UTC)Reply

OK, it works if you zoom out your browser. --JotaCartas (talk) 01:29, 31 October 2020 (UTC)Reply

It does not work

edit

As of 2020-12-11, this does not work – shows only “connecting”. --Nefronus (talk) 19:35, 11 December 2020 (UTC)Reply

It seems that the backend server is down. --Nefronus (talk) 16:12, 14 December 2020 (UTC)Reply

I concur: "502 Bad Gateway" --Iketsi (talk) 01:53, 15 December 2020 (UTC)Reply
The same happens here, since some days ago. I hope it does not last as long as eight months as the time before --JotaCartas (talk) 07:45, 16 December 2020 (UTC)Reply
This is also broken for me. Can someone report this to the developers so it can be fixed promptly? 68.14.140.7 23:31, 18 December 2020 (UTC)Reply
It is working again --JotaCartas (talk) 22:41, 4 January 2021 (UTC)Reply
yeah, I fixed it today! --Dschwen (talk) 23:41, 4 January 2021 (UTC)Reply
  Resolved
, Dschwen, thank you --JotaCartas (talk) 05:31, 5 January 2021 (UTC)Reply

Relevant: a community wishlist request involving FastCCIRhododendrites talk02:02, 15 December 2020 (UTC)Reply

Same problem again? Doesn't do anything. Bag Gateway in console. -- Discostu (talk) 23:03, 17 September 2021 (UTC)Reply

I have same problem at the moment. It is writing “connecting” for few days --Butko (talk) 06:45, 23 September 2021 (UTC)Reply

Mobile support

edit

For some reason on mobile (touch screen) devices the gadget does not work anymore. It is impossible to press the button. I know this wasn't always so and I'll be working on this. Also, this needs to be updated to use OOUI.js. I'll work on that. --Dschwen (talk) 02:38, 19 January 2021 (UTC)Reply

Down again, again?

edit

Is this gadget down again? I'd like to use it to find a good/featured photo from Category:Musicians from the United States for use at w:United States#Music, but it only says "connecting..." I've encountered that other times recently, too. {{u|Sdkb}}talk 05:24, 27 September 2021 (UTC)Reply

Sdkb, I've had it connect fine, but the category breakdown view you get once you click on a photo has been missing in action for me. Example image has a console error that says [Error] WebSocket connection to 'wss://fastcci1.wmflabs.org/?c1=NaN&c2=86209375&a=path' failed: Unexpected response code: 500. This happens on both Safari 15.0 and Firefox 92.0.1; CC Dschwen. Perryprog (talk) 20:20, 9 October 2021 (UTC)Reply
Sdkb Perryprog Having the same problem as Sdkb. I used it up into September but now stalls indefinitely on "Connecting..." Using Firefox 93.0 (also tested with Google Chrome Version 94.0.4606.81) on Ubuntu 20.04.3 LTS. It loads ~60% of the time on Firefox mobile (android) but a few presses of 'refresh' eventually fix that. --Ohlookitsthebard (talk) 14:05, 19 October 2021 (UTC)Reply
It's been down for a while for me too, just says "Connecting..." and nothing happens. I'm on Fiefox 93.0 on Linux Mint 20.2. Developer console shows GETwss://fastcci2.wmflabs.org/?c1=4689266&d1=15&s=200&a=fqv [HTTP/1.1 502 Bad Gateway 32906ms]
Firefox can’t establish a connection to the server at wss://fastcci2.wmflabs.org/?c1=4689266&d1=15&s=200&a=fqv. load.php:102:685 -- Veikk0.ma (talk) 12:02, 22 October 2021 (UTC)Reply
It's up! Glad to have it back. --Ohlookitsthebard (talk) 15:12, 3 November 2021 (UTC)Reply

Hello, I still have the problem. It just says "Connecting", FF and Chrome alike. Ziko (talk) 21:06, 12 November 2021 (UTC)Reply

Yeah it's down again for me too (mobile or desktop, FF). I hope it comes back again soon, really invaluable tool. --Ohlookitsthebard (talk) 15:06, 21 November 2021 (UTC)Reply

It's back! FireFox mobile. first time since going down sometime in October/November --Ohlookitsthebard (talk) 00:01, 2 December 2021 (UTC)Reply

Reason it's always down?

edit

@Dschwen: I get that you don't have time to maintain this tool, which is unfortunately extremely important/useful and quite unreliable, but perhaps you could write a bit about what the challenge is on the back-end that causes it to go down so often. That way anyone who might be interested to maintain it (or write an alternative) could be prepared? Thanks. — Rhododendrites talk14:53, 14 November 2021 (UTC)Reply

Hello, at the moment the tools works (again) for me. As it is indeed very important, it would be great if someone of the WMF could help to prevent malfunctioning in the future. Kind regards, Ziko (talk) 16:15, 20 December 2021 (UTC)Reply
It’s down again… --Nefronus 18:17, 26 December 2021 (UTC)Reply
Had a brief window of functioning FastCCI (in 2022) but it's down again. --Ohlookitsthebard (talk) 14:49, 11 January 2022 (UTC)Reply

Should be back up. The challenges are that we're dealing with a large graph that needs to be queried with extremely high performance. The code is on github. The status is available here: https://fastcci1.wmflabs.org/status and here: https://fastcci2.wmflabs.org/status . I'll have to think about improving scalability to keep up with teh ever growing commons category graph. --Dschwen (talk) 21:50, 11 January 2022 (UTC)Reply

Ok, I think I have a more scalable, future proof way of building the database through the use of mmap and mremap rather than malloc and realloc. That way I'm not bound by RAM size. I'll work on having the serves use mmap as well once I determine what the performance impact is. --Dschwen (talk) 01:03, 12 January 2022 (UTC)Reply

@Dschwen: It appears to be down again. See https://commons.wikimedia.org/wiki/Commons:Village_pump#Good_pictures_button_broken_again Mateusz Konieczny (talk) 13:28, 15 August 2022 (UTC)Reply

Upgrading to Debian 11

edit

I'm working on upgrading (rebuilding) all VMs from Debian 9.5 to 11. That should be good for a few years (support until 2026). There might be some service interruptions. But it's looking good so far. --Dschwen (talk) 21:58, 16 January 2022 (UTC)Reply

Bugs

edit

Hi, I have noticed some problems with the gadget FastCCI enabled by default, CC @Dschwen:

  • the font size is larger than the rest of the text on the page (Vector 2022)
  • the icons of FP/QI/VI overlap (Legacy Vector and Vector 2022)
  • when you click on the "Good pictures" button, the words "Good pictures" appear in the title, between "Category:" and the category name (Legacy Vector and Vector 2022)
  • by adding ?safemode=1 to the url, the problem disappears.

Patafisik (WMF) (talk) 08:55, 17 September 2022 (UTC)Reply

Hi, there is an other gadget on fr.wiki which was not working correctly, because of phab:T313947 and this change (here the original discussion). To summarize: "elements of the .vector-page-titlebar were reorganized and passed from display flex to display float", a solution was found, '"the gadget should either be inserted after the title of the page rather than before, or simply add the order: 1; style". Patafisik (WMF) (talk) 16:32, 20 September 2022 (UTC)Reply
Thanks. I have however once again lost the ability to edit my own gadgets... So if anyone wants to make that change fro me that'd be great. --Dschwen (talk) 00:44, 4 December 2022 (UTC)Reply

Language bug?

edit

With french language on commons, I cannot see the gadget on:

But I can see it on:

Gonioul (talk) 22:21, 11 November 2020 (UTC)Reply

Useless tool...

edit

This tool is very necessary, for example, to see all the images in a subcategorized category. However, FastCCI is neither fast nor useful. Every time you click on the tool, the message "establishing connection" appears and it gets stuck. Never in my 10 years of work at Commons has it worked for me only 1 time. So I propose to remove this tool or change it. --– El Mono 🐒 (talk - es.wiki) 14:47, 15 November 2021 (UTC)Reply

I don't agree with "useless tool" but I agree it seems completely broken to me at the moment (and, I agree that I was never able to see this working in my life). Unfortunately I do not know how to help, if a developer is needed. --bozz (talk) 14:00, 13 October 2023 (UTC)Reply
I reported this technical issue in the Wikitech talk page: wikitech:Nova Resource Talk:Fastcci#Offline? bozz (talk) 14:10, 13 October 2023 (UTC)Reply

Limit number of files to dig thru

edit

sometimes it shows me "digging thru 80121212 files...", because, i guess, some cats somehow contain the entire commons cat tree and cause fastcci go thru EVERYTHING on commons.

i suggest stopping fastcci at 10 million files, or finding at least 1 file, whichever is later.--RZuo (talk) 19:54, 8 February 2023 (UTC)Reply

Date ranges

edit

How about adding an option to search by date ranges?--agr (talk) 19:57, 16 July 2023 (UTC)Reply

Large Images

edit

When trying to search for files that are located both in a category and Category:Large images, around half of the thumbnails in a result don't load. If someone could improve the capability on this front, it would be very helpful. StellarHalo (talk) 03:42, 1 August 2023 (UTC)Reply

Not loading, showing offoptic images, and proposal for a forked gadget that shows the cat-path why a file is in cat

edit

Thanks for this great tool (@Dschwen: ), it has lots of potential. However, it seems to have two or more major issues so it's usually not that useful/usable:

  1. most of the time it just loads with "Connecting..." – issue here: phab:T367652
  2. it display lots of offtopic images somewhere deep down in a category branch – proposed solution: certain subcat types should be filtered out/filterable such as "xyz in art" subcats (e.g. "Maps of the world in art" underneath Maps of the world") and there could be a lower default subcategory-depth level so that it only goes through the highest 5 subcategories (the latter would be a temporary fix or one could make it so that one could load more images deeper down on request/when scrolling [infinite scrolling])

I'm mostly interested in this because it's relevant to this well-supported technical proposal for a wall of images view for category pages (e.g. maybe parts of the code could be repurposed for that which could make WMC actually interesting to explore for users, enable a modern engaging UI, and be more useful).

If you got another idea about the two issues above please let me know, I meant to ask about sth else:


 
FastCCI Commons gadget showing why a quality image is erroneously categorized into a category; a separate gadget that does this for any file is needed

The gadget already has a feature that shows why a specific image is located somewhere underneath a specific category (the category where the Quality images button was clicked) as shown in the screenshot.

I'm looking for a way where one can check why any specific image is anywhere underneath a specific category, see the village pump discussion How to find the source cat for why a given image is in a specific category tree?.

This is useful for example when images that shouldn't be there show up in a petscan and because FastCCI only works for quality images etc and not any kind of file.

Could you create a new tool that allows for that? (Directed at Dschwen as well as anybody else interested). Maybe it wouldn't require lots of changes to the code that already does that for quality images. That gadget could show an extra search box on a category page where one could enter the file's url or name and/or it could be a separate toolforge site where one enters it to view the shortest or all routes by which a file is located underneath a specific category. Prototyperspective (talk) 14:20, 19 June 2024 (UTC)Reply

For example, I'd like to know why this scan shows so many image files as being in the Videos cat; why this scan shows files that are not science fiction films; why this scan shows several files that are not comedy like this or this ... Prototyperspective (talk) 21:39, 20 August 2024 (UTC)Reply
Also see https://github.com/magnusmanske/petscan_rs/issues/182 "A way to see why files are included in the specified cats (source of categorization)" for Petscan. Prototyperspective (talk) 10:25, 26 October 2024 (UTC)Reply
m:Community Wishlist/Wishes/A way to see why a file is somewhere underneath a specific category (tool to show cat-path). Prototyperspective (talk) 19:26, 7 June 2025 (UTC)Reply
I've disabled the "default" setting on this gadget for now, to reduce confusion as it has been flaky for over a year. Feel free to ping me anytime (or be bold, other admins) to re-enable it by default when it seems to have recovered. Anyone can still enable it via Special:Preferences. Krinkle (talk) 17:10, 30 July 2025 (UTC)Reply
Ok, I have rebuilt the server, which apparently just needed a recompile. Should be working now. Some better monitoring would be nice so that I get alerted when this thing is down. --Dschwen (talk) 02:20, 2 August 2025 (UTC)Reply
Thanks! Well the tool has been mostly dysfunctional for at least 2 years or so, it's not like it was suddenly down just recently. Created phab:T367652 in mid 2024. I tried it now and it does work again at the large example category linked in that issue. @Krinkle: could the gadget be re-enabled if it does indeed work relatively reliably now? Maybe there's a way to check if it is, or at least some more users could check if it now works for them and check with more categories. (Re #Shutdown? thread below.) Prototyperspective (talk) 12:16, 18 September 2025 (UTC)Reply
@Prototyperspective @Dschwen It works fine for me on Category:Osaka. Done! diff. Krinkle (talk) 14:54, 18 September 2025 (UTC)Reply
The API is already there in FastCCI. Anyone could write a gadget (just borrow the code from the FastCCI that produces the trail). --Dschwen (talk) 02:22, 2 August 2025 (UTC)Reply
@Dschwen: Please do.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 13:18, 2 August 2025 (UTC)Reply
It's actually even easier. Look at
https://commons.wikimedia.org/wiki/File:Umeda_Sky_Building,_Osaka,_November_2016_-02.jpg?fastcci_from=35253063&c1=35253063&d1=15&s=200&a=fqv
the fastcci_from URL parameter indicates the page ID of the source category. If that parameter is present the FastCCI gadget will query for the path and show it at the top of the page. Dschwen (talk) 02:58, 3 August 2025 (UTC)Reply
Better example:
https://commons.wikimedia.org/wiki/File:Multnomah_Falls_October_2019_stack.jpg?fastcci_from=14693 Dschwen (talk) 03:06, 3 August 2025 (UTC)Reply
Thanks, that's super useful already! I've added the info on this to the Wishlist wish.
Note that your last link probably got fixed by now so doesn't show the path anymore.
 
FastCCI being used to see categorization path of a nonmicroscopic image in the Microscopic images category
Two good places to easily spot offtopic files are deepcat:Microscopic images and deepcat:Diagrams also showing files that aren't diagrams. The category ID can be found via Tools -> Page information on the category. It's 39217 and 27549 for these two categories. Examples (I won't fix these so the path remains visible when you click the link): https://commons.wikimedia.org/wiki/File:Alouatta_seniculus_5perspective.jpg?fastcci_from=39217 https://commons.wikimedia.org/wiki/File:Strada_europea_29.svg?fastcci_from=27549 However, apparently FastCCI is already down again. So right now these links don't work. Will comment above about that. On the right is another better screenshot of how it looked like.
Coming back to the proposed categorization-path-tool: if this is already possible by just adding a parameter to the file url when the gadget is functional and enabled, then implementing the addition of an input box on file pages where the user can enter the category ID or better the category title (where it fetches the ID) to make FastCCI show the path and/or an input box on category pages where to enter the file where it creates that file link seems more readily possible for straightforward implementation than thought. Could your or somebody do that? The wish probably doesn't get read much, maybe I'll ask about it at a place like Commons:User scripts if nobody here is willing to add the code. (MediaWiki:Gadget-fastcci.js#L-1170) Given how often and long FastCCI is dysfunctional it would probably be best if this was implemented as a separate tool. Prototyperspective (talk) 11:53, 23 September 2025 (UTC)Reply

Shutdown?

edit

Has the tool been shutdown? The buttons do not appear on my Commons interface and https://fastcci1.wmflabs.org/status is not responding either. MB-one (talk) 15:45, 11 September 2025 (UTC)Reply

Presumably that's related to this from Krinkle? Ed [talk] [OMT] 09:27, 17 September 2025 (UTC)Reply
@MB-one: If you don't like that link, please just search for "17:10, 30 July 2025 (UTC)" above.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 21:43, 17 September 2025 (UTC)Reply
@Dschwen and Krinkle: It's already down again. Could you please take a look why it's going down? Maybe it's sending too many requests too quickly which needs some changes to be aligned with API guidelines or there's a bug somewhere. It's a really useful tool but still dysfunctional most of the time. The issue is phab:T367652. Prototyperspective (talk) 11:57, 23 September 2025 (UTC)Reply
Return to "FastCCI" page.