Skip to content

Analysis enhancement - better plural stemmer than minimal_english. #43248

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Analysis enhancement - better plural stemmer than minimal_english. #43248

wants to merge 7 commits into from

Conversation

markharwood
Copy link
Contributor

Drops the trailing “e” in taxes, dresses, watches, dishes etc that otherwise cause mismatches with plural and singular forms.
See the issue for recall benchmarking results on typical data.
Closes #42892
@markharwood markharwood self-assigned this Jun 14, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search
romseygeek
romseygeek reviewed Jun 26, 2019
View reviewed changes
...s-common/src/test/java/org/elasticsearch/analysis/common/StemmerTokenFilterFactoryTests.java Outdated
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking at http://www.thefreedictionary.com/words-that-end-in-ches I think that 'avalanche' and 'headache' are the odd ones out here - consider brooch/brooches, branch/branches, couch/couches. Maybe have a specific rule for -ache, and some exceptions?
@markharwood
Analysis enhancement - better plural stemmer than minimal_english.
0359d5d 
Drops the trailing “e” in taxes, dresses, watches etc that otherwise cause mismatches with plural and singular forms

Closes elastic#42892
@markharwood
Added ees->ee stemming so that bees match bee.
9682315 
Made ies->y stemming stricter so short words match eg ties==tie
Removed special-case code for crazy-rare words iaes and eies
@markharwood
Javadoc fix
3dbd2f6
@markharwood
Added support for oes -> o suffixes mawith small exception list for o…
18fcf11 
…nes-> oe e.g. shoes
@markharwood
Remove redundant modifier
942a7af
@markharwood
Added docs
0171b46
@markharwood
Added support for ches suffix with exceptions for words like avalanche
3c76b8b
@markharwood markharwood mentioned this pull request Jul 9, 2019
Open
@markharwood markharwood mentioned this pull request Jul 18, 2019
Open
@rjernst rjernst added the Team:Search Meta label for search team label May 4, 2020
@jimczi
Copy link
Contributor

jimczi commented Apr 23, 2021

What's the status of this PR @markharwood ? Is it still relevant ?
@arteam arteam added v8.1.0 and removed v8.0.0 labels Jan 12, 2022
@mark-vieira mark-vieira added v8.2.0 and removed v8.1.0 labels Feb 2, 2022
@elasticsearchmachine elasticsearchmachine changed the base branch from master to main July 22, 2022 23:14
@mark-vieira mark-vieira added v8.5.0 and removed v8.4.0 labels Jul 27, 2022
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)
@rjernst rjernst added the v8.8.0 label Feb 8, 2023
@gmarouli gmarouli added v8.9.0 and removed v8.8.0 labels Apr 26, 2023
@quux00 quux00 added v8.11.0 and removed v8.10.0 labels Aug 16, 2023
@mattc58 mattc58 added v8.12.0 and removed v8.11.0 labels Oct 4, 2023
@javanna javanna added Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch and removed Team:Search Meta label for search team labels Jul 16, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :Search Relevance/Analysis How text is split into tokens Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch v9.2.0
close