Project

General

Profile

Task #1229

Determine why searching for a particular division with chapter doesn't work

Added by Luke Murphey over 8 years ago. Updated over 8 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Luke Murphey
Target version:
1.3
Start date:
03/03/2016
Due date:
% Done:

100%

Description

The following should return nothing:

work:new-testament section:"Galatians 1" νόμον

Oddly enough, the following matches nothing:

work:new-testament section:"Galatians 10" νόμον

This does seem to work in other places. For example, the following works, returning only one result:

work:new-testament section:"Romans 13" νόμον

But this return too much:

work:new-testament section:"Romans 1" νόμον

History

#1 Updated by Luke Murphey over 8 years ago

It seems like section filtering only works correctly when the chapter is 10 or greater.

#2 Updated by Luke Murphey over 8 years ago

  • Description updated (diff)

#3 Updated by Luke Murphey over 8 years ago

Something happening in the query parser.

Original:
work:new-testament section:"Acts 1""

Parsed:
(work:<new> AND work:<testament> AND section:acts)

Original:
work:new-testament section:"Acts 10"

Parsed:
(work:<new> AND work:<testament> AND section:"acts 10")

#4 Updated by Luke Murphey over 8 years ago

Observations:

I don't like the that the following is happening:
  1. That the single digit numbers are being dropped in the section
  2. That the dash is being used to split up the work name

#5 Updated by Luke Murphey over 8 years ago 

from whoosh.analysis import SimpleAnalyzer
ana = SimpleAnalyzer()
[token.text for token in ana(u"new-testament")]

Outputs:
[u'new', u'testament']

#6 Updated by Luke Murphey over 8 years ago

I think the problem is that Whoosh isn't recognizing that the section is quoted and thus is hitting the minsize limit: http://whoosh.readthedocs.org/en/latest/api/analysis.html?highlight=SimpleAnalyzer

#7 Updated by Luke Murphey over 8 years ago

  • Status changed from New to In Progress

#8 Updated by Luke Murphey over 8 years ago

This returns "Acts 1" as expected:

from whoosh.analysis import SimpleAnalyzer
from whoosh.util import rcompile
ana = SimpleAnalyzer( rcompile(r"[a-zA-Z0-9- ]+") )
[token.text for token in ana(u"section:acts 1")]

#9 Updated by Luke Murphey over 8 years ago

I tried with both of the following and they seem to work:

  • section_analyzer = StandardAnalyzer( rcompile(r"[a-zA-Z0-9- ]+"), minsize=1 )
  • section_analyzer = SimpleAnalyzer( rcompile(r"[a-zA-Z0-9- ]+") )

#10 Updated by Luke Murphey over 8 years ago

There is one issue. I have lost the ability to search for works without a full section. In other words, this no longer works:

work:new-testament section:"Galatians" νόμον

#11 Updated by Luke Murphey over 8 years ago

Going to try building the search indexes with more ways to refer to the divisions.

#12 Updated by Luke Murphey over 8 years ago

The issue is that I am only able to now search for the first chapter description in get_section_index_text()'s output.

#13 Updated by Luke Murphey over 8 years ago

  • Status changed from In Progress to Closed
  • % Done changed from 0 to 100

Also available in: Atom PDF