bobo Discussions Rss Feed

New Post: Full Categorization By BOBO Browser.Net. FYI

omarsrawi — Thu, 17 Jan 2013 21:20:26 GMT

i was trying to solve problem regard categorization as bellow

my category information is

____________________________________

jacket jeans

Jacket jeans 3mD

jacket jeans module 3

i use SimpleFacetHandler for field name "MAIN_CAT"

but i found the facet returned by BrowseResult as below

_________________________

jacket (3)

jeans(3)

3mD(1)

module(1)

3 (1)

my problem was my field posted with SimpleFacetHandler is Analyzed

it should be NOT_Analyzed from lucene Files.

Thanks you Mr.Shcherbachev for Solution :)

hope this help others. feel free for any question :)

New Post: AutoComplete Assistance

Shcherbachev — Tue, 25 Dec 2012 11:38:47 GMT

Hello.

There are several ways to implement autocomplete with BoboBrowse/Lucene. The code you are referring to is using approach similar to this http://solr.pl/en/2010/10/18/solr-and-autocomplete-part-1/
Pros:

You can apply filters (facet selections) to autocomplete list
You will get count returned for every suggestion

Cons:

Only "starts with" matching
Suggests only single term at a time (list of single terms actually)

Raw data will be problematically to extract, since this is something created long time ago.

New Post: AutoComplete Assistance

NightOwl888 — Sat, 22 Dec 2012 20:19:34 GMT

Hello,

Great work on porting this - I got the faceted search working exactly the way I wanted.

Now I am moving on to creating an autocomplete list and I am having trouble understanding the code in the unit test.

I think I get that you are passing in the "type in" text through the Prefix property of the FacetSpec object. However, it is difficult to understand the rest of what is going on without some context as to what the Body and Entity fields are, how they were indexed (were they stored?, were they analyzed?, etc), and how (or whether) they relate to the other fields in the other unit tests.

What I am trying to achieve is to have the autocomplete functionality work for all single or multi-word phrases. The terms in the phrases should be able to be entered in any order and the prompt should help to finish the entire phrase in most likely to least likely order (similar to the way it works on google).

It would be very helpful to see the code that you used to create the index as well as the raw data (XML would suffice) in order to understand completely what the unit test is doing.

New Post: NuGet?

Shcherbachev — Fri, 14 Dec 2012 13:50:11 GMT

Version for 2.9.4.1 makes sense. However, NuGet package for 2.9.4.1 has only .Net 4.0 version. Now I remember, why we haven't created NuGet package already :) The reason is our core projects still must run on .Net 3.5 and creating a package that we were not going to use ourselves... well, didn't sound reasonable.

I will be happy if you can help us with that anyway.

Also, Bobo proved to work just fine for us under both .Net 4.0 and 3.5.

New Post: NuGet?

tommck — Fri, 14 Dec 2012 13:20:59 GMT

I built a 2.9.4.1 nuget package for it (you can lock things to different versions). I'm using that version on my project right now, though I haven't tested Bobo with it.

I also needed to upgrade the framework to 4.0.

Had to tweak some other references as well.

When I get a change, I'll update a fork of it so you can see what I did.

Tom

Shcherbachev <notifications@codeplex.com> wrote:

From: Shcherbachev

We would definitely love to have NuGet packages. The road blocker is that current Bobo version isn't compatible with Lucene.Net 3.0.3 at all. We plan to upgrade Bobo to latest Lucene version. But it will take time. After that it will make sense to create NuGet package.

We welcome any contribution. Bug reports, unit tests, code improvements, NuGet packages. Feel free to contact me directly via skype : Leha-2304

New Post: NuGet?

Shcherbachev — Fri, 14 Dec 2012 10:32:42 GMT

We welcome any contribution. Bug reports, unit tests, code improvements, NuGet packages. Feel free to contact me directly via skype : Leha-2304

New Post: NuGet?

tommck — Wed, 12 Dec 2012 18:00:01 GMT

It would be nice if we had NuGet packages so things worked well with the existing Lucene.Net NuGet packages.

Do you need help with that?

New Post: Lucene 3.0.3

Shcherbachev — Mon, 19 Nov 2012 01:10:40 GMT

Hi Daniel,

Yep, we are planning to upgrade to 3.0.3. Not sure about exact date, however.

Regards,
Alexey

New Post: Lucene 3.0.3

Hoisel — Sun, 18 Nov 2012 19:34:13 GMT

Hi,

Contratulations for your job! Amazing!

Are you planning a update to lucene 3.0.3? Thanks!

Daniel Hoisel

New Post: RangeFacetHandler for Date Ranges

Shcherbachev — Fri, 19 Oct 2012 13:05:40 GMT

Rob,

It should be working with overlapping ranges too, just try to provide such ranges manually. If it doesn't work, this is clearly a bug. Let me know if this is the case.

Regards,

Alexey

New Post: RangeFacetHandler for Date Ranges

roblcecil — Thu, 18 Oct 2012 21:46:18 GMT

Alexey,

Do you know what Bobobrowse generally does for not-exclusive (range) facets?

Thanks

New Post: RangeFacetHandler for Date Ranges

roblcecil — Thu, 18 Oct 2012 21:44:27 GMT

Figured it out. The ranges needed to be from Low TO High date, not High TO Low. When I constructed ModifiedDate class above, I conceptualized the ranges in a fashion inverted from what Bobo was expecting... Should be

yield return Create(FromDays(365), yesterday, "Last Year");

New Post: RangeFacetHandler for Date Ranges

roblcecil — Thu, 18 Oct 2012 21:14:52 GMT

Thanks for the Alexey... Following your steps I was able to get auto ranges to generate.

This is how I set up my field:

document.Add(CreateOrSetValue(fields, SearchFields.ModifyDate, DateTools.DateToString(modify, DateTools.Resolution.DAY), Field.Store.YES, Field.Index.NOT_ANALYZED));

And this is how I created my facet handler:

new RangeFacetHandler(SearchFields.ModifyDate, new PredefinedTermListFactory<DateTime>("MM/dd/yyyy"), true)

I got three facets produced for my data, but I don't think they are very useful, when compared to the "Last Touched Yesterday", "Last Touched Last Week", "Last Touched This Month", etc.

This is how I attempt to setup my facet handler for explicit ranges:

new RangeFacetHandler(SearchFields.ModifyDate, new PredefinedTermListFactory<DateTime>("MM/dd/yyyy"), ModifiedDate.Ranges.Select(i => i.Name).ToList())

Where ModifiedDate is:

    public class ModifiedDate
    {
        public static IEnumerable<ModifiedDate> Ranges
        {
            get
            {
                var today = DateTools.DateToString(DateTime.Today, DateTools.Resolution.DAY);
                yield return Create(today, today, "Today");
                var yesterday = FromDays(1);
                yield return Create(yesterday, yesterday, "Yesterday");
                yield return Create(yesterday, FromDays(7), "Last Week");
                yield return Create(yesterday, FromDays(30), "Last Month");
                yield return Create(yesterday, FromDays(365), "Last Year");
            }
        }

        private static ModifiedDate Create(string from, string to, string displayName)
        {
            return new ModifiedDate(string.Format(Format, from, to), displayName);
        }

        private static string FromDays(int fromDays)
        {
            return DateTools.DateToString(DateTime.Today.Subtract(TimeSpan.FromDays(fromDays)), DateTools.Resolution.DAY);
        }

        private static string Format
        {
            get { return "[{0} TO {1}]"; }
        }

        public string Name { get; set; }
        public string DisplayName { get; set; }

        public ModifiedDate(string name, string displayName)
        {
            Name = name;
            DisplayName = displayName;
        }
    }

But I'm not getting generated ranges from this list. I think perhaps it's because they aren't truly facets in the sense they are not mutually exclusive (Last Month subsumes Last Week subsumes Yesterday, etc). Maybe I don't even want to use facets in my search UI for this field and just create a custom UI (albiet, without the Scented UI benefit) that has these explicit ranges baked in...

Rob

New Post: RangeFacetHandler for Date Ranges

Shcherbachev — Thu, 18 Oct 2012 10:28:36 GMT

Hello,

Right now we are indexing dates with following code:

 document.Add(new Field(name, DateTools.DateToString(value, DateTools.Resolution.MINUTE), Field.Store.YES, Field.Index.NOT_ANALYZED));

This way Bobo should be able to build auto-range facet. Also for the facet values we are using following format string:

FormatString = "MM/dd/yyyy"

And you can use * for start/end values to designate open interval.

If it doesn't work with explicit ranges, I would try to build auto-range and see what Bobo will generate in this case.

Let me know if it still doesn't work.

Regards,

Alexey

New Post: RangeFacetHandler for Date Ranges

roblcecil — Tue, 16 Oct 2012 02:00:58 GMT

I'm struggling to get a facet for date ranges to work. I've posted on the original Java BoboBrowse group page, just in case it's a core issue, and not related to the .Net port...

I've tried both Field and NumericField with no success. I am adding a 6th facet to an existing working Index that uses BoboBrowse.Net for facet support. So, far it hasn't taken too much time to learn how to apply BBN and its a great effort by the author.

I've gotten two other fields (NumericField) to work with BBN. Not sure why a date range is really that much different.

It looks like:

new RangeFacetHandler(SearchFields.ModifyDate, new PredefinedTermListFactory<DateTime>(ModifiedDate.CUSTOM_DATE_FORMAT), ModifiedDate.Ranges.Select(i => i.Name).ToList()),

where

public const string CUSTOM_DATE_FORMAT = "yyyyMMdd";

and the field is defined as a regular field, not NumericField. It is indexed as:

                document.Add(CreateOrSetValue(fields, SearchFields.ModifyDate, modify.ToString(ModifiedDate.CUSTOM_DATE_FORMAT, CultureInfo.InvariantCulture), Field.Store.YES,
                                              Field.Index.NOT_ANALYZED));

and my predefined ranges are computed on the fly, based on the current date:

        public static IEnumerable<ModifiedDate> Ranges
        {
            get
            {
                var today = DateTime.Today.ToString(CUSTOM_DATE_FORMAT, CultureInfo.InvariantCulture);
                yield return Create(today, today, "Today");
                var yesterday = FromDays(1);
                yield return Create(yesterday, yesterday, "Yesterday");
                yield return Create(yesterday, FromDays(7), "Last Week");
                yield return Create(yesterday, FromDays(30), "Last Month");
                yield return Create(yesterday, FromDays(365), "Last Year");
            }
        }

Any ideas? I've read the Javadoc for NumericField and it seems to suggest that you get better performance when using NumericFields to represent date ranges. I tried that and didn't achieve success.

So far, the facet group coming after the query completes has been empty for that facet.

New Post: Lack of unit tests

Shcherbachev — Mon, 02 Jul 2012 09:44:26 GMT

Hi,

Yes. This library is used in several production projects.

There are no plans to implement unit tests in near future (like 1-2 months). But, I would welcome such contribution a lot if somebody is willing to participate.

Regards,

Alexey

New Post: Lack of unit tests

Lybecker — Sat, 30 Jun 2012 10:29:48 GMT

HI,

I appreciate you work with porting the Bobo framework, but I’m concerned by the lack of unit tests.

Are there any plans to port the unit tests also?

Is anybody running this in production and not in just hobby projects?

Regards,

Anders Lybecker

New Post: Adding second facet to BrowseTest() unit test

Shcherbachev — Thu, 21 Jun 2012 18:09:17 GMT

The main Bobo site is good. Since we don't have any documentation for .Net version, it could be the only source for valuable insights.

The difference is how many tokens are stored for every field per document. Usually, for tokenized fields you will end up with many tokens in field. That is the case for Group, which had been indexed as tokenizable (you can see that in the Luke).

But for faceted navigation you don't wanna use tokenized fields usually. Exception is only the field created for auto suggest/type a head feature. Instead you would add either one (or none) untokenized field value for every document (this is the case for SimpleFacetHandler) or more than one field value (then use MultiValueFacetHandler).

Hope that helps.

New Post: Adding second facet to BrowseTest() unit test

roblcecil — Thu, 21 Jun 2012 17:41:32 GMT

Cool this works great. Quick question about handler types. I read the documentation on the main BoboBrowse website ("Creating a Browse Index") and don't know if there is a better place to read a description of the different handlers in Bobo. I was wondering about SimpleFacetHandler vs. MultiValueFacetHandler and how to know if a field has been defined/indexed as something that can take multiple values. I don't know how to tell that in Luke or not.

When I use the changes you suggest (MultiValueFacetHandlers for both File Type and Group) this is what I get:

Facets:
dwp(60)
thmx(40)
webpart(26)
aspx(11)
master(7)
xsn(6)
png(4)
rules(3)
vdw(3)
xml(3)
xoml(3)
xlsx(2)
gif(1)
pdf(1)
content(22)
rollup(18)
search(17)
information(10)
my(10)
filters(9)
business(8)
data(8)
people(7)
navigation(6)
applications(5)
client(5)
office(5)
media(4)
documents(1)
Actual items:
default.master
v4.master
minimal.master
mysite.master
1_.000
3_.000
1073741823_.000
owatasks.dwp
owacalendar.dwp
Microsoft.Office.InfoPath.Server.BrowserForm.webpart

You can see the Group facets printed right after the File Type facet values (Content through documents). When I use both SimpleFacetHandlers the File Type facets listing does not change, but the Group facets does:

rollup(18)
search(17)
my(10)
filters(9)
data(8)
people(7)
navigation(6)
office(5)
media(4)
documents(1)

Notice the differences - facet values 'content', 'information', 'business','applications', 'client' are missing.

I'm guessing that the Group field in the index is multi-value (although I don't know how to check that in Luke), so I'm guessing its a matter of knowing exactly how your fields are set up, right?

New Post: Adding second facet to BrowseTest() unit test

Shcherbachev — Thu, 21 Jun 2012 10:04:48 GMT

Hello. What you need is to extend facet handler collection with additional fields you need.

Something like this:

FacetHandler facetHandler1 = new MultiValueFacetHandler("File Type");
FacetHandler facetHandler2 = new MultiValueFacetHandler("Group");

ICollection handlerList = new FacetHandler[] { facetHandler1, facetHandler2 };