<<O>> Difference Topic IRseminar08-0411 (r1.11 - 11 May 2008 - JangwonSeo)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Distributed IR, Jangwon Seo

Background:

Distributed IR (or federated search)is searching relevant documents or ranking databases in the environment that searchable databases are distributed on networks. Our goal is to understand three sub-problems - resource description, resource selection and results merging - and various scenarios - centralized vs. decentralized and cooperative vs. uncooperative - which distributed IR should address. Furthermore, we would think about real world situations for distributed IR.

Added:

>
>

DistributedIRseminar.pdf: Slides for Lab meeting

Required papers:

13 years old CORI and GIOSS algorithms that the following two papers introduce are still considered as baselines for distributed IR. You can see many basic ideas to solve distributed IR problems there.

Line: 47 to 49

@Elif : I think exchanging information in document level may be too expensive. Yet I thought that unigram LM for collection content representation was too simple. Maybe local clustering suggested in [Liu&Croft] can be better, as it enables multiple-topic representation for each cluser. @Xing : I think one of values of FIR is in allowing each server to use specialized ranking algorithm, although centralized algorithm can simulate this. Also, it seems to me that for users to choose resources(servers) will be possible only when users have good idea on individual resources, which is not true in many cases. Personalization based on query context can be a solution for resource selection. My question is how we can do this context-sensitive FIR? If we can model query context as LM, this won't be much different from pseudo-relevance feedback. - JinyoungKim

Added:

>
>

META FILEATTACHMENT	DistributedIRseminar^?.pdf	attr="" comment="Slides for Lab meeting" date="1210483343" path="C:\Documents and Settings\MYKO\My Documents\Distributed IR (seminar).pdf" size="347468" user="JangwonSeo" version="1.1"

<<O>> Difference Topic IRseminar08-0411 (r1.10 - 11 Apr 2008 - JinyoungKim)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 43 to 43

In an environment where a FIR agent takes over the role of a search engine (i.e. search engines compete to just get chosen as the "best" source of data), how will that affect the adversarial landscape as we know it today? Currently sites try to boost their rankings through non-content-based means - should we expect whole collections to pop up that contain nothing but banner ad information and other spam? At what level would spam be handled? You can't regulate what kind of anti-adversarial measures are in place on search engines that you have no control over, but how well can you identify and filter out spam from little more than a resource description and/or some query-based samples? -- MarcCartright

Added:

>
>

@Elif : I think exchanging information in document level may be too expensive. Yet I thought that unigram LM for collection content representation was too simple. Maybe local clustering suggested in [Liu&Croft] can be better, as it enables multiple-topic representation for each cluser. @Xing : I think one of values of FIR is in allowing each server to use specialized ranking algorithm, although centralized algorithm can simulate this. Also, it seems to me that for users to choose resources(servers) will be possible only when users have good idea on individual resources, which is not true in many cases. Personalization based on query context can be a solution for resource selection. My question is how we can do this context-sensitive FIR? If we can model query context as LM, this won't be much different from pseudo-relevance feedback. - JinyoungKim

<<O>> Difference Topic IRseminar08-0411 (r1.9 - 11 Apr 2008 - MarcCartright)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 40 to 40

from the degree of decentralization, we can see that federated search lies between centralized search and p2p-search. today, centralized search system like Google can successfully deal with large scale data search problem by using carefully designed and well organized distributed index and search system, therefore in many cases, federated search systems are not so needed? federated search is suitable for the senarios where each site does not want to share their data. Thus, I double that elif's suggestions about rearranging documents across DBs could happen. I think that deploying search engines for each DB owners will be more possible: then federated search system like FedLemur^? can work more efficiently with a standard API instead of using a perl wrapper, the deployed search engine can use very effective search methods so that the bad impact of ineffective individual search algorithm can be reduced. My question is whether we really need to merge results from very different DBs or let the user to choose the DB to search: if a user is only interested in the "apple"'s impact for people's health and only interested in the medical database, it is not very useful even a computer DB contains a lot of terms "apple". (Xing)

In the conclusion of "Distributed information retrieval," Jamie Callan mentions the potentiality of applying techniques such as relevance feedback to federated search. If we were to integrate techniques such as this into federated search, how would we go about doing so? For example, would it be reasonable to fetch documents, merge, then do pseudo relevance feedback on the final results list, and then re-fetch/merge documents based on the expanded query (this seems like it would be the most accurate, but could be very costly)? Or could we rely on the centralized sample document database for the pseudo relevance feedback and then apply the expanded query to the distributed databases? -- HenryFeild

Added:

>
>

In an environment where a FIR agent takes over the role of a search engine (i.e. search engines compete to just get chosen as the "best" source of data), how will that affect the adversarial landscape as we know it today? Currently sites try to boost their rankings through non-content-based means - should we expect whole collections to pop up that contain nothing but banner ad information and other spam? At what level would spam be handled? You can't regulate what kind of anti-adversarial measures are in place on search engines that you have no control over, but how well can you identify and filter out spam from little more than a resource description and/or some query-based samples? -- MarcCartright

<<O>> Difference Topic IRseminar08-0411 (r1.8 - 11 Apr 2008 - HenryFeild)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 38 to 38

In the research presented, the resource ranking is done based on the fit of the resource (DB) to the query. The discussed fit employs only textual features of the DB and assumes uniform prior distribution over the DB's. It would be interesting to examine how effective the non-textual features (used for document ranking in large scale systems) would be for resource ranking: click-through data, link-analysis, DB quality, size, personalization bias, etc. How could this be done? (Michael)

from the degree of decentralization, we can see that federated search lies between centralized search and p2p-search. today, centralized search system like Google can successfully deal with large scale data search problem by using carefully designed and well organized distributed index and search system, therefore in many cases, federated search systems are not so needed? federated search is suitable for the senarios where each site does not want to share their data. Thus, I double that elif's suggestions about rearranging documents across DBs could happen. I think that deploying search engines for each DB owners will be more possible: then federated search system like FedLemur^? can work more efficiently with a standard API instead of using a perl wrapper, the deployed search engine can use very effective search methods so that the bad impact of ineffective individual search algorithm can be reduced. My question is whether we really need to merge results from very different DBs or let the user to choose the DB to search: if a user is only interested in the "apple"'s impact for people's health and only interested in the medical database, it is not very useful even a computer DB contains a lot of terms "apple". (Xing)

Added:

>
>

In the conclusion of "Distributed information retrieval," Jamie Callan mentions the potentiality of applying techniques such as relevance feedback to federated search. If we were to integrate techniques such as this into federated search, how would we go about doing so? For example, would it be reasonable to fetch documents, merge, then do pseudo relevance feedback on the final results list, and then re-fetch/merge documents based on the expanded query (this seems like it would be the most accurate, but could be very costly)? Or could we rely on the centralized sample document database for the pseudo relevance feedback and then apply the expanded query to the distributed databases? -- HenryFeild

<<O>> Difference Topic IRseminar08-0411 (r1.7 - 11 Apr 2008 - XingYi)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 36 to 36

Distributed IR seems to somewhat resemble IR from clusters. What are the differences? Clusters contain homogeneous data whereas I assume DBs are rather heterogeneous. Could an algorithm be designed that would gather data to be updated, and do occasional updates to the distributed DBs to make the DBs more homogenous? This would happen by rearranging documents across the DBs and adding new documents to the `right' DBs. Could this, if minimally employed, help the resource selection and merging of the results phases? (Elif)

In the research presented, the resource ranking is done based on the fit of the resource (DB) to the query. The discussed fit employs only textual features of the DB and assumes uniform prior distribution over the DB's. It would be interesting to examine how effective the non-textual features (used for document ranking in large scale systems) would be for resource ranking: click-through data, link-analysis, DB quality, size, personalization bias, etc. How could this be done? (Michael)

Added:

>
>

from the degree of decentralization, we can see that federated search lies between centralized search and p2p-search. today, centralized search system like Google can successfully deal with large scale data search problem by using carefully designed and well organized distributed index and search system, therefore in many cases, federated search systems are not so needed? federated search is suitable for the senarios where each site does not want to share their data. Thus, I double that elif's suggestions about rearranging documents across DBs could happen. I think that deploying search engines for each DB owners will be more possible: then federated search system like FedLemur^? can work more efficiently with a standard API instead of using a perl wrapper, the deployed search engine can use very effective search methods so that the bad impact of ineffective individual search algorithm can be reduced. My question is whether we really need to merge results from very different DBs or let the user to choose the DB to search: if a user is only interested in the "apple"'s impact for people's health and only interested in the medical database, it is not very useful even a computer DB contains a lot of terms "apple". (Xing)

<<O>> Difference Topic IRseminar08-0411 (r1.6 - 11 Apr 2008 - MichaelBendersky)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 34 to 34

Please directly add your questions and thoughts to the wiki (or email to me) about this topic by Friday 1pm at the latest. When you save your editing, please select "Release edit lock" so that other people can edit it immediately.

Distributed IR seems to somewhat resemble IR from clusters. What are the differences? Clusters contain homogeneous data whereas I assume DBs are rather heterogeneous. Could an algorithm be designed that would gather data to be updated, and do occasional updates to the distributed DBs to make the DBs more homogenous? This would happen by rearranging documents across the DBs and adding new documents to the `right' DBs. Could this, if minimally employed, help the resource selection and merging of the results phases? (Elif)

Added:

>
>

In the research presented, the resource ranking is done based on the fit of the resource (DB) to the query. The discussed fit employs only textual features of the DB and assumes uniform prior distribution over the DB's. It would be interesting to examine how effective the non-textual features (used for document ranking in large scale systems) would be for resource ranking: click-through data, link-analysis, DB quality, size, personalization bias, etc. How could this be done? (Michael)

<<O>> Difference Topic IRseminar08-0411 (r1.5 - 09 Apr 2008 - ElifAktolga)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 32 to 32

Your Questions

Added:

>
>

Distributed IR seems to somewhat resemble IR from clusters. What are the differences? Clusters contain homogeneous data whereas I assume DBs are rather heterogeneous. Could an algorithm be designed that would gather data to be updated, and do occasional updates to the distributed DBs to make the DBs more homogenous? This would happen by rearranging documents across the DBs and adding new documents to the `right' DBs. Could this, if minimally employed, help the resource selection and merging of the results phases? (Elif)

<<O>> Difference Topic IRseminar08-0411 (r1.4 - 08 Apr 2008 - JangwonSeo)

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Line: 31 to 31

CIKM 2005 Workshop on Information Retrieval in Peer-to-Peer-Networks

Your Questions

Changed:

<
<

-- JangwonSeo - 22 Feb 2008

>
>

<<O>> Difference Topic IRseminar08-0411 (r1.3 - 07 Apr 2008 - JangwonSeo)

  META TOPICPARENT  IRseminarS08 

   IR seminar, April 11, 2008 

  Distributed IR, Jangwon Seo 
   Background:
-<
<
+Distributed IR (or federated search)is searching relevant documents or ranking databases in the environment that searchable databases are distributed on networks. Our goal is to understand three sub-problems - resource description, resource selection and results merging - and various scenarios - centralized vs. decentralized and cooperative vs. uncooperative - which distributed IR should address.
->
>
+Distributed IR (or federated search)is searching relevant documents or ranking databases in the environment that searchable databases are distributed on networks. Our goal is to understand three sub-problems - resource description, resource selection and results merging - and various scenarios - centralized vs. decentralized and cooperative vs. uncooperative - which distributed IR should address. Furthermore, we would think about real world situations for distributed IR.
    Required papers:
-<
<
+years old CORI and GIOSS algorithms that the following two papers introduce are still considered as standards to overcome in distributed IR.
->
>
+years old CORI and GIOSS algorithms that the following two papers introduce are still considered as baselines for distributed IR. You can see many basic ideas to solve distributed IR problems there.
  J. Callan, "Distributed information retrieval", In W. B. Croft, editor, Advances in Information Retrieval. Kluwer Academic Publishers, 2000 : Overview for distributed IR and introduction to inference network-based CORI algorithm.

 L. Gravano and H. Garcia-Molina, "Generalizing GlOSS to Vector-Space Databases and Broker Hierarchies", in Proc. of VLDB'95 : Introduction to models used for GIOSS at Stanford.
->
>
+Although distributed IR research still stays on testbeds, there are some papers based on real world experience. The following is one of them.

 T.T.Avrahami, L.Yau, L.Si and J.Callan, "The FedLemur Project: Federated Search in the Real World", in JASIST, Volume 57, Issue 3, 2005 : Real world situations of federated search (You might access to this link only on campus because this is an e-jounral article requiring a permission.)
    Recommended:
-<
<
+The following papers relax some strict assumptions in traditional distributed IR.
->
>
+The following recent research papers relax some strict assumptions in traditional distributed IR.
  M.Shokouhi and J.Zobel, "Federated Text Retrieval From Uncooperative Overlapped Collections", in Proc. of SIGIR'07 : no assumption for disjoint collections.
->
>
+ M.Shokouhi, M.Baillie and L.Azzopardi, "Updating collection representations for federated search", in Proc. of SIGIR'07 : no assumption for static collections
  L.Si and J.Callan, "Modeling search engine effectiveness for federated search", in Proc. of SIGIR'05 : no assumption for effectiveness of individual search engines. This work is based on the same author's previous work "Unified Utility Maximization (UUM)". Although this paper provides a short review about UUM, you might want to read UUM paper.



   If you have a taste:
-<
<
+ N.Fuhr, "A decision-theoretic approach to database selection in networked IR", in ACM Transactions on Information Systems , Volume 17, Issue 3, 1999 : Another fundamental work for resource selection.

 L.Si, R.Jin, J.Callan and P.Ogilvie, "A language modeling framework for resource selection and results merging", in Proc. of CIKM'02 : You've thought that somebody in somewhere would use language modeling approaches for this task, haven't you?

 R.R.Larson, "A Logistic Regression Approach to Distributed IR" in Proc. of SIGIR'02 : A simple resource selection approach in light of learning to rank. Only 2 page poster.

 M.Shokouhi, M.Baillie and L.Azzopardi, "Updating collection representations for federated search", in Proc. of SIGIR'07 : What if collections are up-to-date? 

 G.Skobeltsyn, T.Luu, I.P.Zarko, M.Rajman and K.Aberer, "Web Text Retrieval with a P2P Query-Driven Index", in Proc. of SIGIR'07 : Although this is not in context of real distribute IR, this shows interesting view exploiting distributed IR to solve system problems.
->
>
+ N.Fuhr, "A decision-theoretic approach to database selection in networked IR", in ACM TOIS , Volume 17, Issue 3, 1999 : Another fundamental work for resource selection.

 J.Lu and J.Callan, "User modeling for full-text federated search in peer-to-peer networks", in Proc. of SIGIR'06 : If we want to reflect users' consistent interests on P2P network retrieval?

 R.Baeza-Yates, C.Castillo, F.Junqueira, V.Plachouras, F.Silvestri, Challenges on Distributed Web Retrieval, in Proc. of ICDE'07 : Overview for real distributed Web system environments in which distributed IR is likely to be required.

 G.Skobeltsyn, T.Luu, I.P.Zarko, M.Rajman and K.Aberer, "Web Text Retrieval with a P2P Query-Driven Index", in Proc. of SIGIR'07 : Efficient, effective P2P index construction based on queries.
   Related Resources  
To get more information about distributed IR, the following workshops could be good resources.

 SIGIR 2003 Workshop on Distributed Information Retrieval

 CIKM 2005 Workshop on Information Retrieval in Peer-to-Peer-Networks
->
>
+  Your Questions 
  Please directly add your questions and thoughts to the wiki (or email to me) about this topic by Friday 1pm at the latest. When you save your editing, please select "Release edit lock" so that other people can edit it immediately.
 -- JangwonSeo - 22 Feb 2008

<<O>> Difference Topic IRseminar08-0411 (r1.2 - 11 Mar 2008 - JamesAllan)

  META TOPICPARENT  IRseminarS08 

   IR seminar, April 11, 2008
-<
<
+   Topic, people leading.
->
>
+  Distributed IR, Jangwon Seo
    Background:
-<
<
->
>
+Distributed IR (or federated search)is searching relevant documents or ranking databases in the environment that searchable databases are distributed on networks. Our goal is to understand three sub-problems - resource description, resource selection and results merging - and various scenarios - centralized vs. decentralized and cooperative vs. uncooperative - which distributed IR should address.
    Required papers:
-<
<
->
>
+years old CORI and GIOSS algorithms that the following two papers introduce are still considered as standards to overcome in distributed IR. 

 J. Callan, "Distributed information retrieval", In W. B. Croft, editor, Advances in Information Retrieval. Kluwer Academic Publishers, 2000 : Overview for distributed IR and introduction to inference network-based CORI algorithm.

 L. Gravano and H. Garcia-Molina, "Generalizing GlOSS to Vector-Space Databases and Broker Hierarchies", in Proc. of VLDB'95 : Introduction to models used for GIOSS at Stanford.
    Recommended:
-<
<
->
>
+The following papers relax some strict assumptions in traditional distributed IR. 

 M.Shokouhi and J.Zobel, "Federated Text Retrieval From Uncooperative Overlapped Collections", in Proc. of SIGIR'07 : no assumption for disjoint collections.

 L.Si and J.Callan, "Modeling search engine effectiveness for federated search", in Proc. of SIGIR'05 : no assumption for effectiveness of individual search engines. This work is based on the same author's previous work "Unified Utility Maximization (UUM)". Although this paper provides a short review about UUM, you might want to read UUM paper.



   If you have a taste: 

 N.Fuhr, "A decision-theoretic approach to database selection in networked IR", in ACM Transactions on Information Systems , Volume 17, Issue 3, 1999 : Another fundamental work for resource selection.

 L.Si, R.Jin, J.Callan and P.Ogilvie, "A language modeling framework for resource selection and results merging", in Proc. of CIKM'02 : You've thought that somebody in somewhere would use language modeling approaches for this task, haven't you?

 R.R.Larson, "A Logistic Regression Approach to Distributed IR" in Proc. of SIGIR'02 : A simple resource selection approach in light of learning to rank. Only 2 page poster.

 M.Shokouhi, M.Baillie and L.Azzopardi, "Updating collection representations for federated search", in Proc. of SIGIR'07 : What if collections are up-to-date? 

 G.Skobeltsyn, T.Luu, I.P.Zarko, M.Rajman and K.Aberer, "Web Text Retrieval with a P2P Query-Driven Index", in Proc. of SIGIR'07 : Although this is not in context of real distribute IR, this shows interesting view exploiting distributed IR to solve system problems.



  Related Resources  
To get more information about distributed IR, the following workshops could be good resources.

 SIGIR 2003 Workshop on Distributed Information Retrieval

 CIKM 2005 Workshop on Information Retrieval in Peer-to-Peer-Networks
-<
<
+   Tangential but interesting:
-<
<
+  Related Resources
->
>
+-- JangwonSeo - 22 Feb 2008

<<O>> Difference Topic IRseminar08-0411 (r1.1 - 25 Feb 2008 - JamesAllan)

Line: 1 to 1

Added:

>
>

META TOPICPARENT	IRseminarS08

IR seminar, April 11, 2008

Topic, people leading.

Background:

Required papers:

Tangential but interesting:

Related Resources

View topic | Diffs | r1.11 | > | r1.10 | > | r1.9 | More

Revision r1.1 - 25 Feb 2008 - 19:22 - JamesAllan
Revision r1.11 - 11 May 2008 - 05:23 - JangwonSeo