How does Porter Stemmer work?
Anonymous Quiz
64%
Remove suffixes based on rules
18%
Using a dictionary
18%
Using AI
0%
Translation
Purpose of stemming in retrieval?
Anonymous Quiz
50%
Increase recall
20%
Increase precision only
30%
Reduce data size
0%
No use
Difference between lemmatization and stemming?
Anonymous Quiz
73%
Lemmatization uses dictionary; stemming uses rules
9%
Opposite
9%
No difference
9%
Both delete
Why is stemming important for morphologically rich languages like Arabic?
Anonymous Quiz
55%
Significantly improves recall
27%
Reduces storage only
9%
Increases precision only
9%
No effect
Which represents correct preprocessing steps?
Anonymous Quiz
72%
Tokenization → Stop Words Removal → Stemming
17%
Stemming → Stop Words → Tokenization
6%
Normalization → Stemming → Translation
6%
Case Folding → Compression
❤1
What is the correct definition of Precision?
Anonymous Quiz
50%
The fraction of relevant documents that were retrieved
17%
The fraction of retrieved documents that are relevant
17%
The total number of relevant documents retrieved
17%
The ratio of relevant documents to the collection size
What does a perfect Recall score of 1.0 indicate?
Anonymous Quiz
29%
No irrelevant documents were retrieved
29%
Every retrieved document is relevant
14%
All relevant documents were retrieved
29%
The system retrieved all documents in the collection
Which component is essential for the Cranfield evaluation paradigm?
Anonymous Quiz
55%
Real-time user feedback
36%
A set of relevance judgments
0%
Social media data
9%
Mobile app interface
What is the primary use of the F1-Score?
Anonymous Quiz
27%
To measure indexing speed
55%
To combine Precision and Recall into one metric
18%
To evaluate user satisfaction
0%
To calculate storage requirements
👎1🥰1
What is the purpose of the Qrels file in a test collection?
Anonymous Quiz
18%
To store the original documents
18%
To log user click-through rates
64%
To record relevance judgments for query-document pairs
0%
To contain the search engines source code
What does a high Precision value typically signify about a system?
Anonymous Quiz
27%
It finds all relevant documents effectively
64%
Its results contain mostly relevant documents
0%
It has a very fast response time
9%
It can handle complex queries well
In the Fβ measure, if β is greater than 1, what is emphasized?
Anonymous Quiz
10%
Precision is more important than Recall
50%
Recall is more important than Precision
40%
Both are equally important
0%
The measure is invalid
What is the main focus of effectiveness evaluation?
Anonymous Quiz
20%
How quickly the system returns results
80%
The quality and relevance of returned documents
0%
How easy the system is to use
0%
The size of the document index
What are the three necessary components of a reusable test collection?
Anonymous Quiz
0%
Users,Tasks, and Metrics
91%
Documents,Queries, and Relevance Judgments
9%
Algorithms,Indexes, and Rankings
0%
Hardware,Software, and Networks
What is the key challenge in the Precision-Recall trade-off?
Anonymous Quiz
45%
Achieving high scores in both is usually easy
27%
Improving one often reduces the other
27%
They are not related to each other
0%
Recall is always easier to optimize
What type of retrieval system are set-based measures like Precision best suited for?
Anonymous Quiz
20%
Ranked retrieval systems
40%
Boolean retrieval systems
20%
Neural network models
20%
Real-time streaming search
What does Recall measure?
Anonymous Quiz
17%
The purity of the search results
58%
The completeness of the search results
25%
The speed of the search
0%
The users satisfaction level
What is the harmonic mean of Precision and Recall called?
Anonymous Quiz
50%
F1-Score
17%
Arithmetic Mean
17%
Geometric Mean
17%
Weighted Average
In evaluation, what do relevance judgments provide?
Anonymous Quiz
9%
A measure of system speed
73%
Ground truth data for evaluation
18%
User interface preferences
0%
Hardware performance metrics
What is NOT part of the standard Cranfield evaluation setup?
Anonymous Quiz
25%
Document Collection
17%
Set of Queries
17%
Relevance Judgments
42%
Live user interaction
What is the primary goal of IR system evaluation?
Anonymous Quiz
23%
To measure only processing speed
62%
To assess effectiveness and/or efficiency
8%
To determine visual design quality
8%
To count the number of documents