Test Autocomplete
Perform a test where we search for important people/artists/objectTypes (the italic category below), and hope they will come up amongst the top 10-20.
- Start with a prefix of 4 letters (eg "brit", "remb" "new y"). If the term is not in the top 20, increase to 5 and 6 letters.
- Record the prefix length and the rank
- If an "unimportant" term (eg "Paris, Texas") ranks above the important term (eg "Paris France"), record this
Coreferenced terms (having 2 URIs) are marked in bold, since they may have some special behavior
Mitac has implemented this as an automated test (AutocompleteTest.testRDFRank()), see results below.
Test results from the backend:
Term | URI | Prefix | Rank | "Unimportant" Terms (with numeric rank) |
---|---|---|---|---|
Amsterdam | rkd-plaats:amsterdam | 4 | 0.25 | |
Athens | id:place/x22744 | 4 | 0.18 | British School at Athens 0.25 |
British Museum | id:the-british-museum | 4 | 0.52 | |
London | rkd-plaats:londen | 4 | 0.27 | |
New York | rkd-plaats:new-york-city | 5 | 0.13 | New York state (0.19), New York (staat) (0.16), |
Paris | rkd-plaats:parijs | 4 | 0.25 | |
Washington | id:place/x46418 | 4 | 0.26 | drawn 0.27 |
Rembrandt | rkd-artist:Rembrandt | 4 | 0.05 | |
Leonardo | personInstition:35533 | 4 | 0.07 | Sir Charles Leonard Woolley 0.08 |
Michelangelo | personInstition:38368 | 4 | 0.01 | Michigan Avenue 0.25, Michael Grange 0.09, Dr Michael David Peter O'Hanlon 0.07, Michigan state 0.05, George Anastase Michaelides 0.05, Michiel Jansz. Mierevelt 0.04, Michoac?n 0.02, Dr Michael Willis 0.02, Louis Michel Lepelletier de Saint-Fargeau 0.02, Pont Saint-Michel 0.02, Saint-Michel, Quai 0.02, Wayne County Michigan 0.02, Michael Bromberg 0.01, Michael Mitchiner 0.01, Michael Ryder 0.01 |
Drawing | idThes:x6544 | 4 | 0.25 | drawn 0.27, Prints and Drawings 0.26 |
Painting | rkd-object:painting | 6 | 0.0 | painting 0.09, arts and sciences 0.01 |
Test results from the UI (here Rank signifies the place in the autossugested list):
Term | FR | Prefix | Rank | "Unimportant" terms |
---|---|---|---|---|
Places | ||||
Amsterdam | none | 4 | 1st | |
Amsterdam | from | 4 | 1st | |
Athens | none | 4 | 3rd | British School of Athens [BM Person/Institution], Athens [BM Place] |
Athens | from | 4 | 1st | |
British Museum | ||||
London | ||||
New York | none | 5 | 3rd | New York state [BM Place], New York (staat) [RKD Place] |
New York | from | 5 | 3rd | New York state [BM Place], New York (staat) [RKD Place] |
Paris | ||||
Uhr | ||||
Washington | ||||
Artists | ||||
Rembrandt | ||||
Leonardo | ||||
Michelangelo | none | 4 | 16th | |
Michelangelo | from | 4 | 10th | |
Objects | ||||
Drawing | none | 4 | 3rd | drawn [BM Technique], Prints and Drawings [BM Departments] |
Drawing | from | 4 | 1st | |
Painting |
Test RDFRank
The following queries showed that RDFRank has reasonable relevance on the data we have (tested on 115k BM objects).
- But they don't involve a Lucene search, so to be sure we also did Test Autocomplete.
- RDFRank is only 2 decimals and the spread is not so large. But still, it has sufficient discriminative power for 50-100 results.
(we don't need to investigate histograms, just top 100)
Places
PREFIX rank: <http://www.ontotext.com/owlim/RDFRank#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> SELECT ?place ?label ?rank WHERE { ?place skos:inScheme <http://collection.britishmuseum.org/id/place>; rank:hasRDFRank ?rank; skos:prefLabel ?label . } ORDER BY DESC(?rank) LIMIT 100
It returns first the continents and large regions (eg British Isles) because they have a lot of subplaces (P88_consists_of, P89i_contains) and rso:FR7_from_place inferred through the place hierarchy.
place | label | rank |
http://collection.britishmuseum.org/id | Europe | 0.38 |
http://collection.britishmuseum.org/id | Asia | 0.34 |
http://collection.britishmuseum.org/id | British Isles | 0.31 |
http://collection.britishmuseum.org/id | England | 0.30 |
http://collection.britishmuseum.org/id | North America | 0.29 |
http://collection.britishmuseum.org/id | Americas | 0.29 |
http://collection.britishmuseum.org/id | Oceania | 0.28 |
rkd-plaats:londen | London England | 0.27 |
http://collection.britishmuseum.org/id | Africa | 0.27 |
http://collection.britishmuseum.org/id | Melanesia | 0.27 |
http://collection.britishmuseum.org/id | USA | 0.27 |
Cities
Now let's see which are the most popular "town or city" (K) or "village or settlement" (O)
SELECT ?place ?label ?rank WHERE { ?place skos:inScheme <http://collection.britishmuseum.org/id/place>; crm:P2_has_type ?type; rank:hasRDFRank ?rank; skos:prefLabel ?label . FILTER (?type=<http://collection.britishmuseum.org/id/place/type/K> || ?type=<http://collection.britishmuseum.org/id/thesauri/place/type/O>) } ORDER BY DESC(?rank) LIMIT 100
Some of the important cities indeed come first.
Some are a bit curious (Samarkand, Quirigua) but I checked Samarkand and indeed we have about 100 objects from there, and depicting it (P62_depicts)
place | label | rank |
rkd-plaats:londen | London England | 0.27 |
http://collection.britishmuseum.org/id | Washington DC | 0.26 |
http://collection.britishmuseum.org/id | Edo | 0.26 |
rkd-plaats:amsterdam | Amsterdam Netherlands | 0.25 |
rkd-plaats:parijs | Paris France | 0.25 |
http://collection.britishmuseum.org/id | Copan city | 0.25 |
http://collection.britishmuseum.org/id | Quirigua | 0.25 |
http://collection.britishmuseum.org/id | Rome city | 0.25 |
http://collection.britishmuseum.org/id | Samarkand | 0.25 |
http://collection.britishmuseum.org/id | Jingdezhen | 0.25 |
http://collection.britishmuseum.org/id | Begram | 0.25 |
http://collection.britishmuseum.org/id | Palenque | 0.25 |
Organizations and People
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX rank: <http://www.ontotext.com/owlim/RDFRank#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> SELECT ?agent ?label ?rank WHERE { ?agent skos:inScheme <http://collection.britishmuseum.org/id/person-institution>; rank:hasRDFRank ?rank; rdfs:label ?label . } ORDER BY DESC(?rank) LIMIT 100
The BM comes up first. Hurray!
agent | label | rank |
id:the-british-museum | The British Museum | 0.52 |
personInstition:79656 | F W Surridge | 0.28 |
personInstition:53455 | Egypt Exploration Fund | 0.27 |
personInstition:74678 | Dr Alfred Percival Maudslay | 0.27 |
personInstition:182178 | W S Webb Museum of Anthropology (University of Kentucky) | 0.26 |
personInstition:184044 | Sir Percival David Foundation of Chinese Art | 0.26 |
personInstition:187341 | Prof Arthur R Miller | 0.26 |
personInstition:150827 | Dr William Yewdale Adams | 0.26 |
personInstition:53456 | Egypt Exploration Society | 0.26 |
personInstition:56494 | Peregrine Edward Towneley | 0.26 |
personInstition:57503 | British Salonica Force | 0.26 |
personInstition:63099 | Unknown Ruler | 0.26 |
personInstition:104632 | British Library | 0.26 |
People
Only people:
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX rank: <http://www.ontotext.com/owlim/RDFRank#> PREFIX skos: <http://www.w3.org/2004/02/skos/core#> PREFIX crm: <http://erlangen-crm.org/current/> SELECT ?person ?label ?rank WHERE { ?person skos:inScheme <http://collection.britishmuseum.org/id/person-institution>; a crm:E21_Person; rank:hasRDFRank ?rank; rdfs:label ?label . } ORDER BY DESC(?rank) LIMIT 100
person | label | rank | comments |
personInstition:74678 | Dr Alfred Percival Maudslay | 0.27 | A number of Mayan objects are marked as "produced by" him |
personInstition:187341 | Prof Arthur R Miller | 0.26 | pledged his collection of 1,800 prints by Utagawa Kuniyoshi (q.v.) to the Museum. (P49i_is_former_or_current_keeper_of) |
personInstition:150827 | Dr William Yewdale Adams | 0.26 | Anthropologist and archaeologist. Found a lot of objects, P49i_is_former_or_current_keeper_of even more |
personInstition:56494 | Peregrine Edward Towneley | 0.26 | Cousin of Charles Townley (q.v.), whose collection he inherited and sold to BM in 1814. |
personInstition:80988 | Samuel Hazzledine Warren | 0.26 | In 1936 ... his collection ... bequethed ... to the British Museum. |
personInstition:121323 | William Henry Blackmore | 0.26 | |
personInstition:172864 | Prof Ernst Cohn-Wiener | 0.25 | |
personInstition:31869 | Wenceslaus Hollar | 0.25 | |
personInstition:887 | Sir Augustus Wollaston Franks | 0.25 | |
personInstition:149630 | Dr Georgina Herrmann | 0.25 | |
personInstition:3438 | Utagawa Kuniyoshi | 0.25 | Lots of prints by him (production P14_carried_out_by) |
Counts - temp table by Mitac
!TOP ITEM, prefix: 'Amst' (Amsterdam) | Amsterdam Avenue | 5014.0 | ||
Amsterdam | rkd-plaats:amsterdam | 4 | 3966.0 | Amsterdam Avenue (5014.0), |
!TOP ITEM, prefix: 'Athe' (Athens) | British School at Athens | 5818.0 | ||
Athens | id:place/x22744 | 4 | 2251.0 | British School at Athens (5818.0), Athens County (4583.0), Athena/Minerva (2308.0), |
!TOP ITEM, prefix: 'Brit' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'Briti' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'Britis' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British ' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British M' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British Mu' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British Mus' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British Muse' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British Museu' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'British Museum' (British Museum) | The British Museum | 2098944.0 | ||
!TOP ITEM, prefix: 'Lond' (London) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'Londo' (London) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'London' (London) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'Lond' (London England) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'Londo' (London England) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'London' (London England) | School of Oriental and African Studies, London | 8687.0 | ||
!TOP ITEM, prefix: 'London ' (London England) | School of Oriental and African Studies, London | 8687.0 | ||
London England | rkd-plaats:londen | 8 | 27341.0 | |
!TOP ITEM, prefix: 'New ' (New York) | New Atlantis Foundation | 42.0 | ||
!TOP ITEM, prefix: 'New Y' (New York) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New Yo' (New York) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New Yor' (New York) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New York' (New York) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New ' (New York, City) | New Atlantis Foundation | 42.0 | ||
!TOP ITEM, prefix: 'New Y' (New York, City) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New Yo' (New York, City) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New Yor' (New York, City) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New York' (New York, City) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New York,' (New York, City) | New York state | 5687.0 | ||
!TOP ITEM, prefix: 'New York, ' (New York, City) | New York state | 5687.0 | ||
New York, City | rkd-plaats:new-york-city | 11 | 5918.0 | |
!TOP ITEM, prefix: 'Pari' (Paris) | Passy Paris | 1129.0 | ||
!TOP ITEM, prefix: 'Paris' (Paris) | Caddo Parish | 4544.0 | ||
!TOP ITEM, prefix: 'Pari' (Paris France) | Passy Paris | 1129.0 | ||
!TOP ITEM, prefix: 'Paris' (Paris France) | Caddo Parish | 4544.0 | ||
!TOP ITEM, prefix: 'Paris ' (Paris France) | Caddo Parish | 4544.0 | ||
Paris France | rkd-plaats:parijs | 7 | 6558.0 | |
Washington | id:place/x46418 | 4 | 15762.0 | |
!TOP ITEM, prefix: 'Remb' (Rembrandt) | Rembrandtplein (Amsterdam) | 764.0 | ||
Rembrandt | rkd-artist:Rembrandt | 4 | 496.0 | Rembrandtplein (Amsterdam) (764.0), |
!TOP ITEM, prefix: 'Leon' (Leonardo) | Leonard Charles Wyon | 593.0 | ||
!TOP ITEM, prefix: 'Leona' (Leonardo) | Leonard Charles Wyon | 593.0 | ||
Leonardo | personInstition:35533 | 5 | 335.0 | Leonard Charles Wyon (593.0), |
!TOP ITEM, prefix: 'Mich' (Michelangelo) | Dr Michael David Peter O'Hanlon | 1399.0 | ||
!TOP ITEM, prefix: 'Miche' (Michelangelo) | Louis Michel Lepelletier de Saint-Fargeau | 357.0 | ||
!TOP ITEM, prefix: 'Michel' (Michelangelo) | Louis Michel Lepelletier de Saint-Fargeau | 357.0 | ||
Michelangelo | personInstition:38368 | 7 | 120.0 | |
!TOP ITEM, prefix: 'Draw' (Drawing) | Prints and Drawings | 29604.0 | ||
Drawing | idThes:x6544 | 4 | 20997.0 | Prints and Drawings (29604.0), |
!TOP ITEM, prefix: 'Pain' (Painting) | Thomas Paine | 31.0 | ||
!TOP ITEM, prefix: 'Paint' (Painting) | Altenburg Painter | 37.0 | ||
!TOP ITEM, prefix: 'Painti' (Painting) | painting | 3832.0 | ||
Painting | rkd-object:painting | 6 | 45.0 | painting (3832.0), arts and sciences (207.0), tomb-painting (64.0), wall-painting (56.0), |