Cross-Language Overlap Statistics

Cross-Language Overlap Statistics


General statistics about the DBpedia 2014 release are provided on the Data Set Statistics page. Below we analyze for the canonicalized, mapping-based data sets to which extent the same instance is described in different languages.

We consider the DBpedia versions in the following 28 languages: en, ar, bn, eu, ga, hr, nl, cs, de, el, es, fr, it, pl, pt, bg, ca, hu, ko, ru, sl, tr, id, ja, be, sr, cy, sk. The last 4 are the new languages in the 2014 release with respect to 3.9, Belarusian, Serbian, Welsh and Slovak.

A thing (instance) is identified with the same URI within all canonicalized data sets. The mapping-based infobox extractor normalizes the property names that are used in different languages to refer to the same property to a single English property name. This allows us to 'merge' the datasets from the 28 languages into a single multi-lingual version which is analyzed below.

Cross-language overlap statistics for DBpedia 3.9 can be found here. Below we compare the numbers between the 2014, 3.9 and 3.8 releases.



1 Overall Number of Instances and Statements for Selected Classes

In the table below we report the overall number of instances, mapping-based infobox statements and distinct mapping-based infobox properties (for which all statements that have the same predicate and refer to the same instance are counted as a single property) for a number of important DBpedia classes.

The number 1,471,254 for the class Person means that all 28 language versions together describes 1,471,254 different persons. As we will see below, a single person can be described in multiple languages. The number is also higher than the number of persons described in the canonilized English infobox data set (1,445,104), as there might be an infobox on a non-English page describing a person while there is no infobox on the English page describing the same person. Out of the same reason, the number of distinct properties in the merged version is 1,654 compared to 1,367 distinct properties in English version alone.

The Instances 3.2 column contains the number of instances that were contained in DBpedia 3.2, the 2009 edition of DBpedia in which the ontology was first introduced. Note that the 3.2 numbers refer to English DBpedia only, while the 3.8, 3.9 and 2014 numbers refer to the merge of all languages. For some of the DBpedia classes 3.2 data is not available.


Classes in bold (e.g. Work) are top-level, i.e. subclasses of owl:Thing, in the DBpedia ontology, classes in italic (e.g. MusicalWork) are on the 2nd level and the rest (e.g. Album) are on the 3rd level of the class hierarchy.
  Instances       Statements     Distinct Properties    
  2014 3.9 3.8 3.2 2014 3.9 3.8 2014 3.9 3.8
Person 1,471,254 979,053 871,630 214,179 45,486,871 25,692,893 18,323,794 10,809,876 7,760,313 6,195,234
Artist 164,501 128,912 100,793 69,320 9,520,443 5,693,303 3,723,440 1,728,485 1,390,336 998,616
Actor 38,881 31,861 25,340 26,047 3,021,143 1,759,089 1,070,066 444,281 372,112 247,690
MusicalArtist 67,142 57,488 46,364 34,520 4,414,488 2,979,826 2,069,152 803,249 715,093 550,225
Athlete 305,848 267,977 217,067 75,884 15,243,575 9,805,423 6,373,136 3,433,084 2,586,730 1,853,233
Politician 61,636 39,584 41,126 476 2,907,418 1,587,472 1,407,548 656,829 486,174 454,209
Place 818,539 723,757 643,260 248,470 34,622,810 32,250,749 24,698,893 8,916,657 9,979,392 8,026,305
Building 77,852 76,107 65,355 23,443 1,403,744 1,321,828 1,058,610 567,780 634,144 530,010
Airport 13,958 12,566 11,675 7,973 445,357 449,272 352,377 113,717 153,614 138,944
Bridge 4,239 3,765 3,425 1,433 109,884 78,418 66,968 41,263 38,846 34,470
Skyscraper 1,457 795 68 2,053 73,315 35,403 3,091 20,012 11,415 719
PopulatedPlace 518,727 467,259 424,291 182,019 27,984,008 26,584,052 20,565,679 6,723,089 7,694,182 6,212,991
River 29,254 27,818 26,892 10,800 937,984 806,429 681,782 247,670 229,762 208,146
Organisation 266,551 228,286 206,670 76,608 7,789,539 6,256,810 4,940,190 2,322,552 2,282,581 2,029,620
SportsLeague 5,016 3,853 2,746 192,697 124,224 70,475 46,060 36,378 23,379
SportsTeam 35,287 25,336 19,113 8,672 1,328,942 1,025,695 565,625 246,719 204,706 150,382
Band 33,183 31,344 29,101 1,744,474 1,449,829 1,126,744 321,526 340,016 298,743
Company 64,308 55,320 48,989 20,217 1,720,791 1,292,526 1,048,251 592,987 524,303 445,758
Educ.Institution 51,261 47,101 43,250 21,108 1,264,402 1,101,287 958,257 505,803 543,322 493,792
Work 462,124 410,676 360,808 193,085 14,846,601 12,641,898 9,649,228 4,409,805 4,153,448 3,566,511
Book 64,965 55,694 44,339 15,881 2,143,211 1,721,132 1,111,960 504,943 517,959 408,724
Film 92,490 81,833 75,067 34,734 4,167,029 3,408,374 2,663,487 991,037 923,070 787,129
MusicalWork 185,644 169,811 160,383 104,163 5,902,714 5,213,842 4,116,625 1,894,464 1,794,704 1,635,655
Album 134,199 128,514 122,729 74,780 4,797,348 4,381,101 3,400,942 1,370,621 1,360,640 1,224,746
Single 47,230 42,933 42,393 25,595 1,703,790 1,543,304 1,226,636 606,556 576,181 534,023
Software 33,154 30,495 28,930 5,700 966,871 932,543 731,138 269,791 272,488 242,411
TelevisionShow 31,843 28,559 24,784 10,231 945,765 788,740 565,136 401,712 342,230 282,594
Species 278,793 234,512 205,231 90,858 7,179,294 6,375,368 4,415,050 2,522,806 2,166,889 1,836,221
Activity 2,725 1,707 1,490 39,312 14,562 10,282 11,812 6,744 5,213
AnatomicalStructure 4,447 4,454 4,217 3,616 35,672 39,596 36,179 18,034 25,105 23,732
Biomolecule 18,633 17,300 12,108 105,082 113,106 72,444 27,048 54,898 42,836
CelestialBody 35,489 21,697 19,839 708,736 536,325 465,133 231,143 205,953 185,628
ChemicalSubstance 13,644 12,064 10,849 310,966 213,352 140,466 62,136 71,102 51,687
Device 31,268 28,961 25,983 239,821 220,662 191,195 125,108 122,024 108,322
Event 74,104 57,775 44,481 7,855 1,736,157 1,377,047 830,068 431,768 380,148 270,979
Food 6,606 4,339 1,671 45,620 35,420 14,274 22,816 18,771 7,930
Disease 6,628 6,021 5,776 3,180 67,183 84,070 58,217 19,732 30,600 27,917
Drug 5,620 5,396 5,197 3,134 64,726 69,472 56,580 16,940 38,299 31,609
EthnicGroup 4,924 4,163 3,820 607 81,321 56,146 46,043 30,028 21,072 18,485
Holiday 1,220 898 750 10,073 8,184 5,914 4,734 4,047 3,036

 

2 Cross-Language Instance Overlap

Next we try to measure to which extent the multi-lingual DBpedia dataset obtained by 'merging' the 28 language versions, is actually multi-lingual. In the table below, the Instances column contains the total number of instances per class across all languages, the 1 column contains the number of instances that are contained only in a single out of the 28 languages, the 2 column contains the number of instances that are contained in 2 languages but not in 3 or more languages, etc. So, for example, 2,729 Persons are described in 12 languages but not in 13 or more languages. If for the Person class we sum 2 to >20 columns, we get that 446,234 Persons are described in 2 or more languages. This might seem small compared to the total of 1,471,254 Persons in total (Instances column), but come back to the second table on the Data Set Statistics page and note there are 1,445,104 Persons in English DBpedia and only 189,448 Persons in the second large Italian DBpedia. Therefore, most of the 1,025,020 Persons described in just one language are very likely to be the ones present in English DBpedia only.
  Instances 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 >20
Person 1,471,254 1,025,020 205,891 94,861 50,147 29,994 18,698 12,295 8,214 5,922 4,455 3,580 2,729 2,156 1,736 1,474 1,147 841 580 450 333 731
Artist 164,501 54,587 38,456 23,216 14,361 9,114 5,937 4,165 3,187 2,478 1,906 1,518 1,172 949 705 586 497 377 295 239 199 557
Actor 38,881 3,075 10,047 6,984 4,738 3,257 2,187 1,625 1,319 1,046 852 699 566 467 381 300 283 226 174 134 113 408
MusicalArtist 67,142 24,108 14,447 8,968 5,387 3,592 2,488 1,862 1,440 1,152 867 688 536 406 269 226 187 131 104 84 73 127
Athlete 305,848 155,393 62,832 35,128 19,423 11,830 6,874 4,414 2,657 1,775 1,295 1,047 792 594 500 386 298 220 158 99 69 64
Politician 61,636 28,541 13,776 6,574 3,474 2,189 1,536 1,114 842 655 596 459 359 305 277 280 217 130 87 78 53 94
Place 818,539 396,551 141,511 77,741 40,821 27,725 22,451 17,090 16,755 28,750 25,289 14,147 5,184 1,739 764 550 374 336 234 215 201 111
Building 77,852 61,888 9,057 3,464 1,563 759 428 252 167 105 64 49 25 10 9 7 1 2 1 1 0 0
Airport 13,958 8,456 2,251 1,168 681 395 244 223 154 126 105 71 44 24 10 4 1 1 0 0 0 0
Bridge 4,239 2,774 743 274 290 78 34 19 9 9 5 2 2 0 0 0 0 0 0 0 0 0
Skyscraper 1,457 98 463 315 185 125 92 61 45 31 18 15 6 2 1 0 0 0 0 0 0 0
PopulatedPlace 518,727 185,780 93,663 58,859 31,618 22,950 19,776 15,482 15,618 27,908 24,656 13,707 4,878 1,524 630 436 304 273 193 183 185 104
River 29,254 16,294 7,179 2,279 864 693 512 320 285 190 123 109 99 75 52 51 35 33 23 22 13 3
Organisation 266,551 191,812 33,197 14,675 8,317 4,988 3,394 2,354 1,714 1,316 1,066 773 673 538 383 309 289 214 181 141 97 120
SportsLeague 5,016 2,207 818 493 431 452 323 175 78 15 2 3 7 12 0 0 0 0 0 0 0 0
SportsTeam 35,287 18,229 6,107 3,653 2,311 1,123 761 590 397 319 314 235 252 233 158 134 131 102 97 79 39 23
Band 33,183 17,492 5,576 2,784 1,694 1,178 835 686 593 508 406 314 251 186 130 117 111 70 60 51 51 90
Company 64,308 44,846 9,138 3,952 2,161 1,280 908 586 433 281 214 142 100 77 54 34 34 31 16 9 6 6
Educ.Institution 51,261 44,109 4,027 1,235 663 409 241 158 110 101 52 43 31 31 18 12 5 6 6 2 1 1
Work 462,124 279,382 79,175 35,459 19,356 12,521 8,775 6,264 4,813 3,798 2,998 2,226 1,737 1,354 1,100 821 685 532 428 293 154 253
Book 64,965 36,453 10,577 5,062 2,951 1,973 1,573 1,179 921 779 632 485 396 378 362 331 268 227 180 99 55 84
Film 92,490 45,024 18,525 8,766 4,990 3,190 2,402 1,743 1,396 1,229 1,097 886 735 581 480 317 292 215 195 167 92 168
MusicalWork 185,644 118,979 30,948 13,291 7,018 4,534 3,004 2,192 1,683 1,236 875 585 424 289 180 134 98 73 53 29 11 8
Album 134,199 80,549 23,100 10,296 5,860 4,034 2,745 2,060 1,611 1,203 866 581 421 287 180 134 98 73 53 29 11 8
Single 47,230 27,148 8,211 4,386 2,420 1,619 1,096 698 536 384 275 160 102 79 52 31 21 10 0 2 0 0
Software 33,154 16,000 6,499 3,593 2,055 1,449 1,049 727 508 390 279 203 130 79 73 39 37 22 12 5 4 1
TelevisionShow 31,843 20,065 5,274 2,119 1,324 914 683 473 329 202 167 97 77 54 30 25 7 2 1 0 0 0
Species 278,793 107,610 85,513 31,850 17,684 12,491 7,428 4,895 3,266 2,256 1,759 1,248 983 698 479 314 171 104 44 0 0 0
Activity 2,725 1,518 579 295 141 97 47 17 8 7 4 2 5 1 2 1 1 0 0 0 0 0
AnatomicalStructure 4,447 3,410 542 360 118 10 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Biomolecule 18,633 12,128 4,004 1,152 1,165 121 44 15 3 1 0 0 0 0 0 0 0 0 0 0 0 0
CelestialBody 35,489 14,777 4,429 2,551 3,771 3,814 1,017 1,011 1,206 1,133 975 699 59 45 1 1 0 0 0 0 0 0
ChemicalSubstance 13,644 1,147 3,552 2,675 1,822 1,269 1,046 723 579 485 263 72 11 0 0 0 0 0 0 0 0 0
Device 31,268 28,431 1,447 637 347 171 90 59 39 27 13 5 1 1 0 0 0 0 0 0 0 0
Event 74,104 44,242 14,049 6,623 3,522 2,019 1,240 825 507 271 214 145 109 97 65 42 51 39 29 14 0 1
Food 6,606 6,194 324 67 12 5 2 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0
Disease 6,628 3,211 1,082 682 472 335 279 162 124 89 68 42 25 24 17 9 3 4 0 0 0 0
Drug 5,620 553 2,795 800 462 308 251 225 152 54 12 7 1 0 0 0 0 0 0 0 0 0
EthnicGroup 4,924 3,690 686 279 109 50 39 39 17 8 5 2 0 0 0 0 0 0 0 0 0 0
Holiday 1,220 816 263 94 35 6 5 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0

 

3 Cross-Language Property Overlap

The table below contains the statistics on properties of the PopulatedPlace class that are frequently used in different languages. We report the number of instances that have this property in exactly 1, 2, 3, ..., 8 and from 9 to 28 languages.

Property Total 1 2 3 4 5 6 7 8 >8
rdf:type 593,708 185,780 93,663 58,859 31,618 22,950 19,776 15,482 15,618 74,981
foaf:name 528,867 203,026 107,359 52,475 27,552 24,068 29,491 30,560 21,740 16,298
wgs8:long 466,097 169,386 94,660 52,543 27,120 22,014 18,277 21,880 24,161 18,028
wgs8:lat 466,097 169,386 94,661 52,543 27,119 22,012 18,279 21,879 24,162 18,028
dbpedia-owl:country 396,868 306,214 81,466 6,279 1,862 623 220 91 57 28
dbpedia-owl:populationTotal 378,789 137,520 70,031 37,746 28,667 41,815 34,033 16,320 5,047 3,805
dbpedia-owl:isPartOf 346,941 343,825 3,054 62 0 0 0 0 0 0
dbpedia-owl:timeZone 267,019 214,371 27,197 23,833 1,468 104 32 9 5 0
dbpedia-owl:type 204,844 179,378 24,951 504 9 1 0 1 0 0
dbpedia-owl:elevation 198,623 85,095 36,887 24,282 21,342 13,252 14,681 1,922 514 324
dbpedia-owl:areaTotal 194,806 76,875 67,447 30,513 14,294 4,092 802 174 137 236
dbpedia-owl:name 171,451 171,448 3 0 0 0 0 0 0 0
dbpedia-owl:area 142,757 76,457 32,521 33,744 34 1 0 0 0 0
dbpedia-owl:populationDensity 140,218 84,441 44,823 8,558 1,682 191 73 34 52 182
dbpedia-owl:censusYear 136,933 91,766 36,083 5,874 2,445 765 0 0 0 0
dbpedia-owl:region 129,253 57,132 19,703 7,693 3,663 8,290 15,230 11,612 4,136 897
dbpedia-owl:administrativeDistrict 127,821 112,512 14,715 594 0 0 0 0 0 0
foaf:homepage 120,057 36,588 23,677 15,010 12,046 9,844 6,820 9,628 2,694 1,875
dbpedia-owl:leaderTitle 107,980 77,684 21,939 5,735 1,303 504 178 92 53 246

The table below contains the same type of statistics on properties of the Person class.

Property Total 1 2 3 4 5 6 7 8 >8
rdf:type 1,497,388 1,025,020 205,891 94,861 50,147 29,994 18,698 12,295 8,214 26,134
foaf:name 1,199,478 803,720 185,139 77,573 40,631 23,641 14,542 9,505 6,377 19,175
dbpedia-owl:birthYear 978,162 806,919 155,232 11,706 3,792 470 41 2 0 0
dbpedia-owl:birthDate 772,431 604,228 111,606 35,477 14,927 5,285 785 111 10 1
dbpedia-owl:birthPlace 655,831 437,574 108,666 44,646 21,233 11,873 7,410 4,832 3,303 8,147
dbpedia-owl:deathYear 453,733 381,110 67,307 4,325 914 71 6 0 0 0
dbpedia-owl:team 340,987 296,259 28,524 8,827 2,991 1,553 1,004 696 531 301
dbpedia-owl:deathDate 328,856 277,341 37,324 9,850 3,408 738 157 31 3 2
dbpedia-owl:deathPlace 215,673 148,041 35,185 13,628 6,259 3,448 2,088 1,373 881 2,385
dbpedia-owl:currentMember 205,382 205,089 270 23 0 0 0 0 0 0
dbpedia-owl:activeYearsStartYear 194,423 135,241 32,598 11,455 4,983 2,941 1,913 1,369 923 1,500
dbpedia-owl:squadNumber 189,739 189,739 0 0 0 0 0 0 0 0
dbpedia-owl:occupation 186,788 152,785 20,980 6,844 3,122 1,612 717 322 156 125
dbpedia-owl:position 183,744 107,421 32,208 15,390 8,825 5,329 3,517 2,244 1,524 3,643
dbpedia-owl:height 178,217 103,005 40,232 14,962 7,389 3,944 2,398 1,499 1,156 1,816
dbpedia-owl:nationality 168,150 144,435 17,780 3,714 1,368 457 196 102 38 30
foaf:surname 166,716 165,198 1,517 1 0 0 0 0 0 0