Cross-Language Overlap Statistics

General statistics about the DBpedia 2014 release are provided on the Data Set Statistics page. Below we analyze for the canonicalized, mapping-based data sets to which extent the same instance is described in different languages.

We consider the DBpedia versions in the following 28 languages: en, ar, bn, eu, ga, hr, nl, cs, de, el, es, fr, it, pl, pt, bg, ca, hu, ko, ru, sl, tr, id, ja, be, sr, cy, sk. The last 4 are the new languages in the 2014 release with respect to 3.9, Belarusian, Serbian, Welsh and Slovak.

A thing (instance) is identified with the same URI within all canonicalized data sets. The mapping-based infobox extractor normalizes the property names that are used in different languages to refer to the same property to a single English property name. This allows us to 'merge' the datasets from the 28 languages into a single multi-lingual version which is analyzed below.

Cross-language overlap statistics for DBpedia 3.9 can be found here. Below we compare the numbers between the 2014, 3.9 and 3.8 releases.

1 Overall Number of Instances and Statements for Selected Classes

In the table below we report the overall number of instances, mapping-based infobox statements and distinct mapping-based infobox properties (for which all statements that have the same predicate and refer to the same instance are counted as a single property) for a number of important DBpedia classes.

The number 1,471,254 for the class Person means that all 28 language versions together describes 1,471,254 different persons. As we will see below, a single person can be described in multiple languages. The number is also higher than the number of persons described in the canonilized English infobox data set (1,445,104), as there might be an infobox on a non-English page describing a person while there is no infobox on the English page describing the same person. Out of the same reason, the number of distinct properties in the merged version is 1,654 compared to 1,367 distinct properties in English version alone.

The Instances 3.2 column contains the number of instances that were contained in DBpedia 3.2, the 2009 edition of DBpedia in which the ontology was first introduced. Note that the 3.2 numbers refer to English DBpedia only, while the 3.8, 3.9 and 2014 numbers refer to the merge of all languages. For some of the DBpedia classes 3.2 data is not available.

Classes in bold (e.g. Work) are top-level, i.e. subclasses of owl:Thing, in the DBpedia ontology, classes in italic (e.g. MusicalWork) are on the 2nd level and the rest (e.g. Album) are on the 3rd level of the class hierarchy.

	Instances				Statements			Distinct Properties
	2014	3.9	3.8	3.2	2014	3.9	3.8	2014	3.9	3.8
Person	1,471,254	979,053	871,630	214,179	45,486,871	25,692,893	18,323,794	10,809,876	7,760,313	6,195,234
Artist	164,501	128,912	100,793	69,320	9,520,443	5,693,303	3,723,440	1,728,485	1,390,336	998,616
Actor	38,881	31,861	25,340	26,047	3,021,143	1,759,089	1,070,066	444,281	372,112	247,690
MusicalArtist	67,142	57,488	46,364	34,520	4,414,488	2,979,826	2,069,152	803,249	715,093	550,225
Athlete	305,848	267,977	217,067	75,884	15,243,575	9,805,423	6,373,136	3,433,084	2,586,730	1,853,233
Politician	61,636	39,584	41,126	476	2,907,418	1,587,472	1,407,548	656,829	486,174	454,209
Place	818,539	723,757	643,260	248,470	34,622,810	32,250,749	24,698,893	8,916,657	9,979,392	8,026,305
Building	77,852	76,107	65,355	23,443	1,403,744	1,321,828	1,058,610	567,780	634,144	530,010
Airport	13,958	12,566	11,675	7,973	445,357	449,272	352,377	113,717	153,614	138,944
Bridge	4,239	3,765	3,425	1,433	109,884	78,418	66,968	41,263	38,846	34,470
Skyscraper	1,457	795	68	2,053	73,315	35,403	3,091	20,012	11,415	719
PopulatedPlace	518,727	467,259	424,291	182,019	27,984,008	26,584,052	20,565,679	6,723,089	7,694,182	6,212,991
River	29,254	27,818	26,892	10,800	937,984	806,429	681,782	247,670	229,762	208,146
Organisation	266,551	228,286	206,670	76,608	7,789,539	6,256,810	4,940,190	2,322,552	2,282,581	2,029,620
SportsLeague	5,016	3,853	2,746	—	192,697	124,224	70,475	46,060	36,378	23,379
SportsTeam	35,287	25,336	19,113	8,672	1,328,942	1,025,695	565,625	246,719	204,706	150,382
Band	33,183	31,344	29,101	—	1,744,474	1,449,829	1,126,744	321,526	340,016	298,743
Company	64,308	55,320	48,989	20,217	1,720,791	1,292,526	1,048,251	592,987	524,303	445,758
Educ.Institution	51,261	47,101	43,250	21,108	1,264,402	1,101,287	958,257	505,803	543,322	493,792
Work	462,124	410,676	360,808	193,085	14,846,601	12,641,898	9,649,228	4,409,805	4,153,448	3,566,511
Book	64,965	55,694	44,339	15,881	2,143,211	1,721,132	1,111,960	504,943	517,959	408,724
Film	92,490	81,833	75,067	34,734	4,167,029	3,408,374	2,663,487	991,037	923,070	787,129
MusicalWork	185,644	169,811	160,383	104,163	5,902,714	5,213,842	4,116,625	1,894,464	1,794,704	1,635,655
Album	134,199	128,514	122,729	74,780	4,797,348	4,381,101	3,400,942	1,370,621	1,360,640	1,224,746
Single	47,230	42,933	42,393	25,595	1,703,790	1,543,304	1,226,636	606,556	576,181	534,023
Software	33,154	30,495	28,930	5,700	966,871	932,543	731,138	269,791	272,488	242,411
TelevisionShow	31,843	28,559	24,784	10,231	945,765	788,740	565,136	401,712	342,230	282,594
Species	278,793	234,512	205,231	90,858	7,179,294	6,375,368	4,415,050	2,522,806	2,166,889	1,836,221
Activity	2,725	1,707	1,490	—	39,312	14,562	10,282	11,812	6,744	5,213
AnatomicalStructure	4,447	4,454	4,217	3,616	35,672	39,596	36,179	18,034	25,105	23,732
Biomolecule	18,633	17,300	12,108	—	105,082	113,106	72,444	27,048	54,898	42,836
CelestialBody	35,489	21,697	19,839	—	708,736	536,325	465,133	231,143	205,953	185,628
ChemicalSubstance	13,644	12,064	10,849	—	310,966	213,352	140,466	62,136	71,102	51,687
Device	31,268	28,961	25,983	—	239,821	220,662	191,195	125,108	122,024	108,322
Event	74,104	57,775	44,481	7,855	1,736,157	1,377,047	830,068	431,768	380,148	270,979
Food	6,606	4,339	1,671	—	45,620	35,420	14,274	22,816	18,771	7,930
Disease	6,628	6,021	5,776	3,180	67,183	84,070	58,217	19,732	30,600	27,917
Drug	5,620	5,396	5,197	3,134	64,726	69,472	56,580	16,940	38,299	31,609
EthnicGroup	4,924	4,163	3,820	607	81,321	56,146	46,043	30,028	21,072	18,485
Holiday	1,220	898	750	—	10,073	8,184	5,914	4,734	4,047	3,036

 

2 Cross-Language Instance Overlap

Next we try to measure to which extent the multi-lingual DBpedia dataset obtained by 'merging' the 28 language versions, is actually multi-lingual. In the table below, the Instances column contains the total number of instances per class across all languages, the 1 column contains the number of instances that are contained only in a single out of the 28 languages, the 2 column contains the number of instances that are contained in 2 languages but not in 3 or more languages, etc. So, for example, 2,729 Persons are described in 12 languages but not in 13 or more languages. If for the Person class we sum 2 to >20 columns, we get that 446,234 Persons are described in 2 or more languages. This might seem small compared to the total of 1,471,254 Persons in total (Instances column), but come back to the second table on the Data Set Statistics page and note there are 1,445,104 Persons in English DBpedia and only 189,448 Persons in the second large Italian DBpedia. Therefore, most of the 1,025,020 Persons described in just one language are very likely to be the ones present in English DBpedia only.

	Instances	1	2	3	4	5	6	7	8	9	10	11	12	13	14	15	16	17	18	19	20	>20
Person	1,471,254	1,025,020	205,891	94,861	50,147	29,994	18,698	12,295	8,214	5,922	4,455	3,580	2,729	2,156	1,736	1,474	1,147	841	580	450	333	731
Artist	164,501	54,587	38,456	23,216	14,361	9,114	5,937	4,165	3,187	2,478	1,906	1,518	1,172	949	705	586	497	377	295	239	199	557
Actor	38,881	3,075	10,047	6,984	4,738	3,257	2,187	1,625	1,319	1,046	852	699	566	467	381	300	283	226	174	134	113	408
MusicalArtist	67,142	24,108	14,447	8,968	5,387	3,592	2,488	1,862	1,440	1,152	867	688	536	406	269	226	187	131	104	84	73	127
Athlete	305,848	155,393	62,832	35,128	19,423	11,830	6,874	4,414	2,657	1,775	1,295	1,047	792	594	500	386	298	220	158	99	69	64
Politician	61,636	28,541	13,776	6,574	3,474	2,189	1,536	1,114	842	655	596	459	359	305	277	280	217	130	87	78	53	94
Place	818,539	396,551	141,511	77,741	40,821	27,725	22,451	17,090	16,755	28,750	25,289	14,147	5,184	1,739	764	550	374	336	234	215	201	111
Building	77,852	61,888	9,057	3,464	1,563	759	428	252	167	105	64	49	25	10	9	7	1	2	1	1	0	0
Airport	13,958	8,456	2,251	1,168	681	395	244	223	154	126	105	71	44	24	10	4	1	1	0	0	0	0
Bridge	4,239	2,774	743	274	290	78	34	19	9	9	5	2	2	0	0	0	0	0	0	0	0	0
Skyscraper	1,457	98	463	315	185	125	92	61	45	31	18	15	6	2	1	0	0	0	0	0	0	0
PopulatedPlace	518,727	185,780	93,663	58,859	31,618	22,950	19,776	15,482	15,618	27,908	24,656	13,707	4,878	1,524	630	436	304	273	193	183	185	104
River	29,254	16,294	7,179	2,279	864	693	512	320	285	190	123	109	99	75	52	51	35	33	23	22	13	3
Organisation	266,551	191,812	33,197	14,675	8,317	4,988	3,394	2,354	1,714	1,316	1,066	773	673	538	383	309	289	214	181	141	97	120
SportsLeague	5,016	2,207	818	493	431	452	323	175	78	15	2	3	7	12	0	0	0	0	0	0	0	0
SportsTeam	35,287	18,229	6,107	3,653	2,311	1,123	761	590	397	319	314	235	252	233	158	134	131	102	97	79	39	23
Band	33,183	17,492	5,576	2,784	1,694	1,178	835	686	593	508	406	314	251	186	130	117	111	70	60	51	51	90
Company	64,308	44,846	9,138	3,952	2,161	1,280	908	586	433	281	214	142	100	77	54	34	34	31	16	9	6	6
Educ.Institution	51,261	44,109	4,027	1,235	663	409	241	158	110	101	52	43	31	31	18	12	5	6	6	2	1	1
Work	462,124	279,382	79,175	35,459	19,356	12,521	8,775	6,264	4,813	3,798	2,998	2,226	1,737	1,354	1,100	821	685	532	428	293	154	253
Book	64,965	36,453	10,577	5,062	2,951	1,973	1,573	1,179	921	779	632	485	396	378	362	331	268	227	180	99	55	84
Film	92,490	45,024	18,525	8,766	4,990	3,190	2,402	1,743	1,396	1,229	1,097	886	735	581	480	317	292	215	195	167	92	168
MusicalWork	185,644	118,979	30,948	13,291	7,018	4,534	3,004	2,192	1,683	1,236	875	585	424	289	180	134	98	73	53	29	11	8
Album	134,199	80,549	23,100	10,296	5,860	4,034	2,745	2,060	1,611	1,203	866	581	421	287	180	134	98	73	53	29	11	8
Single	47,230	27,148	8,211	4,386	2,420	1,619	1,096	698	536	384	275	160	102	79	52	31	21	10	0	2	0	0
Software	33,154	16,000	6,499	3,593	2,055	1,449	1,049	727	508	390	279	203	130	79	73	39	37	22	12	5	4	1
TelevisionShow	31,843	20,065	5,274	2,119	1,324	914	683	473	329	202	167	97	77	54	30	25	7	2	1	0	0	0
Species	278,793	107,610	85,513	31,850	17,684	12,491	7,428	4,895	3,266	2,256	1,759	1,248	983	698	479	314	171	104	44	0	0	0
Activity	2,725	1,518	579	295	141	97	47	17	8	7	4	2	5	1	2	1	1	0	0	0	0	0
AnatomicalStructure	4,447	3,410	542	360	118	10	7	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0
Biomolecule	18,633	12,128	4,004	1,152	1,165	121	44	15	3	1	0	0	0	0	0	0	0	0	0	0	0	0
CelestialBody	35,489	14,777	4,429	2,551	3,771	3,814	1,017	1,011	1,206	1,133	975	699	59	45	1	1	0	0	0	0	0	0
ChemicalSubstance	13,644	1,147	3,552	2,675	1,822	1,269	1,046	723	579	485	263	72	11	0	0	0	0	0	0	0	0	0
Device	31,268	28,431	1,447	637	347	171	90	59	39	27	13	5	1	1	0	0	0	0	0	0	0	0
Event	74,104	44,242	14,049	6,623	3,522	2,019	1,240	825	507	271	214	145	109	97	65	42	51	39	29	14	0	1
Food	6,606	6,194	324	67	12	5	2	1	0	1	0	0	0	0	0	0	0	0	0	0	0	0
Disease	6,628	3,211	1,082	682	472	335	279	162	124	89	68	42	25	24	17	9	3	4	0	0	0	0
Drug	5,620	553	2,795	800	462	308	251	225	152	54	12	7	1	0	0	0	0	0	0	0	0	0
EthnicGroup	4,924	3,690	686	279	109	50	39	39	17	8	5	2	0	0	0	0	0	0	0	0	0	0
Holiday	1,220	816	263	94	35	6	5	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0

 

3 Cross-Language Property Overlap

The table below contains the statistics on properties of the PopulatedPlace class that are frequently used in different languages. We report the number of instances that have this property in exactly 1, 2, 3, ..., 8 and from 9 to 28 languages.

Property	Total	1	2	3	4	5	6	7	8	>8
rdf:type	593,708	185,780	93,663	58,859	31,618	22,950	19,776	15,482	15,618	74,981
foaf:name	528,867	203,026	107,359	52,475	27,552	24,068	29,491	30,560	21,740	16,298
wgs8:long	466,097	169,386	94,660	52,543	27,120	22,014	18,277	21,880	24,161	18,028
wgs8:lat	466,097	169,386	94,661	52,543	27,119	22,012	18,279	21,879	24,162	18,028
dbpedia-owl:country	396,868	306,214	81,466	6,279	1,862	623	220	91	57	28
dbpedia-owl:populationTotal	378,789	137,520	70,031	37,746	28,667	41,815	34,033	16,320	5,047	3,805
dbpedia-owl:isPartOf	346,941	343,825	3,054	62	0	0	0	0	0	0
dbpedia-owl:timeZone	267,019	214,371	27,197	23,833	1,468	104	32	9	5	0
dbpedia-owl:type	204,844	179,378	24,951	504	9	1	0	1	0	0
dbpedia-owl:elevation	198,623	85,095	36,887	24,282	21,342	13,252	14,681	1,922	514	324
dbpedia-owl:areaTotal	194,806	76,875	67,447	30,513	14,294	4,092	802	174	137	236
dbpedia-owl:name	171,451	171,448	3	0	0	0	0	0	0	0
dbpedia-owl:area	142,757	76,457	32,521	33,744	34	1	0	0	0	0
dbpedia-owl:populationDensity	140,218	84,441	44,823	8,558	1,682	191	73	34	52	182
dbpedia-owl:censusYear	136,933	91,766	36,083	5,874	2,445	765	0	0	0	0
dbpedia-owl:region	129,253	57,132	19,703	7,693	3,663	8,290	15,230	11,612	4,136	897
dbpedia-owl:administrativeDistrict	127,821	112,512	14,715	594	0	0	0	0	0	0
foaf:homepage	120,057	36,588	23,677	15,010	12,046	9,844	6,820	9,628	2,694	1,875
dbpedia-owl:leaderTitle	107,980	77,684	21,939	5,735	1,303	504	178	92	53	246

The table below contains the same type of statistics on properties of the Person class.

Property	Total	1	2	3	4	5	6	7	8	>8
rdf:type	1,497,388	1,025,020	205,891	94,861	50,147	29,994	18,698	12,295	8,214	26,134
foaf:name	1,199,478	803,720	185,139	77,573	40,631	23,641	14,542	9,505	6,377	19,175
dbpedia-owl:birthYear	978,162	806,919	155,232	11,706	3,792	470	41	2	0	0
dbpedia-owl:birthDate	772,431	604,228	111,606	35,477	14,927	5,285	785	111	10	1
dbpedia-owl:birthPlace	655,831	437,574	108,666	44,646	21,233	11,873	7,410	4,832	3,303	8,147
dbpedia-owl:deathYear	453,733	381,110	67,307	4,325	914	71	6	0	0	0
dbpedia-owl:team	340,987	296,259	28,524	8,827	2,991	1,553	1,004	696	531	301
dbpedia-owl:deathDate	328,856	277,341	37,324	9,850	3,408	738	157	31	3	2
dbpedia-owl:deathPlace	215,673	148,041	35,185	13,628	6,259	3,448	2,088	1,373	881	2,385
dbpedia-owl:currentMember	205,382	205,089	270	23	0	0	0	0	0	0
dbpedia-owl:activeYearsStartYear	194,423	135,241	32,598	11,455	4,983	2,941	1,913	1,369	923	1,500
dbpedia-owl:squadNumber	189,739	189,739	0	0	0	0	0	0	0	0
dbpedia-owl:occupation	186,788	152,785	20,980	6,844	3,122	1,612	717	322	156	125
dbpedia-owl:position	183,744	107,421	32,208	15,390	8,825	5,329	3,517	2,244	1,524	3,643
dbpedia-owl:height	178,217	103,005	40,232	14,962	7,389	3,944	2,398	1,499	1,156	1,816
dbpedia-owl:nationality	168,150	144,435	17,780	3,714	1,368	457	196	102	38	30
foaf:surname	166,716	165,198	1,517	1	0	0	0	0	0	0