Tuesday, July 4, 2017 - 1:53pm
We are happy to announce the new DBpedia Release.
This release is based on updated Wikipedia dumps dating from October 2016.
This release took us longer than expected. We had to deal with multiple issues and included new data. Most notable is the addition of the NIF annotation datasets for each language, recording the whole wiki text, its basic structure (sections, titles, paragraphs, etc.) and the included text links. We hope that researchers and developers, working on NLP-related tasks, will find this addition most rewarding. The DBpedia Open Text Extraction Challenge (next deadline Mon 17 July for SEMANTiCS 2017) was introduced to instigate new fact extraction based on these datasets.
We want to thank anyone who has contributed to this release, by adding mappings, new datasets, extractors or issue reports, helping us to increase coverage and correctness of the released data. The European Commission and the ALIGNED H2020 project for funding and general support.
You want to read more about the New Release? Click below for further details.[expander_maker id=”1″ more=”Read more” less=”Read less”]
Altogether the DBpedia 2016-10 release consists of 13 billion (2016-04: 11.5 billion) pieces of information (RDF triples) out of which 1.7 billion (2016-04: 1.6 billion) were extracted from the English edition of Wikipedia, 6.6 billion (2016-04: 6 billion) were extracted from other language editions and 4.8 billion (2016-04: 4 billion) from Wikipedia Commons and Wikidata.
In addition, adding the large NIF datasets for each language edition (see details below) increased the number of triples further by over 9 billion, bringing the overall count up to 23 billion triples.
- The NLP Interchange Format (NIF) aims to achieve interoperability between Natural Language Processing (NLP) tools, language resources and annotations. To extend the versatility of DBpedia, furthering many NLP-related tasks, we decided to extract the complete human- readable text of any Wikipedia page (‘nif_context’), annotated with NIF tags. For this first iteration, we restricted the extent of the annotations to the structural text elements directly inferable by the HTML (‘nif_page_structure’). In addition, all contained text links are recorded in a dedicated dataset (‘nif_text_links’).
The DBpedia Association started the Open Extraction Challenge on the basis of these datasets. We aim to spur knowledge extraction from Wikipedia article texts in order to dramatically broaden and deepen the amount of structured DBpedia/Wikipedia data and provide a platform for benchmarking various extraction tools with this effort.
If you want to participate with your own NLP extraction engine, the next deadline for the SEMANTICS 2017 is July 17th.
We included an example of these structures in section five of the download-page of this release.
- A considerable amount of work has been done to streamline the extraction process of DBpedia, converting many of the extraction tasks into an ETL setting (using SPARK). We are working in concert with the Semantic Web Company to further enhance these results by introducing a workflow management environment to increase the frequency of our releases.
In case you missed it, what we changed in the previous release (2016-04)
- We added a new extractor for citation data that provides two files:
- citation links: linking resources to citations
- citation data: trying to get additional data from citations. This is a quite interesting dataset but we need help to clean it up
- In addition to normalised datasets to English DBpedia (en-uris), we additionally provide normalised datasets based on the DBpedia Wikidata (DBw) datasets (wkd-uris). These sorted datasets will be the foundation for the upcoming fusion process with wikidata. The DBw-based uris will be the only ones provided from the following releases on.
- We now filter out triples from the Raw Infobox Extractor that are already mapped. E.g. no more “<x> dbo:birthPlace <z>” and “<x> dbp:birthPlace|dbp:placeOfBirth|… <z>” in the same resource. These triples are now moved to the “infobox-properties-mapped” datasets and not loaded on the main endpoint. See issue 22 for more details.
- Major improvements in our citation extraction. See here for more details.
- We incorporated the statistical distribution approach of Heiko Paulheim in creating type statements automatically and providing them as additional datasets (instance_types_sdtyped_dbo).
- DBpedia Fusion: We finally started working again on fusing DBpedia language editions. Johannes Frey is taking the lead in this project. The next release will feature intermediate results.
- Id Management: Closely pertaining to the DBpedia Fusion project is our effort to introduce our own Id/IRI management, to become independent of Wikimedia created IRIs. This will not entail changing out domain or entity naming regime, but providing the possibility of adding entities of any source or scope.
- RML Integration: Wouter Maroy did already provide the necessary groundwork for switching the mappings wiki to an RML based approach on Github. Wouter started working exclusively on implementing the Git based wiki and the conversion of existing mappings last week. We are looking forward to the consequent results of this process.
- Further development of SPARK Integration and workflow-based DBpedia extraction, to increase the release frequency.
- New languages extracted from Wikipedia:
South Azerbaijani (azb), Upper Sorbian (hsb), Limburgan (li), Minangkabau (min), Western Mari (mrj), Oriya (or), Ossetian (os)
- SDTypes: We extended the coverage of the automatically created type statements (instance_types_sdtyped_dbo) to English, German and Dutch.
- Extensions: In the extension folder (2016-10/ext) we provide two new datasets (both are to be considered in an experimental state:
- DBpedia World Facts: This dataset is authored by the DBpedia Association itself. It lists all countries, all currencies in use and (most) languages spoken in the world as well as how these concepts relate to each other (spoken in, primary language etc.) and useful properties like iso codes (ontology diagram). This Dataset extends the very useful LEXVO dataset with facts from DBpedia and the CIA Factbook. Please report any error or suggestions in regard to this dataset to Markus.
- JRC-Alternative-Names: This resource is a link based complementary repository of spelling variants for person and organisation names. The data is multilingual and contains up to hundreds of variations entity. It was extracted from the analysis of news reports by the Europe Media Monitor (EMM) as available on JRC-Names.
The DBpedia community added new classes and properties to the DBpedia ontology via the mappings wiki. The DBpedia 2016-04 ontology encompasses:
- 760 classes
- 1,105 object properties
- 1,622 datatype properties
- 132 specialised datatype properties
- 414 owl:equivalentClass and 220 owl:equivalentProperty mappings external vocabularies
The editor community of the mappings wiki also defined many new mappings from Wikipedia templates to DBpedia classes. For the DBpedia 2016-10 extraction, we used a total of 5887 template mappings (DBpedia 2015-10: 5800 mappings). The top language, gauged by the number of mappings, is Dutch (648 mappings), followed by the English community (606 mappings).[/expander_maker]
- Markus Freudenberg (University of Leipzig / DBpedia Association) for taking over the whole release process and creating the revamped download & statistics pages.
- Dimitris Kontokostas (University of Leipzig / DBpedia Association) for conveying his considerable knowledge of the extraction and release process.
- All editors that contributed to the DBpedia ontology mappings via the Mappings Wiki.
- The whole DBpedia Internationalization Committee for pushing the DBpedia internationalization forward.
- Václav Zeman and the whole LHD team (University of Prague) for their contribution of additional DBpedia types
- Alan Meehan (TCD) for performing a big external link cleanup
- Aldo Gangemi (LIPN University, France & ISTC-CNR, Italy) for providing the links from DOLCE to DBpedia ontology.
- SpringerNature for offering a co-internship to a bright student and developing a closer relation to DBpedia on multiple issues, as well as Links to their SciGraph subjects.
- Kingsley Idehen, Patrick van Kleef, and Mitko Iliev (all OpenLink Software) for loading the new data set into the Virtuoso instance that provides 5-Star Linked Open Data publication and SPARQL Query Services.
- OpenLink Software (http://www.openlinksw.com/) collectively for providing the SPARQL Query Services and Linked Open Data publishing infrastructure for DBpedia in addition to their continuous infrastructure support.
- Ruben Verborgh from Ghent University – imec for publishing the dataset as Triple Pattern Fragments, and imec for sponsoring DBpedia’s Triple Pattern Fragments server.
- Ali Ismayilov (University of Bonn) for extending and cleaning of the DBpedia Wikidata dataset.
- All the GSoC students and mentors which have directly or indirectly worked on the DBpedia release
- Special thanks to members of the DBpedia Association, the AKSW and the Department for Business Information Systems of the University of Leipzig.
The work on the DBpedia 2016-10 release was financially supported by the European Commission through the project ALIGNED – quality-centric, software and data engineering.
Have fun with the new DBpedia 2016-10 release!
Wednesday, June 7, 2017 - 1:57pm
We are happy to announce that the 9th DBpedia Community meeting will be held in Galway, Ireland on June 21st 2017. DBpedia will be part of the Language, Data and Knowledge conference (LDK) in Galway. This new biennial conference series aims at bringing together researchers from across disciplines. The DBpedia Meeting is part of the conference and is scheduled for the last day.
Only few seats are left: So come and get your ticket to be part of the 9th DBpedia Community meeting in Galway.
- Keynote #1: Logainm.ie data use cases by Brian Ó Raghallaigh (Dublin City University & Logainm)
- Keynote #2: Wikimedia in Ireland: A Monumental Undertaking by Sharon Flynn (NUI Galway & Wikimedia Ireland)
- DBpedia Association hour
- A session about Irish Linked data projects (and DBpedia)
- Web URL: http://wiki.dbpedia.org/meetings/Galway2017
- Hashtag: #DBpediaGalway17
- When: June 21st, 2017
- Where: National University of Ireland, Galway (at the Millenium Arts Building Saint Josephs, Lower Newcastle Lower Newcastle, Galway, H91 PH2P, Ireland)
- Call for Contribution: Submit your proposal in our form
- Registration: Free to participate but only through registration (Option for DBpedia support tickets) https://goo.gl/FFQDow
Please check our schedule for the 9th DBpedia Community meeting here: http://wiki.dbpedia.org/meetings/Galway2017
The social event will be held in the evening (starting at 6pm) at the PorterShed around the topic How to exploit data commercially? featuring several short impulse talks. We still have some remaining slots and would welcome you to present your success stories as well as use cases, but also tell us about your problems regarding the commercialisation of data. If you are interested in presenting, please email email@example.com.
Sponsors and Acknowledgments
|LDK2017||For hosting the meeting.|
|Institute for Applied Informatics||For supporting the DBpedia Association.|
|OpenLink Software||For continuous hosting of the main DBpedia Endpoint.|
|ADAPT research centre||For supporting the DBpedia Association.|
|ALIGNED – Software and Data Engineering||For funding the development of DBpedia as a project use-case and covering part of the travel cost.|
|PorterShed||For hosting the evening event.|
In case you want to sponsor the 9th DBpedia Community Meeting, please contact the DBpedia Association via firstname.lastname@example.org.
- Tatiana Gornostay, TILDE
- Rob Brennan, ADAPT research centre
- Felix Sasaki, DFKI GmbH
- Bianca Pereira, The Insight Centre for Data Analytics
- Caoilfhionn Lane, The Insight Centre for Data Analytics
- Jimmy O’Regan, ITUT, Trinity College Dublin
- Julia Holze, DBpedia Association
- Sandra Prätor, DBpedia Association
- Sebastian Hellmann, DBpedia Association and AKSW, Uni Leipzig
We are looking forward to meeting you in Galway!
Your DBpedia Association
Thursday, June 1, 2017 - 1:31pm
New Internship Opportunity @
In conjunction with Springer Nature, DBpedia offers a 3 months internship at Springer Nature in London, UK and at DBpedia in Leipzig, Germany.
|Main Employer||DBpedia Association|
|Deadline||June 30th, 2017|
|Duration||3 months/full-time, internship will starts in the second half of 2017|
|Location||50% in London (UK) and 50% in Leipzig (GER)|
|Type of students desired||Undergraduate, Graduate (Junior role)|
|Compensation||You will receive a stipend of 1300€ per month and additional reimbursement of your travel and visa costs (total up to 1000€)|
The student intern will be responsible for assisting with mappings for DBpedia at SpringerNature. Your tasks include and are not restricted to improving the quality of the extraction mechanism of DBpedia scholarly references/wikipedia citations to Springer Nature URIs and Text mining of DBpedia entities from Springer Nature publication content.
We are looking forward to meet all the whiz kids out there.
Friday, May 5, 2017 - 10:16am
GSoC students have finally been selected.
We are very excited to announce this year’s final students for our projects at the Google Summer of Code program (GSoC).
Google Summer of Code is a global program focused on bringing more student developers into open source software development. Stipends are awarded to students to work on a specific DBpedia related project together with a set of dedicated mentors during summer 2017 for the duration of three months.
For the past 5 years DBpedia has been a vital part of the GSoC program. Since the very first time many Dbpedia projects have been successfully completed.
In this years GSoC edition, DBpedia received more than 20 submissions for selected DBpedia projects. Our mentors read many promising proposals, evaluated them and now the crême de la crême of students snatched a spot for this summer. In the end 7 students from around the world were selected and will jointly work together with their assigned mentors on their projects. DBpedia developers and mentors are really excited about this 7 promising student projects.
List of students and projects:
- Ismael Rodriguez – DBpedia Mapping Front-End Administration
- Ram Ganesan Athreya – First Chatbot for DBpedia
- Nausheen Fatma – Knowledge base embeddings for DBpedia
- Akshay Jagatap – Knowledge Base Embeddings for DBpedia
- Luca Virgili – The table extractor
- Shashank Motepalli – Unsupervised Learning of DBpedia Taxonomy
- Krishanu Konar – Wikipedia List-Extractor
You want to read more about their specific projects? Just click below… or check GSoC pages for details.[expander_maker id=”1″ more=”Read more” less=”Read less”] Ismael Rodriguez – Project Description: Although the DBPedia Extraction Framework was adapted to support RML mappings thanks to a project of last year GSoC, the user interface to create mappings is still done by a MediaWiki installation, not supporting RML mappings and needing expertise on Semantic Web. The goal of the project is to create a front-end application that provides a user-friendly interface so the DBPedia community can easily view, create and administrate DBPedia mapping rules using RML. Moreover, it should also facilitate data transformations and overall DBPedia dataset generation. Mentors: Anastasia Dimou, Dimitris Kontokostas, Wouter Maroy
Ram Ganesan Athreya – Project Description:The requirement of the project is to build a conversational Chatbot for DBpedia which would be deployed in at least two social networks.There are three main challenges in this task. First is understanding the query presented by the user, second is fetching relevant information based on the query through DBpedia and finally tailoring the responses based on the standards of each platform and developing subsequent user interactions with the Chatbot.Based on my understanding, the process of understanding the query would be undertaken by one of the mentioned QA Systems (HAWK, QANARY, openQA). Based on the response from these systems we need to query the DBpedia dataset using SPARQL and present the data back to the user in a meaningful way. Ideally, both the presentation and interaction flow needs to be tailored for the individual social network.I would like to stress that although the primary medium of interaction is text, platforms such as Facebook insist that a proper mix between chat and interactive elements such as images, buttons etc would lead to better user engagement. So I would like to incorporate these elements as part of my proposal.
Mentor: Ricardo Usbeck
Nausheen Fatma – Project discription: Knowledge base embeddings has been an active area of research. In recent years a lot of research work such as TransE, TransR, RESCAL, SSP, etc. has been done to get knowledge base embeddings. However none of these approaches have used DBpedia to validate their approach. In this project, I want to achieve the following tasks: i) Run the existing techniques for KB embeddings for standard datasets. ii) Create an equivalent standard dataset from DBpedia for evaluations. iii) Evaluate across domains. iv) Compare and Analyse the performance and consistency of various approaches for DBpedia dataset along with other standard datasets. v)Report any challenges that may come across implementing the approaches for DBpedia. Along the way, I would also try my best to come up with any new research approach for the problem.
Mentors: Sandro Athaide Coelho, Tommaso Soru
Akshay Jagatap – Project Description: The project aims at defining embeddings to represent classes, instances and properties. Such a model tries to quantify semantic similarity as a measure of distance in the vector space of the embeddings. I believe this can be done by implementing Random Vector Accumulators with additional features in order to better encode the semantic information held by the Wikipedia corpus and DBpedia graphs.
Mentors: Pablo Mendes, Sandro Athaide Coelho, Tommaso Soru
Luca Virgili – Project Description: In Wikipedia a lot of data are hidden in tables. What we want to do is to read correctly all tables in a page. First of all, we need a tool that can allow us to capture the tables represented in a Wikipedia page. After that, we have to understand what we read previously. Both these operations seem easy to make, but there are many problems that could arise. The main issue that we have to solve is due to how people build table. Everyone has a particular style for representing information, so in some table we can read something that doesn’t appear in another structure. In this paper I propose to improve the last year’s project and to create a general way for reading data from Wikipedia tables. I want to review the parser for Wikipedia pages for trying to understand more types of tables possible. Furthermore, I’d like to build an algorithm that can compare the column’s elements (that have been read previously by the parser) to an ontology so it could realize how the user wrote the information. In this way we can define only few mapping rules, and we can make a more generalized software.
Mentors: Emanuele Storti, Domenico Potena
Shashank Motepalli – Project Description: DBpedia tries to extract structured information from Wikipedia and make information available on the Web. In this way, the DBpedia project develops a gigantic source of knowledge. However, the current system for building DBpedia Ontology relies on Infobox extraction. Infoboxes, being human curated, limit the coverage of DBpedia. This occurs either due to lack of Infoboxes in some pages or over-specific or very general taxonomies. These factors have motivated the need for DBTax.DBTax follows an unsupervised approach to learning taxonomy from the Wikipedia category system. It applies several inter-disciplinary NLP techniques to assign types to DBpedia entities. The primary goal of the project is to streamline and improve the approach which was proposed. As a result, making it easy to run on a new DBpedia release. In addition to this, also to work on learning taxonomy of DBTax to other Wikipedia languages.
Mentors: Marco Fossati, Dimitris Kontokostas
Krishanu Konar – Project Description: Wikipedia, being the world’s largest encyclopedia, has humongous amount of information present in form of text. While key facts and figures are encapsulated in the resource’s infobox, and some detailed statistics are present in the form of tables, but there’s also a lot of data present in form of lists which are quite unstructured and hence its difficult to form into a semantic relationship. The project focuses on the extraction of relevant but hidden data which lies inside lists in Wikipedia pages. The main objective of the project would be to create a tool that can extract information from wikipedia lists, form appropriate RDF triplets that can be inserted in the DBpedia dataset.
Mentor: Marco Fossati [/expander_maker]
Congrats to all selected students! We will keep our fingers crossed now and patiently wait until early September, when final project results are published.
An encouraging note to the less successful students.
The competition for GSoC slots is always on a very high level and DBpedia only has a limited amount of slots available for students. In case you weren’t among the selected, do not give up on DBpedia just yet. There are plenty of opportunities to prove your abilities and be part of the DBpedia experience. You, above all, know DBpedia by heart. Hence, contributing to our support system is not only a great way to be part of the DBpedia community but also an opportunity to be vital to DBpedia’s development. Above all, it is a chance for current DBpedia mentors to get to know you better. It will give your future mentors a chance to support you and help you to develop your ideas from the very beginning.
Go on you smart brains, dare to become a top DBpedia expert and provide good support for other DBpedia Users. Sign up to our support page or check out the following ways to contribute:
- Join our DBpedia-discussion -mailinglist, where we discuss current DBpedia developments. NOTE: all mails announcing tools or call to papers unrelated to DBpedia are not allowed. This is a community discussion list.
- If you like to join DBpedia developers discussion and technical discussions sign up in Slack
- Developer Discussion
- Become a DBpedia Student and sign up for free at the DBpedia Association. We offer special programs that provide training and other opportunities to learn about DBpedia and extend your Semantic Web and programming skills
We are looking forward to working with you!
Have a great weekend!
Thursday, March 9, 2017 - 1:36pmDo you want to stay informed about upcoming DBpedia events, releases and technical developments? Through the DBpedia newsletter you get the possibility to be always up to date and to provide feedback to us. Four times per year we will inform the DBpedia community about meetings, new collaborations and other topics related to DBpedia. So … Continue reading STAY TUNED AND SIGN UP FOR THE DBPEDIA NEWSLETTER
Friday, March 3, 2017 - 1:34pm
DBpedia will participate for a fifth time in the Google Summer of Code program (GSoC) and now we are looking for students who will share their ideas with us. We are regularly growing our community through GSoC and can deliver more and more opportunities to you. We got excited with our new ideas, we hope you will get excited too!
What is GSoC?
Google Summer of Code is a global program focused on bringing more student developers into open source software development. Funds will given to students (BSc, MSc, PhD) to work for three months on a specific task. At first open source organizations announce their student projects and then students should contact the mentor organizations they want to work with and write up a project proposal for the summer. After a selection phase, students are matched with a specific project and a set of mentors to work on the project during the summer.
If you are a GSoC student who wants to apply to our organization, please check our guideline here: http://wiki.dbpedia.org/gsoc2017
Here you can see the Google Summer of Code 2017 timeline:
|March 20th, 2017||Student applications open (Students can register and submit their applications to mentor organizations.)|
|April 3rd, 2017||Student application deadline|
|May 4th, 2017||Accepted students are announced and paired with a mentor.|
|May 30th, 2017||Coding officially begins!|
|August 21st, 2017||Final week: Students submit their final work product and their final mentor evaluation|
|September 6th, 2017||Final results of Google Summer of Code 2017 announced|
We are looking forward to your input.
Your DBpedia Association
Wednesday, February 22, 2017 - 10:11am
Sören Auer and the DBpedia Board members prepared a survey to assess the direction of the DBpedia Association. We would like to know what you think should be our priorities and how you would like the funds of the association to be used.
Your opinion counts – so please contribute actively in developing a better DBpedia. If you use DBpedia and want us to keep going forward, we kindly invite you to vote here: https://goo.gl/forms/rDqLcwL823Ok09Uw2
We will publish the results in anonymized, aggregated form on the DBpedia website.
Your DBpedia Association
Thursday, January 19, 2017 - 4:35pm
As previous years, we would like your input for DBpedia related project ideas for GSoC 2017.
For those who are unfamiliar with GSoC (Google Summer of Code), Google pays students (BSc, MSc, PhD) to work for 3 months on an open source project. Open source organizations announce their student projects and students apply for projects they like. After a selection phase, students are matched with a specific project and a set of mentors to work on the project during the summer.
Here you can see the Google Summer of Code 2017 timeline: https://developers.google.com/open-source/gsoc/timeline
or please check: http://wiki.dbpedia.org/gsoc2016
If you have a cool idea for DBpedia or want to co-mentor an existing cool idea go here (All mentors get a free Google T-shirt and get the chance to go Google HQs in November.).
DBpedia applied for the fifth time to participate in the Google Summer of Code program. Here you will find a list of all projects and students from GSoC 2016: http://blog.dbpedia.org/2016/04/26/dbpedia-google-summer-of-code-2016/
Looking forward to your input.
Your DBpedia Association
Monday, November 28, 2016 - 4:17pm
The DBpedia community and members from over 20 countries work hard to localize and internationalize DBpedia and support the extraction of non-English Wikipedia editions as well as build a data community around a certain language, region or special interest. The chapters are part of the DBpedia executives and have taken on responsibility to contribute to the infrastructure of DBpedia.
Hereby we proudly announce that DBpedia in Dutch is the first chapter which signed the Memorandum of Understanding (MoU). There are various intentions why they already signed the MoU: First of all they support the goals of the DBpedia Association, secondly they strengthen their own chapter and community of contributors and thirdly they improve the cooperation with the Dutch research infrastructure and the Dutch Digital Heritage. The cooperation was initiated by Koninklijke Bibliotheek (National Library of the Netherlands) and Huygens ING (research institute of History and Culture).
Other partners like imec/Ghent University and Institute of Sound and Vision have signed as well and became an executive partner of the DBpedia Association. The Vrije Universiteit will join soon. It is a cooperation between these Dutch organizations as well as the NL-DBpedia community.
The Dutch Chapter has provided a Sample DBpedia Chapter Memorandum of Understanding (MoU) to use as a template for further chapters. If you use DBpedia and want us to keep going forward, we kindly invite you to donate and help DBpedia to grow. If you would like to become a member of the DBpedia Association, please go directly to the application form or contact us.
Your DBpedia Association
Monday, November 21, 2016 - 5:44pm
After our successful meeting in Poznan in 2015, we thought it is time to meet the Polish DBpedia community again. The DBpedia meetup will be held on 22th of November 2016 at the Poznań University of Economics and Business. This meetup aims at the presentation of semantic web technologies and their use in applications by entrepreneurs.
- Web URL: http://wiki.dbpedia.org/meetings/Poznan2016
- Hashtag: #DBpediaPL
- When: November 22nd, 2016
- Where: Towarowa 55, 61-875 Poznań, Poland
- Host: Uniwersytet Ekonomiczny w Poznaniu, Uniwersytet im. Adama Mickiewicza w Poznaniu
- Registration: through eventbrite
The schedule for the DBpedia meetup in Poznan is included in the eventbrite page.
Get your ticket here and be part of this event.
Your DBpedia Association