agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Talk at the US National Agricultural Library, May 20 2011 Dr. Johannes Keizer Office of Knowledge Exchange, Research and Extension Food and Agriculture Organization of the UN AGROVOC Linked Open Data and the VocBench, potentials for the community agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 We will promote research for food and agriculture, including research to adapt to, and mitigate climate change, and access to research results and technologies at national, regional and international levels. We will reinvigorate national research systems and will share information and best practices. We will improve access to knowledge. world food summit 2009 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 …Sharing Information  1975 – AGRIS  1980 - AGROVOC  2000 - Rethinking of AGRIS  2002 - AOS/AGMES  2005 - CIARD  2005 - AIMS agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Todays Talk  What’s new with AGROVOC  AGROVOC Linked Open Data  The VocBench  Why mapping Vocabularies  Automatic Indexing  AGRIS AGROVOC agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVOC  A multilingual agricultural vocabulary organized as concept scheme in 20 languages  Covers agriculture, forestry, fisheries and related themes (food security, land use, environment, etc.)  Organized in sub-vocabularies, e.g. chemicals, fisheries terms, scientific/common names of organisms  Maintained by a global community (e.g. librarians, terminologists, information managers) using VocBench agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVOC - Statistics Total terms 580,239 Concepts ca. 40,000 Top concepts 25 English concepts / terms ca. 32,000 concepts / 40,737 terms French terms 38,395 Spanish terms 41,745 Terms in Arabic, Chinese, Czech, German, Hindi, Hungarian, Italian, Japanese, Korean, Lao, Persian (Farsi), Polish, Portuguese, Russian, Slovak, Thai 456,952 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVOC - Restructuring  Goal: Transform AGROVOC from a traditional thesaurus into a concept scheme with distinction between conceptual level and terminological level  Overall revision done by FAO in collaboration with KSI (Knowledge Sharing and Innovation) team at ICRISAT, Hyderabad, India  Top concepts reduced from 918 to 25  Around 85,000 term relations revised  Non-hierarchical relationships refined by semantic relations  Ca. 4,000 non-preferred terms changed to preferred terms agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Top concepts agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Relationships (examples) agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVO C EUROVO C RAMEAU LCSH NALT GEMET STW  18000 outlinks  2000 inlinks Thesauri into the AGROVOC LOD Cloud agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVOC LOD- inlinks Trusted Links from AGROVOC agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGROVOC Links after 3 weeks LOD Outlinks: GEMET-AGROVOC 1,198 RAMEAU-AGROVOC  : 700 Total Outlinks: 1898 Inlinks: AGROVOC-EUROVOC:1,297 AGROVOC-GEMET:1,198 AGROVOC-LCSH :1,093 AGROVOC-NAL: 13,390 AGROVOC-STW:1136 AGROVOC-RAMEAU:700 Total Inlinks:18,814 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Get the NALT into the LOD cloud too!  Some notes from Ahsan  Issues  1.  Only  problem is that  the online version  and  the SKOS version 2011 of NALT are  totally different according to the terms code .  They need to make the stable version of their terms code . 2. Since  the AGROVOC is connected with the  NALT so they are in the LOD according to the principle. They can put our 13,000 mapping links into their SKOS file. It will cover outlinks and inlinks.  Necessary activities  1. Put the SKOS version in the triple store. 2. Make the dereferenceable URIs in their website (They can use the biotech drupal module that we are going to build now) 3. Publish the URIs  by using Pubby  tool       http://www4.wiwiss.fu-berlin.de/pubby/ agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Europe:(It is better to use this example during the presentation) http://aims.fao.org/aos/agrovoc/c_2724 From the Top concept: Ref:  http://aims.fao.org/aos/agrovoc/c_7644 Vocbench (Production) Ref:   http://agrovoc.mimos.my/vocbenchv1.1i/ VocBench(Sandbox) Ref:http://agrovoc.mimos.my/vocbenchv1.1i/ The VocBench agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 The VocBench VocBenchconcepts and entities triples agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 VocBench Features  Domain independent Structure independent (i.e. thesauri, Glossaries, etc) Supports RDF (SKOS, SKOS-XL), OWL Supports collaborative editing  Supports editorial workflow, with user roles  Simple and advanced search Supports data export: SKOS, Relational format (MySQL) agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Why linking vocabularies? agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org/aos/agrovoc/c_7825 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org/aos/agrovoc/c_7825 http://eurovoc.europa.eu/218754 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org/aos/agrovoc/c_7825 http://eurovoc.europa.eu/218754 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org/aos/agrovoc/c_7825 http://eurovoc.europa.eu/218754 http://agclass.nal.usda.go v/nalt/2011.xml#1780 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 http://aims.fao.org/aos/ agrovoc/c_7825 AGROVOC http://aims.fao.org/aos/agrovoc/c_12332 owl:sameAs http://eurovoc.europa.eu/219871 skos: exact match UNBIS: Toxic Substances http://agris.fao.org/agris- search/search/display.do? f=1996/TR/TR96001.xml;TR9600026 Linking data through common URIs http://eur- lex.europa.eu/LexUriServ/LexUr iServ.do? uri=OJ:L:2010:202:0011:0015:E N:PDF http://unbisnet.un.org:8080/ipac20/i pac.jsp? session=128F308557F34.283092& profile=bib&uri=full=3100001~! 685149~! 1&ri=1&aspect=subtab124&menu= search&source=~!horizon http://eurovoc.eu ropa.eu/218754 Eurovoc TOXIC SUBSTANCES UNBIS http://agclass.nal.usda. gov/nalt/2011.xml#1780 NALT http://www.agnic. org/search/CAT8 5822953 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 If all institutions, which publish about toxic wastes would:  - Index their publications with URIs from AGROVOC,GEMET, NALT, LCSH or EUROVOC  (many do – low hanging fruit!)  - Publish their metadata as LOD  (quite easy to do, bibData map well to RDF Then Everyone who knows to write Sparql Qeries could get all these publications with one shot for a new website on toxic wastes agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 Vocabularies and LOD  Simply publishing your data as RDF does not link them to other data sets   Creating this links by humans is interesting in detail, but unrealistic as mass processing  Linking 2 standard vocabularies can link 200 datasets which use these standard vocabularies agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AgroTagger And OpenCalais agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 • Does Concept identification in unstructured texts • Uses Agrovoc as a controlled vocabulary • Prototype under testing with excellent results (entire repository of ICARDA indexed) • Will produce in future Structured RDF files that c n be used to link data like “open Calais” • AgroTagger agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGRIS agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 On e y ea r agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 0 10000 20000 30000 40000 50000 60000 70000 80000 Records Full text Citations Country Records Full-text Citations Japan 70,045 0 70029 Korea Rep. 27,833 339 27832 Scielo - BR 25,955 25815 25955 China 17,225 0 17224 Spain 14,421 3205 12129 Thailand 11,460 487 3177 FAO 9,578 5523 4791 Serbia 8,903 1322 5834 Brazil 8,380 18 6519 Italy 7,500 0 7500 Total records Full-text 316,888 54,209 2005-2011 AGRIS repository Data aggregation in the last 5 years agricultural information management standards and services - dr. johannes keizer AGROVOC and the VocBench, NAL, 2011, May 19 AGRIS Contributions 5 years Name N0.citations Japan 70029 Korea Rep. 27832 Scielo - BR. 25955 China 17224 Spain 12129 Italy 7500 Poland 6966 Brazil 6519 Pakistan 6345 Serbia 5834 Cuba 5188 Belarus 5144 India 4935 Czech Rep. 4891 FAO 4791 Philippine 4424 Uruguay 3373 Bulgaria 3178 Thailand 3177 Latvia 2718 Turkey 2507 Slovak 2174 Switzerland 1937 Ghana 1646 Serbia/Montenegro 1532 Finland 1248 CIHEAM - France 1241 Argentina 1170 Indonesia 1067 South Africa 1067 Russia 922 Egypt 850 Iran 837 Hungary 819 Colombia 772 Perú 690 Nicaragua 573 Venezuela 503 Slovenia 476 Vietnam 453 Ukraina 435 Portugal 401 Norway 396 Chile 391 Dominican Republic 384 Sudan 379 Moldavia 368 Somalia 363 Ethiopia 318 Ecuador 311 Syria 269 Cymmit 255 CIFOR 249 IRRI 244 ILRI 230 Thank You! http://www.ciard.net http://ring.ciard.net http://aims.fao.org http://agris.fao.org