Best Practice in Open Science Iryna Kuchma, EIFL Open Access Programme Manager, Twitter: @irynakuchma UniversiUtrecht (except logos) Innovations in scholarly communication https://101innovations.wordpress.com/ Bianca Kramer & Jeroen Bosman @MsPhelps @jeroenbosman A model of the research workflow preparation analysis writingpublication outreach assessment discovery A model of the research workflow preparation analysis writingpublication outreach assessment discovery Rounds of (grant) writing and application Iterations of search and reading Drafting, receiving comments,rew riting Submitting, peer review, rejection, resubmitting Rounds of experiments and measurements Writing Data Management Plans 2005 2010 A n alysis O u tr ea ch Opening up the research workflow Assessment • Comment / peer review • Determine impact of research output • Determine impact of researchers Preparation • Define & crowdsource research priorities • Organize project, team, collaborations • Get funding / contract Discovery • Search literature / data / code / … • Get access; Get alerts / recommendations • Read / view • Annotate Analysis • Collect, mine, extract data / experiment • Share protocols / notebooks / workflows • Analyze Writing • Write / code • Visualize • Cite • Translate Publication • Archive / share publications; data & code • Publish in OA journal Outreach • Archive/share posters • Archive/share presentations • Tell about research outside academia • Researcher profiles/networks Open Science practices openly share project proposals involve public / patients in drafting research proposals share hypothesis before starting research (if possible/relevant) extensively search for existing data before generating your own use easily attainable software to allow anyone to reproduce your results Open Science practices store data in the most open format possible cite OA versions of literature & provide data and code citations acknowledge contributor roles in a publication publish preprints, encourage feedback / open peer review translate research objects in world languages Open Science practices refuse to be part of all male of all white panels use metrics of commercial /social applications to assess research publish pre-publication history (version + reviews) Opening up the research workflow Assessment • Comment / peer review • Determine impact of research output • Determine impact of researchers Preparation • Define & crowdsource research priorities • Organize project, team, collaborations • Get funding / contract Discovery • Search literature / data / code / … • Get access; Get alerts / recommendations • Read / view • Annotate Analysis • Collect, mine, extract data / experiment • Share protocols / notebooks / workflows • Analyze Writing • Write / code • Visualize • Cite • Translate Publication • Archive / share publications; data & code • Select journal Outreach • Archive/share posters • Archive/share presentations • Tell about research outside academia • Researcher profiles/networks Activity Tell us about the activities that you are already doing and about one or two that you haven’t done yet and would like to explore Opening up the research workflow Assessment • Comment / peer review • Determine impact of research output • Determine impact of researchers Preparation • Define & crowdsource research priorities • Organize project, team, collaborations • Get funding / contract Discovery • Search literature / data / code / … • Get access; Get alerts / recommendations • Read / view • Annotate Analysis • Collect, mine, extract data / experiment • Share protocols / notebooks / workflows • Analyze Writing • Write / code • Visualize • Cite • Translate Publication • Archive / share publications; data & code • Select journal Outreach • Archive/share posters • Archive/share presentations • Tell about research outside academia • Researcher profiles/networks Reproducibility “Mostly due to current methods capture and data malpractice, approximately 50% of all research data and experiments is considered not reproducible, and the vast majority (likely over 80%) of data never makes it to a trusted and sustainable repository.” Source: Realising the European Open Science Cloud, EC DG Research & Innovation 2016 http://ec.europa.eu/research/openscience/pdf/realising_the_european_open_science_cloud_2016.pdf#view=fit&pagemode=none Reproducibility Reproducibility in the research workflow preparation experimenting / analysis publication assessment • pre-register (can be embargoed) • share protocols, scripts • use materials ids (RRIDs) • use open hardware • document steps, file management • share data • use executable/forkable publications • use IDs for preregistrations, data, methods, materials, contributors • check (statistical) methods /reporting • welcome replication studies Pre-registering, e.g. at OSF or AsPredicted Make it easy to verify your hypothesis and analysis plans. Prevent p-hacking Pre-registering, e.g. at OSF or AsPredicted Pre-registering, e.g. at OSF or AsPredicted Aspredicted.org Source: https://aspredicted.org/ Sharing methods and materials, e.g. at Protocols.io or RRID MyExperiment – research workflow Source: https://www.myexperiment.org/home sharing notebooks e.g. at ONSNetwork or OSF Get feedback from peers, help form your thoughts, feel less alone while doing the analyses. Spot mistakes early on. Open Notebook Science Network Source: http://onsnetwork.org/ Sharing data, e.g. at Dryad, Figshare or Zenodo Sharing research data, e.g. at Dryad, Figshare or Zenodo Sharing code e.g. at GitHub with GNU OR MIT license Get people to check, contribute to and use and build on your code Ipython - notebook Source: http://ipython.org/notebook.html What do researchers use ? Analyze Share notebooks / protocols Archive / share data & code Open Peer Review Disciplinary variety and Open Science ARTS & HUMANITIES SOCIAL SCIENCE LIFE/HEALTH PHYSICAL SCIENCES Research types often exploratory research often confirmatory research often confirmatory research often confirmatory research? Data often texual data also qualitative data, sometimes sensitive data sensitive patient data / big datasets big datasets Publ. Types books, chapters, articles mostly articles and chapters mostly articles, (syst.) reviews preprints, conf papers, articles Collaboration typically 1 typically 1-4 typically 3-10 typically 3-many Languages native languge & some English English, some native languages English English Funding small scale funding small & medium scale funding large scale funding large scale funding Review double blind double + single blind single blind single blind Research characteristics and Open Science options/issues Characteristic Open Science options/issues Research types Preregistration different for exploratory research Data Costs of archiving large datasets / conderations of anonimity/sensitiveness / Patentable code/outcomes Publ. Types Limited OA Book options / Book publishers small and many / Preprints Collaboration Reaching agreements with co-authors Languages Not all languages always accepted / Non-native English researcherds at disadvantage Funding Large projects have funding but may ‘dictate’ way of archiving/publishing/communicating Review Closed and blind variants of peer review are deeply rooted Open Science monitor (European Union) http://ec.europa.eu/research/openscience/index.cfm?pg=home§ion=monitor (except logos) With thanks to Bianca Kramer & Jeroen Bosman, Utrecht University Library for re-using their slides presented at Open Access, Open Data, Open Science EIFL Train-the-trainer programme @MsPhelps @jeroenbosman Open Access to publications OA publishing: Costs Find a no-cost open access (OA) journal - about 65% of fully OA journals do not charge for publishing an article OA publishing: Costs (2) Notable examples of OA journals that do not currently charge fees include: OA publishing: Costs (3) It's important to note that researchers in any country can request a fee waiver if unable to pay Examples of publisher fee waiver policies (non-exhaustive list) BioMed Central’s open access waiver fund Hindawi’s waiver policy PLOS’s Global Participation Initiative Take back control “Know your rights. Keep your rights. You should decide how your work is used.” “Many subscription publishers require authors to sign a copyright transfer agreement. Sign this and you no longer own your work, the publisher does. The publisher decides who can read, share, and reuse the content. Do you think you should have to ask the publisher for permission to reuse your own work? No? Then take back control.” Negotiate to keep your rights “You can negotiate the terms of your publishing agreement. Want to retain your copyright? Want the right to post a free copy in an open repository? Want to reuse the content? Simply ask. Submit an author addendum that describes the rights you want to retain. SPARC provides a template addendum [pdf]. More info is available here.” Negotiate to keep your rights (2) The Scholar’s Copyright Addendum Engine can help you generate a customized author addendum. Not all publishers will accept author addenda, but some will. And it never hurts to ask… Consider publishing in an OA journal “Instead of negotiating with a subscription publisher, you can go with an OA publisher and keep all your rights. OA publishers do not require a copyright transfer agreement; authors retain copyright.” Consider publishing in an OA journal (2) “Articles are most often distributed under a Creative Commons Attribution (CC BY) license, which allows anyone to read, share, and reuse the content provided they attribute the original source. Creative Commons also has other licenses, depending on the types of reuse rights you as the copyright holder want to grant users of your work. Don't know which license to choose? This simple license selector can help.” How to find a suitable OA journal? 1. Browse the Directory of Open Access Journals The DOAJ is the foremost trusted listing of over 9,914 registered OA journals. Searches by subject, article processing charges, journal license, publisher, country of publisher, and full text language, type of peer review (blind, double- blind, open, etc.) are available. How to find a suitable OA journal? (2) 2. Use the CoFactor Journal Selector Tool The Cofactor Journal Selector Tool is not exclusive to OA journals, but allows authors to filter by several options, including whether the journal is fully open, or has an open publishing option (hybrid journal). How to find a suitable OA journal? (3) 3. Talk to your mentors, librarians, and colleagues who focus on scholarly communication issues in your field Scholars from many disciplines are seeking to promote the development and growth of rigorous OA publishing options in their fields. Make a list of OA publication options in your particular field. Chances are you will be surprised by the range of possibilities Erin McKiernan Discuss access issues with your collaborators up front, before the research is done and the articles written. Erin McKiernan If for some reason you do publish a closed-access article, remember that you can self-archive a copy of your article in a disciplinary or institutional or shared repository. Erin McKiernan Publish where you want “You don’t have to sacrifice quality or academic freedom to publish openly. There are many high-quality OA journals. But if you can't find what you deem a suitable OA venue, it's important to remember that open publishing is not restricted to these journals. You can publish in any journal you like and make a copy of your manuscript available (self-archive) in an OA repository.” ~78% of publishers allow authors to openly archive a version of their published manuscript: Breakdown of archiving policies from over 2,100 publishers. Source: Data from SHERPA/RoMEO. Accessed October 2015 and plotted by E.C. McKiernan (CC BY) Preprint and postprint versions Preprints are all the versions of an academic article or other publication before it has been submitted for peer review, while the postprint is the form of the article after all the peer review changes are in place. Repositories – institutional & disciplinary http://roar.eprints.org/ http://opendoar.org/ http://oad.simmons.edu With thanks to Erin C. McKiernan, Twitter: @emckiernan13, and John McKiernan for re-using the content and visuals from the Why Open Research website http://whyopenresearch.org Open Access to Research Data Image courtesy of http://aukeherrema.nl CC-BY Source: http://www.nature.com/nature/journal/v461/n7261/index.html ”If we wait 5 years for (Arctic) data to be released, the Arctic is going to be a very different place” Parsons, Arctic Research Scientist Open Science is now a requirement Research results: “each beneficiary must ensure open access to all peer- reviewed scientific publications” (page 4) Research data: “A new feature of Horizon 2020 is the Open Research Data Pilot (ORD Pilot), designed to improve and maximise access to and reuse of research data generated by projects… The Pilot on Open Research Data will be monitored throughout Horizon 2020 with a view to further developing Commission policy on open research.” (page 7) Report URL: https://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/oa_pilot/h2020-hi-oa-pilot-guide_en.pdf Funders recognise it Open data  make your stuff available on the Web (whatever format) under an open licence  make it available as structured data (e.g. Excel instead of a scan of a table)  use non-proprietary formats (e.g. CSV instead of Excel)  use URIs to denote things, so that people can point at your stuff  link your data to other data to provide context Tim Berners-Lee’s proposal for five star open data - http://5stardata.info “Open data and content can be freely used, modified and shared by anyone for any purpose” http://opendefinition.org How to make data open? 1. Choose your dataset(s) • What can you open? You may need to revisit this step if you encounter problems later. 2. Apply an open license • Determine what IP exists. Apply a suitable licence e.g. CC-BY 3. Make the data available • Provide the data in a suitable format. Use repositories. 4. Make it discoverable • Post on the web, register in catalogues… https://okfn.org WHY SHOULD YOU BE OPEN? Image by wonderwebby CC-BY-NC-SA www.flickr.com/photos/wonderwebby/2723279491 Image courtesy of http://aukeherrema.nl CC-BY It’s part of good research practice Science as an open enterprise https://royalsociety.org/policy/projects/science-public-enterprise/Report “Much of the remarkable growth of scientific understanding in recent centuries is due to open practices; open communication and deliberation sit at the heart of scientific practice.” Royal Society report calls for ‘intelligent openness’ whereby data are accessible, intelligible, assessable and usable. Cut down on academic fraud www.nature.com/news/2011/111101/full/479015a.html Validation of results www.guardian.co.uk/politics/2013/apr/18/uncovered-error-george-osborne- austerity “It was a mistake in a spreadsheet that could have been easily overlooked: a few rows left out of an equation to average the values in a column. The spreadsheet was used to draw the conclusion of an influential 2010 economics paper: that public debt of more than 90% of GDP slows down growth. This conclusion was later cited by the International Monetary Fund and the UK Treasury to justify programmes of austerity that have arguably led to riots, poverty and lost jobs.” More scientific breakthroughs www.nytimes.com/2010/08/13/health/research/13alzheimer.html?pagewanted=all&_r=0 “It was unbelievable. Its not science the way most of us have practiced in our careers. But we all realised that we would never get biomarkers unless all of us parked our egos and intellectual property noses outside the door and agreed that all of our data would be public immediately.” Dr John Trojanowski, University of Pennsylvania A citation advantage A study that analysed the citation counts of 10,555 papers on gene expression studies that created microarray data, showed: “studies that made data available in a public repository received 9% more citations than similar studies for which the data was not made available” Data reuse and the open data citation advantage, Piwowar, H. & Vision, T. https://peerj.com/articles/175 Increased use and economic benefit Up to 2008 • Sold through the US Geological Survey for US$600 per scene • Sales of 19,000 scenes per year • Annual revenue of $11.4 million Since 2009 • Freely available over the internet • Google Earth now uses the images • Transmission of 2,100,000 scenes per year. • Estimated to have created value for the environmental management industry of $935 million, with direct benefit of more than $100 million per year to the US economy • Has stimulated the development of applications from a large number of companies worldwide The case of NASA Landsat satellite imagery of the Earth’s surface: http://earthobservatory.nasa.gov/IOTD/view.php?id=83394&src=ve Image courtesy of http://aukeherrema.nl CC-BY WHAT IS A DMP & WHY WRITE ONE? Image CC-BY-NC-SA by Leo Reynolds www.flickr.com/photos/lwr/13442910354 A DMP is a brief plan to define: • how the data will be created • how it will be documented • who will be able to access it • where it will be stored • who will back it up • whether (and how) it will be shared & preserved DMPs are often submitted as part of grant applications, but are useful whenever researchers are creating data. Data Management Plans (DMP) Jean-François Dechamp & Daniel Spichtinger European Commission Directorate-General for Research & Innovation • Findable – Assign persistent IDs, provide rich metadata, register in a searchable resource,... • Accessible - Retrievable by their ID using a standard protocol, metadata remain accessible even if data aren’t... • Interoperable - Use formal, broadly applicable languages, use standard vocabularies, qualified references... • Reusable - Rich, accurate metadata, clear licences, provenance, use of community standards www.force11.org/group/fairgroup/fairprinciples Making data FAIR CREATING DATA PROCESSING DATA ANALYSING DATA PRESERVING DATA GIVING ACCESS TO DATA RE-USING DATA Research data lifecycle CREATING DATA: designing research, DMPs, planning consent, locate existing data, data collection and management, capturing and creating metadata RE-USING DATA: follow-up research, new research, undertake research reviews, scrutinising findings, teaching & learning ACCESS TO DATA: distributing data, sharing data, controlling access, establishing copyright, promoting data PRESERVING DATA: data storage, back-up & archiving, migrating to best format & medium, creating metadata and documentation ANALYSING DATA: interpreting, & deriving data, producing outputs, authoring publications, preparing for sharing PROCESSING DATA: entering, transcribing, checking, validating and cleaning data, anonymising data, describing data, manage and store data Ref: UK Data Archive: http://www.data-archive.ac.uk/create-manage/life-cycle What data organisation would a re-user like? Planning trick 1: think backwards CREATING DATA PROCESSING DATA PRESERVING DATA GIVING ACCESS TO DATA RE-USING DATA Data organisation http://datasupport.researchdata.nl/en/start-de-cursus/iii-onderzoeksfase/organising-data Some other funders that require DMPs Why manage data? NON PECUNIAE INVESTIGATIONIS CURATORE SED VITAE FACIMUS PROGRAMMAS DATORUM PROCURATIONIS (Not for the research funder, but for life we make data management plans) • Make your research easier • Stop yourself drowning in irrelevant stuff • Save data for later • Avoid accusations of fraud or bad science • Write a data paper • Share your data for re-use • Get credit for it Planning trick 2: include RDM stakeholders Institution RDM policy Facilities €$£ Research funders Publishers Data Availability policy Commercial partners https://www.openaire.eu/briefpaper-rdm-infonoads Responsibilities in RDM https://www.openaire.eu/briefpaper-rdm-infonoads A DMP is about ‘keeping’ data • Storing data < > archiving data • Archived data < > findable data • Findable < > accessible • Accessible < > understandable • Understandable < > usable • A USB stick is not safe • A persistent ID is essential but no guarantee for usability • Data in a proprietary format is not sustainable How to deal with data and context? • Versioning, back-up, storage and archiving –During the project and in the long term • Ethics, consent forms, legal access • Security and technical access • Usage licences What should be preserved and shared? • The data needed to validate results in scientific publications (minimally!). • The associated metadata: the dataset’s creator, title, year of publication, repository, identifier etc. – Follow a metadata standard in your line of work, or a generic standard, e.g. Dublin Core or DataCite, and be FAIR. – The repository will assign a persistent ID to the dataset: important for discovering and citing the data. Research Data Alliance (RDA) http://rd-alliance.github.io/metadata-directory/standards/ FAIR Guiding Principles for scientific data management & stewardship http://www.nature.com/articles/sdata201618 How to select and appraise research data:www.dcc.ac.uk/resources/how-guides/appraise-select-research-data What should be preserved and shared? (2) • Documentation: code books, lab journals, informed consent forms – domain-dependent, and important for understanding the data and combining them with other data sources. • Software, hardware, tools, syntax queries, machine configurations – domain-dependent, and important for using the data. (Alternative: information about the software etc.) Basically, everything that is needed to replicate a study should be available. Plus everything that is potentially useful for others. Research Data Alliance (RDA) http://rd-alliance.github.io/metadata-directory/standards/ FAIR Guiding Principles for scientific data management & stewardship http://www.nature.com/articles/sdata201618 How to select and appraise research data:www.dcc.ac.uk/resources/how-guides/appraise-select-research-data DMPonline A web-based tool to help researchers write DMPs Includes a template for Horizon 2020, guidance from EUDAT and OpenAIRE https://dmponline.dcc.ac.uk How the tool works Click to write a generic DMP Or choose your funder to get their specific template Pick your uni to add local guidance and to get their template if no funder applies Choose any additional optional guidance Data description examples The final dataset will include self-reported demographic and behavioural data from interviews with the subjects and laboratory data from urine specimens provided. From NIH data sharing statements Every two days, we will subsample E. affinis populations growing under our treatment conditions. We will use a microscope to identify the life stage and sex of the subsampled individuals. We will document the information first in a laboratory notebook and then copy the data into an Excel spreadsheet. The Excel spreadsheet will be saved as a comma separated value (.csv) file. From DataOne – E. affinis DMP example Metadata examples Metadata will be tagged in XML using the Data Documentation Initiative (DDI) format. The codebook will contain information on study design, sampling methodology, fieldwork, variable-level detail, and all information necessary for a secondary analyst to use the data accurately and effectively. From ICPSR Framework for Creating a DMP We will first document our metadata by taking careful notes in the laboratory notebook that refer to specific data files and describe all columns, units, abbreviations, and missing value identifiers. These notes will be transcribed into a .txt document that will be stored with the data file. After all of the data are collected, we will then use EML (Ecological Metadata Language) to digitize our metadata. EML is one of the accepted formats used in ecology, and works well for the types of data we will be producing. We will create these metadata using Morpho software, available through KNB. The metadata will fully describe the data files and the context of the measurements. From DataOne – E. affinis DMP example Image courtesy of http://aukeherrema.nl CC-BY Use standards of your domain Digital Curation Centre General • Dublin Core (DC) • Datacite metadata schema • Metadata Object Description Schema (MODS) Humanities • Text Encoding Initiative (TEI) • Visual Resources Association Core (VRA) Archives/Repositories • DatastaR minimD-space metadata • um Metadata Social Science • Data Documentation Initiative (DDI) Life Sciences • Darwin Core • Integrated Taxonomic information System (ITIS) Earth Science • Directory Interchange Format (DIF) • Standard for the Exchange of Earthquake Data (SEED) Ecology • Ecological Metadata Language (EML) Geographic/Geospatial • Federal Geographic Data Committee (FGDC) • ISO 19115 • Geospatial Interoperability Framework (GIF) METADATA STANDARDS Metadata standards Use relevant standards for interoperability www.dcc.ac.uk/resources/metadata-standards http://rd-alliance.github.io/metadata-directory Data sharing examples We will make the data and associated documentation available to users under a data-sharing agreement that provides for: (1) a commitment to using the data only for research purposes and not to identify any individual participant; (2) a commitment to securing the data using appropriate computer technology; and (3) a commitment to destroying or returning the data after analyses are completed. From NIH data sharing statements The videos will be made available via the bristol.ac.uk website (both as streaming media and downloads) HD and SD versions will be provided to accommodate those with lower bandwidth. Videos will also be made available via Vimeo, a platform that is already well used by research students at Bristol. Appropriate metadata will also be provided to the existing Vimeo standard. All video will also be available for download and re-editing by third parties. To facilitate this Creative Commons licenses will be assigned to each item. In order to ensure this usage is possible, the required permissions will be gathered from participants (using a suitable release form) before recording commences. From University of Bristol Kitchen Cosmology DMP Examples restrictions Because the STDs being studied are reportable diseases, we will be collecting identifying information. Even though the final dataset will be stripped of identifiers prior to release for sharing, we believe that there remains the possibility of deductive disclosure of subjects with unusual characteristics. Thus, we will make the data and associated documentation available to users only under a data-sharing agreement. From NIH data sharing statements Examples restrictions (2) 1. Share data privately within 1 year. Data will be held in Private Repository, but metadata will be public 2. Release data to public within 2 years. Encouraged after one year to release data for public access. 3. Request, in writing, data privacy up to 4 years. Extensions beyond 3 years will only be granted for compelling cases. 4. Consult with creators of private CZO datasets prior to use. Pis required to seek consent before using private data they can access From Boulder Creek Critical Zone Observatory DMP Archiving examples The investigators will work with staff at the UKDA to determine what to archive and how long the deposited data should be retained. Future long- term use of the data will be ensured by placing a copy of the data into the repository. From ICPSR Framework for Creating a DMP Data will be provided in file formats considered appropriate for long- term access, as recommended by the UK Data Service. For example, SPSS Portal forat and tab-delimited text for qualitative tabular data and RTF and PDF/A for interview transcripts. Appropriate documentation necessary to understand the data will also be provided. Anonymised data will be held for a minimum of 10 years following project completion, in compliance with LSHTM’s Records Retention and Disposal Schedule. Biological samples (output 3) will be deposited with the UK BioBank for future use. From Writing a Wellcome Trust Data Management and Sharing Plan Sharing data: what is meant? With collaborators while research is active Data are mutable (Open) data sharing Data are stable, searchable, citable, clearly licensed Storing data: what is meant? Storing and backing up files while research is active Likely to be on a networked filestore or hard drive Archiving or preserving data in the long-term Likely to be deposited in a digital repository afeguarded and preserved Archiving, repositories, ehm? • Select a data repository that will preserve your data, metadata and possibly tools in the long term. • It is advisable to contact the repository of your choice when writing the first version of your DMP. • Repositories may offer guidelines for sustainable data formats and metadata standards, as well as support for dealing with sensitive data and licensing. Where to find a repository? • More information: https://www.openaire.eu/opendatapilot-repository • Zenodo: http://www.zenodo.org • Re3data.org: http://www.re3data.org How to select a repository? • Main criteria for choosing a data repository: Certification as a ‘Trustworthy Digital Repository’, with an explicit ambition to keep the data available in the long term. • Three common certification standards for TDRs: Data Seal of Approval: http://datasealofapproval.org/en nestor seal: http://www.langzeitarchivierung.de/Subsites/nestor/EN/nestor- Siegel/siegel_node.html ISO 16363: http://www.iso16363.org How to select a repository? (2) • Matches your particular data needs: e.g. formats accepted; mixture of Open and Restricted Access. • Provides guidance on how to cite the data that has been deposited. • Gives your submitted dataset a persistent and globally unique identifier: for sustainable citations – both for data and publications – and to link back to particular researchers and grants. www.openaire.eu/opendatapilot-repository Zenodo (OpenAIRE/CERN repository) www.zenodo.org Zenodo Repository • Multiple data types • Publications • Long tail of research data • Citable data (DOI) • Links to funding, pubs, data, software “Catch-all” repository: OpenAIRE-CERN joint effort 151 www.zenodo .org H2020: Option to gather, preserve and share project’s scientific output • How to develop a DMP www.dcc.ac.uk/resources/how-guides/develop- data-plan • RDM brochure and template https://dans.knaw.nl/en/about/organisation- and-policy/information- material?set_language=en • OpenAIRE guidelines • www.openaire.eu/opendatapilot-dmp • ICPSR framework for a DMP www.icpsr.umich.edu/icpsrweb/content/datama nagement/dmp/framework.html Guidelines on DMPs www.dcc.ac.uk/resources/how-guides/license-research-data Licensing research data This DCC guide outlines the pros and cons of each approach and gives practical advice on how to implement your licence CREATIVE COMMONS LIMITATIONS NC Non-Commercial What counts as commercial? ND No Derivatives Severely restricts use These clauses are not open licenses Horizon 2020 Open Access guidelines point to: or EUDAT licensing tool Answer questions to determine which licence(s) are appropriate to use http://ufal.github.io/public-license-selector Other resources Where to keep research data http://www.dcc.ac.uk/resources/how-guides- checklists/where-keep-research-data/where-keep-research-data Five steps to decide what data to keep http://www.dcc.ac.uk/resources/how-guides/five-steps-decide-what-data- keep Re3data http://www.re3data.org/ Figshare https://figshare.com/ Genbank https://www.ncbi.nlm.nih.gov/genbank/ How to write a lay summary http://www.dcc.ac.uk/resources/how- guides/write-lay-summary Lay summaries https://www.bhf.org.uk/research/information-for- researchers/how-to-apply/lay-summaries www.eudat.eu www.openaire.eu With thanks to Marjan Grootveld: marjan.grootveld@dans.knaw.nl Sarah Jones: sarah.jones@glasgow.ac.uk Acknowledgements: Thanks to DANS and DCC for reuse of slide Research ethics and Data Protection with thanks to GESIS Research ethics: useful links • National advisory board on research ethics (Helsinki, 2009): Ethical principles of research in the humanities and social and behavioural sciences and proposals for ethical review: http://www.tenk.fi/sites/tenk.fi/files/ethicalprinciples.pdf • RatSWD (German Data Forum): Principles and Review Procedures of Research Ethics in the Social and Economic Sciences: https://www.ratswd.de/dl/RatSWD_Output9.5_Summary_Research_Ethics.pdf • Ethics Assessment in Different Fields: Humanities by Rok Benčin, Jelica Šumič Riha, Rado Riha, Scientific Research Centre of the Slovenian Academy of Sciences and Arts (ZRC SAZU): http://satoriproject.eu/media/2.e-Humanities.pdf Research ethics “The ethics of data focuses on ethical problems posed by the collection and analysis of large datasets and on issues ranging from the use of big data in biomedical research and social sciences, to profiling, advertising and data philanthropy as well as open data.” Research ethics (2) “Key issues concern possible re-identification of individuals through data-mining, -linking, - merging and re-using of large datasets, as well as risks for so-called ‘group privacy’, when the identification of types of individuals, independently of the de-identification of each of them, may lead to serious ethical problems, from group discrimination (e.g. ageism, ethnicism, sexism) to group-targeted forms of violence.” Research ethics (3) “Trust and transparency are also crucial topics in the ethics of data, in connection with an acknowledged lack of public awareness of the benefits, opportunities, risks and challenges associated with data science. For example, transparency is often advocated as one of the measures that may foster trust. However, it is unclear what information should be made transparent and to whom information should be disclosed.” Research ethics (4) “The ethics of algorithms addresses issues posed by the increasing complexity and autonomy of algorithms broadly understood (e.g. including artificial intelligence and artificial agents such as Internet bots), especially in the case of machine learning applications. In this case, some crucial challenges include moral responsibility and accountability of both designers and data scientists with respect to unforeseen and undesired consequences as well as missed opportunities.” Research ethics (5) “Unsurprisingly, the ethical design and auditing of algorithms' requirements and the assessment of potential, undesirable outcomes (e.g. discrimination or the promotion of antisocial content) is attracting increasing research.” Research ethics (6) “Finally, the ethics of practices (including professional ethics and deontology) addresses the pressing questions concerning the responsibilities and liabilities of people and organizations in charge of data processes, strategies and policies, including data scientists, with the goal to define an ethical framework to shape professional codes about responsible innovation, development and usage, which may ensure ethical practices fostering both the progress of data science and the protection of the rights of individuals and groups. Three issues are central in this line of analysis: consent, user privacy and secondary use." http://rsta.royalsocietypublishing.org/content/374/2083/20160360 Some more useful links • Guide to Research Ethics - Research with human participants (faculty of humanities): http://www.humanities.uct.ac.za/sites/default/files/image_tool/images/2/HumFa culty%20Ethics%20Guidebook%20August%20l%202016%281%29.pdf • CESSDA User Guide on Research Data Management Data Consent and Ethics: https://cessda.net/content/download/245/2411/file/CESSDA%20User%20Guide%20f or%20data%20management_8_Data%20consent%20and%20ethics.pdf https://www.fosteropenscience.eu/content/research-ethics-and-legal-compliance- informed-consent-and-data-licensing Data Protection • Data protection is especially difficult in qualitative data (interviews, videos) • Informed consent, participation is voluntary, aim and scope of survey and (re-)use of data must be transparent • Participants in surveys can withdraw consent at any point in time, also after survey was completed, but only until data is completely anonymized Data Protection (2) Complete anonymisation is often very difficult or impossible to achieve for micro data, data can be shared when it is “factually anonymous” (at least by German court ruling, not quite sure about other countries) https://cessda.net/content/download/243/2401/file/CESSDA%20User%20Guide%20fo r%20data%20management_6_Data%20security.pdf Data protection: tips • Collected survey data and personal data (such as addresses, telephone number etc. needed for field work) must be stored separately • Sensitive information (such as on race, ethnicity, health, religion, political views and engagement, sexual orientation) need even stronger protection • Re-identification of survey participants is strictly forbidden for both primary researchers and secondary users Open Science taxonomy Paper available at http://oro.open.ac.uk/44719/. Image available at http://oro.open.ac.uk/47806/ FOSTER – an Open Science portal Course: Introduction to Open Science • Online material with re-usable/open licenses • Videos, readings, quizzes, certificate • Self-paced for the time being • Forum where learners can post questions Direct link to the course https://www.fosteropenscience.eu/content/open-science-scientific-research Objectives & project activities 2017-2019 – Strengthening Open Science training capacity in ERA – Focusing on practical implementation of Open Science & ‘training the trainers’ – Training resources: new topics RDM & Open Data + intermediate & advanced level, and discipline specific – Involving disciplines: • Humanities • Social sciences • Life sciences Save the date: Open Science Trainer Bootcamp 18-20 April Become an Open Science trainer in our 3 day programme in Barcelona! For more information check the news on our website. www.fosteropenscience.eu/news Book sprint: Open Science Training Handbook, 12-15 February, Germany Share your experience and help to write a book! Open Science trainers and educators will collaboratively author a training handbook. Check the news on our website and apply now. www.fosteropenscience.eu/news Thank you! Questions? iryna.kuchma@eifl.net