Transcript

PowerPoint Presentation

The NISO Altmetrics InitiativeAltmetrics14Bloomington, IN

Nettie Lagace (@abugseye)NISO Associate Director for Programs

1Whats NISO?Non-profit industry trade association accredited by ANSI with 150+ membersMission of developing and maintaining standards related to information, documentation, discovery and distribution of published materials and mediaRepresent US interests to ISO TC46 (Information and Documentation) and also serve as Secretariat for ISO TC46/SC 9 (Identification and Description)Responsible for standards like ISSN, DOI, Dublin Core metadata, DAISY digital talking books, OpenURL, SIP, NCIP, MARC records and ISBN (indirectly)Volunteer driven organization: 400+ spread out across the world2Premise of StandardsConsensus standards created by a community with various stakeholdersTrustLeading to broader acceptance

Standards as plumbingStandards facilitate trade, commerce and innovationStandards reduce costsStandards support better communication and interoperability across systems

3Definitions and PrinciplesBalance: no single interest category constitutes a majority of the membership / voting pool / working group: producer, user, general interest4

JATSRecommended PracticeStandardConsensus: respond to all comments and make efforts to resolve negative votes, even if proposal is approved

Open process: allowing members and the community to have confidence in NISO standards.

OAMI

Why worth funding? Scholarly assessment is critical to the overall processWhich projects get fundedWho gets promoted and tenureWhich publications are prominentAssessment has been based on citation since the 60sTodays scholars multiple types of interactions with scholarly content are not reflectedIs non-traditional scholarly output important too?6Why worth funding? In order to move out of pilot and proof-of-concept phases Altmetrics must coalesce around commonly understood definitions, calculations and data sharing practicesAltmetrics must be able to be audited Organizations who want to apply metrics will need to understand them and ensure consistent application and meaning across the community72 Phases Phase 1Describe the current state of the altmetrics discussionIdentify potential action items for further work on best practices and standardsHold meetings of stakeholders to define a high-level list of issuesOctober 2013, San FranciscoDecember 2013, Washington, DCJanuary 2014, PhiladelphiaPublic WebinarsWhite paper output, public presentations, public feedback82 Phases - Phase 2Phase 2: Create Working Group within NISO structure, to create recommended practice(s) and/or standard(s)Education/training efforts to ensure implementationFinal report to Sloan due November 2015

Steering Committee Euan Adie, AltmetricAmy Brand, Harvard UniversityMike Buschman, Plum AnalyticsTodd Carpenter, NISOMartin Fenner, Public Library of Science (PLoS) (Chair)Michael Habib, Reed ElsevierGregg Gordon, Social Science Research Network (SSRN)William Gunn, MendeleyNettie Lagace, NISOJamie Liu, American Chemical Society (ACS)Heather Piwowar, ImpactStoryJohn Sack, HighWire PressPeter Shepherd, Project CounterChristine Stohn, Ex LibrisGreg Tananbaum, SPARC (Scholarly Publishing & Academic Resources Coalition)10ApproachOpen format: lightning talks, brainstorming, breakout groups, etc.

Include all stakeholders

Focus on collecting unstructured input

Make all material (including audio recordings of steering group) publicly available

Meeting Lightning TalksExpectations of researchersExploring disciplinary differences in the use of social media in scholarly communicationAltmetrics as part of the services of a large university library systemDeriving altmetrics from annotation activityAltmetrics for Institutional Repositories: Are the metadata ready?Snowball Metrics: Global Standards for Institutional BenchmarkingInternational Standard Name IdentifierAltmetric.com, Plum Analytics, Mendeley reader surveyTwitter InconsistencyLightning" by snowpeak is licensed under CC BY 2.0

DiscussionsSan FranciscoWashington DCPhiladelphiaBusiness & Use CasesBusiness & Use Cases

Use Cases (3X)Quality & Data scienceQualitative vs. QuantitativeData IntegrityDefinitionsDefinitions/Defining ImpactDefinitionsDevelopment & InfrastructureIdentifying Stakeholders and their ValuesStandardsFuture ProofingInterviewsThirty researchers, administrators, librarians, funders (and others)

Semi-structured interview

March April 2014

Develop specific definitions for alternative assessment metrics.Agree on using the term altmetrics, or on using a different term.Define subcategories for alternative assessment metrics, as needed.Identify research output types that are applicable to the use of metrics.Define appropriate metrics for specific output types.Agree on main use cases for alternative assessment metrics.Develop statement about role of alternative assessment metrics in research evaluation.Identify specific scenarios for the use of altmetrics in research evaluation (e.g., research data, social impact).Promote and facilitate use of persistent identifiers.Research reproducibility issues.Develop strategies to improve data quality."Q is for Question Mark" by b4b2 is licensed under CC BY 2.0

Develop strategies to increase trust, e.g., openly available data, audits, or a clearinghouse.Identify best practices for grouping and aggregating multiple data sources.Identify best practices for grouping and aggregation by journal, author, institution, and funder.Define contributorship roles.Establish context and normalization over time, by discipline and country.Describe main use cases for the different stakeholder groups. Identify best practices for identifying contributor categories (e.g., scholars vs. general public).Identify organizations to include in further discussions.Identify existing standards to include in further discussions.Prioritize further activities.Clarify researcher strategy (e.g., driven by researcher uptake vs. mandates by funders and institutions)."Q is for Question Mark" by b4b2 is licensed under CC BY 2.0

http://www.niso.org

Next stepsFinalize and release white paper and draft new work item proposal for standards/best practices based on the study Proposal vetted by NISO leadership and membersProposal approved and working groups formed for Phase II of the projectThank you!Questions?Nettie Lagace [email protected]@abugseye

23


Top Related