riscoss convention ossmetera.bagnato
TRANSCRIPT
Automated Analysis and Measurement of Open-Source
Software @ OW2con'13 RISCOSS Convention
Alessandra Bagnato
Softeam R&D
Issy-les-Moulineaux, 12th November 2013
1
Selecting OSS
Is a challenging task
Time, cost of error, stress
Approaches
Use over-simplified selection criteria
Try to avoid making a decision altogether
Choose arbitrary default options
Overestimate their expertise
Become highly risk averse
Selecting OSS
Is a challenging task
Time, cost of error, stress
Approaches
Use over-simplified selection criteria
Try to avoid making a decision altogether
Choose arbitrary default options
Overestimate their expertise
Become highly risk averse
Selecting OSS
Many OSS projects with similar/overlapping functionality
Adopters are looking for OSS that is … of high quality (fast, secure, extensible etc.)
supported by a substantial team of developers
• questions answered
• bugs fixed
• new requirements implemented
backed by a company
used by other people
going to be around for a while
Monitoring OSS
The health of OSS needs to be monitored after initial selection has taken place The company behind an OSS project may
fold/switch focus
OSS developers may change jobs (or simply lose interest)
A newer/better OSS may make the project obsolete
Adopters need to be warned early enough to set up a transition plan
OSSMETER Vision
Develop a platform that will support decision makers in the process of discovering, comparing, assessing and monitoring the health, quality, impact and activity of open-source software
Late/no replies to questionsInfrequent source code updates
Bugs not fixedInfrequent releases
Small number of downloadsFew external references
Quick replies to questionsFrequent source code updates
Bugs fixed quicklyFrequent releases
Large number of downloadsMany external references
Qua
lity/M
atu
rity
?
Sources of Information
OSS forge metadata
Source code repositories
Issue/bug tracking systems
User communication channels
Newsgroups, forums
OSS Project
Communication channel (Newsgroup/forum/
mailing list)
Source CodeRepository
Bug Tracking System
OSS ForgeMetadata
Expected Results
Metamodels for capturing meta-information relevant to OSS projects (e.g. types and details of source code repositories, communication channels and bug tracking systems, types of licences, number of downloads etc.)
OSS Project
Communication channel (Newsgroup/forum/
mailing list)
Source CodeRepository
Bug Tracking System
OSS ForgeMetadata
Expected Results
OSS analysis based on advances in language-agnostic and language-specific methods for code analysis, state-of-the-art Natural Language Processing (NLP) and text mining techniques
Source Code Analysis
Current state of practice: Language-Agnostic Analysis
#LoC vs. comments
File extensions
OSSMETER contribution: Language-Aware Analysis
Integrate current state-of-the-art in source code analysis
Tailored metrics for source code
Bug Tracking and Communication Channel Analysis
Current state of practice # of bugs # of messages
OSSMETER contributions Thread analysis
• How many people ask/answer questions? • How do users feel about the support they
receive? • How does this evolve over time?
Bug lifecycle analysis • Are bugs fixed? How long does it take on
average?
…
OSS Project
Communication channel (Newsgroup/forum/
mailing list)
Source CodeRepository
Bug Tracking System
OSS ForgeMetadata
Expected Results
Extensible cloud-based platform enabling users to discover and compare OSS projects, which can also support quality analysis and monitoring of in-house software development projects
OSSMETER Platform
Platform Storage, analysis
API Interoperability
Web application Presentation
Available both as a service and as a platform that can be deployed in-house to monitor internal projects for local deployment
Beneficiaries
Developers and Project Managers who are responsible for deciding on the adoption of OSS, will be able to make decisions on hard facts and uniform quality indicators
Developers of OSS will be able to monitor the quality of the OSS projects they contribute to and promote the projects using independently calculated and trustworthy quality indicators, and identify related projects for establishing synergies
Funding Bodies supporting projects which produce OSS will be able to monitor the quality and assess the impact of the produced software even after the end of the projects
Current state of platform
Data Persistence
Object Mapper
OSSMETER Platform
Metrics Connectors
Project Analysis and Management
Front-end
OSSMETER Browse
OSSMETER Monitor & Compare
Partners (1/2)
Industrial Partners
The Open Group (UK)
Tecnalia (ES)
Softeam (FR)
Uninova (PT)
Unparallel Innovation (PT)
Partners (2/2)
Academic Partners
CWI (NL)
• Expertise in source code analysis
University of Manchester (UK)
• Expertise in text mining
University of York (UK) & University of L’Aquila (IT)
• Expertise in Model Driven Engineering
Inter-Project Collaboration
Future services to facilitate FLOSS development and adoption by EU research and business communities http://ec.europa.eu/digital-agenda/events/cf/ict2013/item-display.cfm?id=10341
Participants from MARKOS project - n 317743 "Global level view of open
source software on the web" RISCOSS project - n.318249 "Risk management of OSS
development in the cloud" OSSMETER project - n. 318736 "Measurement and
analysis of open source software: a big data challenge" PROSE project - n. 318218 "OSS development support
tools: how a software forge can sustain H2020 innovation"
Contacts
Alessandra Bagnato
SOFTEAM | ModelioSoft
OSSMETER Web Site:
http://www.ossmeter.eu @ossmeter
SOFTEAM R&D Web Site:
http://rd.softeam.com
Modelio UML Open Source Modeling Tool Web Site :
http://www.modelio.org
www.modeliosoft.com 22