![Page 1: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/1.jpg)
![Page 2: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/2.jpg)
OPNFV CI and ChallengesHow we solved them – if we solved them at all!
Fatih DegirmenciPrincipal Developer, Ericsson
![Page 3: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/3.jpg)
Who am I?
• Principal Developer, Ericsson• Member of the Technical Steering Committee, OPNFV• Project Team Lead, Releng, OPNFV• Committer to several Infrastructure Projects, OPNFV• Active Technical Contributor, OpenStack
![Page 4: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/4.jpg)
What is OPNFV?
Open Platform for Network Functions Virtualization
“OPNFV is a carrier-grade, integrated, open source platform to accelerate the introduction of new NFV products
and services.”
![Page 5: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/5.jpg)
OPNFV is a midstream project
Enhancements
Additions
![Page 6: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/6.jpg)
Realizing ETSI NFV Architecture
![Page 7: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/7.jpg)
To transform telco
![Page 8: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/8.jpg)
Service Providers
Telco/Network Vendors
IT Vendors
Linux Distro Vendors
Education/ResearchInstitutions
Altogether
![Page 9: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/9.jpg)
By doing
DEPLOYDEVS BUILD &INTEGRATE
TEST USERS
![Page 10: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/10.jpg)
We call it Platform CI
Target POD(SUT)
Jumphost
InitiateRun for certain
Scenario
DownloadISO
Deploy FunctestFunctional Testing
YardstickPlatform Benchmarking
Pull DownFunctest Image
Pull DownYardstick Image
Labs connected 24x7using JNLP
Google CloudStorage
DockerHub
DockerHub
![Page 11: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/11.jpg)
Using the tools
![Page 12: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/12.jpg)
On distributed OPNFV Infrastructure
![Page 13: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/13.jpg)
Which is, rather complex…
Lab/POD Ericsson Linux Foundation Orange Intel Huawei
Host OS Ubuntu CentOS
Installer / Cloud Execution Apex Compass Fuel Joid
SDN OpenDaylight ONOS OpenContrail
Testing Functional Testing (Functest) Platform Benchmarking (Yardstick)
Addons / Features SFC BGPVPN KVM for NFV FD.IO
![Page 14: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/14.jpg)
But we achieved a lot!
What Release1Arno
Release2 Brahmaputra
Release3Colorado
Scenarios supported by CI1 2 20+ 37+
No of Pharos labs2 3 12 14
CPU Architecture3 1 1 2
No of nodes utilized by OPNFV Jenkins 13 90+ 130+
Time to run release verification ~30 hours 400+ hours 600+ hours
Total no of OPNFV deployments in CI4 8000+
![Page 15: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/15.jpg)
Despite the Challenges
• Being a midstream project• Availability of stable versions from upstream
• OPNFV Development Workflow• Slow feedback
• Diverse infrastructure and lack of uniformity• Diversity is good but we need some homogeneity
• Community CI/CD Awareness and resistance to change• Contributors with different backgrounds, mindset &
culture
![Page 16: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/16.jpg)
Being a midstream project• OPNFV can go as fast as its slowest upstream…• In order for OPNFV to do CI, upstream must do CD!
![Page 17: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/17.jpg)
OPNFV Development WorkflowProject Team OPNFV gerrit OPNFV CI/Test OPNFV Release OpenStack gerrit OpenStack CI/Test OpenStack Release
Requirement
PatchTest Release
Downstream
Release
Test
Long development cycleDownstream will delay to next releaseSlow feedback, > 5 monthsOPNFV specific issues cannot be tested/detected in time
Document
![Page 18: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/18.jpg)
OPNFV Workflow with 3rd Party CIProject Team OPNFV gerrit OPNFV CI/Test OPNFV Release OpenStack gerrit OpenStack CI/Test OpenStack Release
Requirement
PatchTest Release
Downstream
Release
Test
TestFast feedback
Fast development cycleFast feedback, < 1 dayOPNFV specific issues can be tested/detected in time; Correction in same release
Document
OPNFV Workflow
![Page 19: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/19.jpg)
3rd Party CI
contribute contribute contribute
pull from masterpost feedback
![Page 20: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/20.jpg)
Infrastructure Diversity
LaaS
LaaS
LaaS
![Page 21: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/21.jpg)
Community CI/CD Awareness
Arno ( 2015-06) Brahmaputra (2016-02) Colorado (2016/09) Now (2016/11)0
50
100
150
200
250
300
40
168(+320%)
251(+49%)272(+8%)
13 36(+176%)75(+108%) 84(+12%)
Total Contributors Contributors to CI
![Page 22: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/22.jpg)
In the pipeline
• Re-thinking our CI/CD and Infrastructure• CI and Infrastructure Evolution
• Further increase the community awareness in CI/CD• “Recruit” more core people
• Close collaboration with upstream projects on CI/CD• Push them to CD
![Page 23: OPNFV CI and Challenges: How we solved them - if we solved them at all!](https://reader035.vdocument.in/reader035/viewer/2022070511/58a488b11a28ab58738b6057/html5/thumbnails/23.jpg)
Questions