Release v2.13

Intro

Prep work for the v2.13 release

Pre-Release

Task(s)URL(s)Description
AMI - opencord

Recreate AWS AMI jenkins node image for opencord

AMI - ONOS
Recreate AWS AMI jenkins node image for ONOS.
Priority problem but not a release dependency unless ONOS component upgrades are required.
Upgrades

golang upgrade
Dependency for VGC deployment
Deployment needed to docker, jenkins nodes, (lxc cluster: unknown)
python upgrade
AMI recreation may force an upgrade >3.10.  Affected: voltha-system-tests, robot framework, docs.voltha.org, ...
Testing failures

transient
e2e ping tests, subscriber flow.
bbsim failuresXBulk bbsim testing failure
timeout: voltha-protos

15 minute timeout - profiling / longer runtime related to a change in implementation ?

volthaStackDeploy

Tickets are open for this problem, search needed.

v2.13 release


Failures

VGC/Golang


Jira

VOL-5220
Create a New Jenkins Job for voltha with VGC 
VOL-5229
Upgrade golang (docker image) to v1.17.10
VOL-5222
Upgrade golang version for VOLTHA jobs (grpc)
VOL-5229
docker layer: proto.Dockerfile: golang upgrade to v1.17.10
VOL-5348
venv, pip install grpcio fails locally
VOL-5343
VGC docker file update

Common failures: pingtest


Jira

VOL-5311bbsim

Test Perform BBSim Sanity :: Validates the BBSim Functionality for... | FAIL |

Verify Subscriber Access Flows Added For ONU DT' failed after retrying for 1 minute

VOL-5308bbsim

Test Perform BBSim Sanity :: Validates the BBSim Functionality for... | FAIL |

VOL-5314voltctl

Sanity E2E Test for OLT/ONU on POD :: Validates E2E Ping Connectiv... | FAIL |

Keyword 'Verify Subscriber Access Flows Added For ONU' failed after retrying for 1 minute.

VOL-5331

Sanity E2E Test for OLT/ONU on POD for DT :: Validates E2E Ping Co... | FAIL |

Keyword 'Verify Subscriber Access Flows Added For ONU DT' failed after retrying for 1 minute. The last error was: No matching added upstream flow found for of:00000a0a0a0a0a0a in TABLE 0 (in_port 256)

VOL-5333

Sanity E2E Test for OLT/ONU on POD for DT :: Validates E2E Ping Co... | FAIL |

Keyword 'Verify Subscriber Access Flows Added For ONU DT' failed after retrying for 1 minute. The last error was: No matching added downstream flow found for of:00000a0a0a0a0a0a in TABLE 1 (in_port 16777216; out_port: 256)

VOL-5335pingtest

Sanity E2E Test for TT (HSIA, VoD, VoIP) :: Validates E2E Ping Con... | FAIL |

Keyword 'Validate Device' failed after retrying for 1 minute. The last error was: Device BBSM000a0001 mib_state incorrect (initial-mib-downloaded) values=False: '
repo:voltha-lib-go

VOL-5127bbsimverify_bbsim_sanity-test-failure
VOL-5125bbsimBulk unit test failure tracking ticket.
VOL-5157bbsimverify_bbsim_unit-test failures in job history
search-bbsimbbsimBulk Jira tickets
search-voltctlvoltctlBulk Jira tickets

NOTE: Most testing failures are unrelated to submitted patches:

  • Cosmetic changes, comments added in source.
  • No logic changes: makefile-only edits

repo:bbsim


JiraTypeDescription
VOL-5308transient
unrelated

Unrelated testing failures reported.

Patch gerrit:35214 installs the pre-commit hook in repo:bbsim
Failure: No match found for 'dhcpl2relay-remove-allocation of:00000a0a0a0a0a0a 256' in 5 seconds

repo:voltha-protos


JiraTypeDescription
VOL-5347TimeoutBuild timeout after 20 minutes, cryptic/silent error.
Compiler warning: --std=gnu99 is invalid for c++.  Compiler switch not found in makefiles, may be supplied as a default flag from docker image.
VOL-5332
Silent failure

repo:voltha-go-controller


JiraTypeDescription
VOL-5346timeout

golang-ci timeout after 10 minutes.
Strange error, linting/profiling is threaded so one task has a very long runtime.

Triggering patch applies non-trivial changes to library hierarchy.  Should do a deep dive into the patch, perhaps new code paths have increased runtime, delays, overhead, etc to the point that elapsed runtime exceeds the timeout window.

VOL-5302timeout

See VOL-5346.  Similar content, this ticket contains extra log messages and debug details.

VOL-5304

Define protos for collecting on demand stats from OLT & ONT (may be related to patch timeout)

VOL-5313timeout

 Build timed out (after 20 minutes). Marking the build as failed.

VOL-5318

repo:voltha-go-controller -- verify_voltha-go-controller _unit-test failure

VOL-5325intermittent

Inconsistent behavior – patch recheck reported a new testing failure.

VOL-5324timeout

Use latest SCA-COMMON image for  VOLTHA

  • Patch succeeds when built and tested locally.
  • Patch profiling fails in jenkins.

Definitely will be differences in interpreter and module versions (~golang) when building locally VS jenkins.

repo:voltha-lib-go


JiraTypeDescription
VOL-5335
repo:voltha-lib-go: voltha-go_sanity-test failing E2E ping check

repo:helm-charts


JiraTypeDescription
VOL-5345
Helm chart install failure
Error: unable to build kubernetes objects from release manifest: resource mapping not found for name: "voltha-infra-atomix-pdb" 

repo:openolt


JiraTypeDescription
VOL-5301
Proprietary copyright notice

repo:openolt-adapter


JiraTypeDescription
VOL-5339
Proprietary license in source (paths detailed in a github issue attached to the repository).

repo:voltctl


JiraTypeDescription
VOL-5305
2024-05-01 Silent failure, no jenkins activity logged for this patc
VOL-5323
Two distinct test failures during recheck

Port forwarding + pkill procs within pipelines


JiraTypeDescription
VOL-5306
Port forwarding within VOLTHA builds should be completely removed to improve reliability.

BISDN cleaned up port forwarding, replaced with an ingress controller.
There is lingering pipeline logic that continues to setup/teardown port forwarding, this should be removed.
Also research needed, Jan was not sure of other possible connections (grpc, etc)

VOLTHA: v2.13 Release


JiraRepoDescription
VOL-5319voltctlgo not found

See Also


docs.voltha.org:

Queries