Testing new lib builds on Arm
This blueprint is designed to explore the possibility of using existing tests within the Linux Standards Base to test new architecture level builds of libraries on arm processors, as well as other ideas for testing to ensure library api's don't break.
Blueprint information
- Status:
- Complete
- Approver:
- David Mandala
- Priority:
- High
- Drafter:
- Tobin Davis
- Direction:
- Approved
- Assignee:
- None
- Definition:
- Obsolete
- Series goal:
- Accepted for lucid
- Implementation:
-
Blocked
- Milestone target:
-
lucid-alpha-2
- Started by
- Tobin Davis
- Completed by
- Tobin Davis
Whiteboard
[asac]: this spec couldnt be done and should not be resurrected without developer resource assignment. ... from feedback i got from the folks working on this, it seems that upstream is not really ready for use anywhere outside of their own environment.
[asac]: setting status blocked to reflect the upstream problems.
Work items lucid-alpha-2:
Determine and document selected list of tests on wiki: DONE
Port selected tests to Arm Karmic build environment: POSTPONED
Run baseline tests from Karmix for armv5 by Alpha 1: POSTPONED
Talk to IS about integrating into archive test-rebuild process: POSTPONED
Solve rebuild issue for selective rebuild of libs alone: POSTPONED
Create scripts to handle auto-test on rebuild: POSTPONED
Results for lucid/armv7 for Alpha 2: POSTPONED
Deploy for build/use for every release with new toolchain in future: POSTPONED
Discuss arm port of LSB tests with Linux Foundation: DONE
Work items lucid-alpha-3:
Port selected tests to Arm Karmic build environment: DONE
Run baseline tests from Karmix for armv5 by Alpha 1: DONE
Results for lucid/armv7 for Alpha 2: DONE
Port OLVER Tests: DONE
Run baseline OLVER tests: DONE
Port T2C Test Suite: DONE
Run baseline T2C tests: DONE
Port TET-Harness for T2C test suite: DONE
[persia] Package TET-Harness: DONE
[persia] Package OLVER tests: POSTPONE
[persia] Provide packages in private ppa (licensing issues) that allow reproducible local results: POSTPONE
Create instructions how to locally reproduce results/run tests: POSTPONE
Work items ubuntu-
[persia] Package OLVER tests: POSTPONE
[persia] Provide packages in private ppa (licensing issues) that allow reproducible local results: POSTPONE
Create instructions how to locally reproduce results/run tests: POSTPONE
Comments:
[asac] setting to high priority as this is part of validating that the new toolchain flags don't cause unexpected regressions.
[GrueMaster] Documenting work items and process notes from UDS.
[asac] please massage wiki syntax a bit (e.g. * ... got truncated to one line)
[GrueMaster] Fixed.
[asac] please add details about where to get the bzr sources from linux foundation.
[GrueMaster] Will do as part of first task on worklist. not all sources are at Linuxfoundation, as they have contracted ISPRAS to write some of the tests.
[asac] approved. thx!
[khoroshilov] All sources of the tests developed by ISPRAS are in the Linux Foundation bzr. What sources do you mean?
[GrueMaster] Initial searching led me astray. All LSB source is on http://
12/14/2009
[GrueMaster] OLVER Tests have successfully been built and are now running. After this initial run, I'll post results and double check the changes needed for cleanliness and completeness. Then I'll work on a deb-build environment for it.
12/18/2009
[GrueMaster] Created lsb-arm-port on launchpad to publish patches needed to run lsb test suites. Initial push of olver-core-tests patches and readme file.
1/4/2010
[GrueMaster] Proposed changes to the BP work items:
Port OLVER Tests: DONE
Run baseline OLVER tests: DONE
Package OLVER tests: TODO
Port TET-Harness for T2C test suite: DONE
Package TET-Harness: TODO
Port T2C Test Suite: DONE
Run baseline T2C tests: DONE
Package T2C Tests: INPROGRESS
Port libstdcpp test suite: POSTPONE
Run baseline libstdcpp test suite: POSTPONE
Package libstdcpp test suite: POSTPONE
1/8/2010
[GrueMaster] Finished porting T2C-Harness & T2C-cpp-tests. Tests ran ok. Need to parse test results.
1/11/2010
[GrueMaster] Removed libstdcpp tests from list as these are the same as the tests built into the libstdc++ library build system.
[asac 13-01-10] postponing all not yet finished alpha-2 items and duplicating them below to somehow reflect that those items didn't get done in alpha-2 and moved to alpha-3 (e.g. added workload there) (lets cross finger the new work item software agrees!)
[asac 29-01-10] test results are available; switch from auto-run tests to manual instructions.
[asac 29-01-10] moved the individual porting/packaging tasks to be official work items
Status:
done: porting to arm; test run base tests for karmic/karmic, karmic/lucid and lucid/lucid on wiki; todo: integration first batch of upstream fixes; get packages in a private ppa; blocked on bad license: bringing packages to a public archive/ppa
