Actions
action #46874
closed[sle][functional][rt][y] - replace rt_preempt_test by rt-tests ( cyclictest & hackbench )
Status:
Resolved
Priority:
High
Assignee:
Category:
Bugs in existing tests
Target version:
SUSE QA - Milestone 23
Start date:
2019-01-30
Due date:
2019-02-26
% Done:
0%
Estimated time:
Difficulty:
Description
We can remove above mentioned test module from openQA due to below reasons:
- not packaged for sle15sp1, available for sle12sp1
- makefile updates are required
- requires libboost packages
- executed as part of regression milestone test plan
Since RT customer requires rt-tests package to be available on our system and in fact it should be available for both (sles and slert). I would like to replace rt_preempt_test by rt-tests modules.
In the past, QA help to ensure the below and then run the testing for each release.
- Ensure that package rt-tests is installed
- Ensure that ibmrtpkgs is installed and execute to ensure some settings such as kthread-priority, etc
- Execute cyclictest -a -n -t -p 99 -l 1000000 ( <- or more number to collect maximum latency ) for both OS
- Open another terminal and execute hackbench -l 1000000 ( <- or more number to make the system busy as long as possible )
- Do the comparison
Acceptance criteria¶
- make sure that rt-tests & ibmrtpkgs packages are available in repo and can be installed successfully
- execute cyclictest -a -n -t -p 99 -l 100 -v
- execute hackbench -l 100
- do not gather or store any data
- create a follow up ticket for next Milestone manual test to gather data from SLERT and SLES. Please include above steps (1..5)
Example executions
time cyclictest -a -n -t -p 99 -l 100 -v
Max CPUs = 6
# /dev/cpu_dma_latency set to 0us
Thread 0 Interval: 1500
Thread 1 Interval: 2000
Thread 2 Interval: 2500
Thread 3 Interval: 3000
Thread 4 Interval: 3500
Thread 5 Interval: 4000
0: 0: 16
0: 1: 16
0: 2: 16
0: 3: 2
0: 4: 14
0: 5: 14
0: 6: 14
0: 7: 5
0: 8: 14
0: 9: 14
1: 0: 13
1: 1: 2
1: 2: 14
1: 3: 14
1: 4: 18
1: 5: 14
1: 6: 19
2: 0: 4
2: 1: 3
2: 2: 3
2: 3: 16
2: 4: 14
3: 0: 5
3: 1: 13
3: 2: 2
3: 3: 16
4: 0: 7
4: 1: 8
4: 2: 8
5: 0: 13
5: 1: 19
0: 10: 3
0: 11: 3
0: 12: 2
0: 13: 2
0: 14: 2
0: 15: 3
0: 16: 2
0: 17: 2
0: 18: 2
0: 19: 2
0: 20: 4
1: 7: 4
1: 8: 14
1: 9: 14
1: 10: 13
1: 11: 24
1: 12: 14
2: 5: 4
2: 6: 3
2: 7: 2
2: 8: 3
2: 9: 2
3: 4: 14
3: 5: 14
3: 6: 23
3: 7: 14
4: 3: 8
4: 4: 8
4: 5: 7
5: 2: 3
5: 3: 13
5: 4: 26
0: 21: 2
0: 22: 2
0: 23: 2
0: 24: 2
0: 25: 2
0: 26: 2
0: 27: 2
0: 28: 2
0: 29: 2
0: 30: 2
1: 13: 4
1: 14: 13
1: 15: 2
1: 16: 17
1: 17: 2
1: 18: 18
1: 19: 2
2: 10: 3
2: 11: 3
2: 12: 2
2: 13: 2
2: 14: 3
3: 8: 14
3: 9: 18
3: 10: 14
3: 11: 14
4: 6: 8
4: 7: 8
4: 8: 8
4: 9: 8
5: 5: 2
5: 6: 13
5: 7: 17
0: 31: 2
0: 32: 2
0: 33: 2
0: 34: 2
0: 35: 2
0: 36: 2
0: 37: 2
0: 38: 2
0: 39: 2
0: 40: 2
1: 20: 2
1: 21: 2
1: 22: 13
1: 23: 2
1: 24: 12
1: 25: 6
1: 26: 17
2: 15: 3
2: 16: 2
2: 17: 3
2: 18: 3
2: 19: 3
3: 12: 14
3: 13: 16
3: 14: 14
3: 15: 18
4: 10: 7
4: 11: 8
4: 12: 9
5: 8: 13
5: 9: 16
5: 10: 13
0: 41: 2
0: 42: 2
0: 43: 2
0: 44: 2
0: 45: 2
0: 46: 2
0: 47: 2
0: 48: 2
0: 49: 2
0: 50: 2
1: 27: 2
1: 28: 12
1: 29: 2
1: 30: 12
1: 31: 8
1: 32: 17
1: 33: 2
2: 20: 3
2: 21: 2
2: 22: 2
2: 23: 2
2: 24: 2
3: 16: 14
3: 17: 14
3: 18: 14
3: 19: 14
4: 13: 3
4: 14: 8
4: 15: 8
4: 16: 7
5: 11: 14
5: 12: 14
5: 13: 18
0: 51: 3
0: 52: 2
0: 53: 2
0: 54: 2
0: 55: 2
0: 56: 2
0: 57: 2
0: 58: 2
0: 59: 2
0: 60: 2
0: 61: 2
1: 34: 13
1: 35: 2
1: 36: 16
1: 37: 2
1: 38: 13
1: 39: 6
1: 40: 13
2: 25: 4
2: 26: 2
2: 27: 2
2: 28: 2
2: 29: 2
2: 30: 9
3: 20: 16
3: 21: 18
3: 22: 14
3: 23: 14
4: 17: 8
4: 18: 7
4: 19: 8
5: 14: 25
5: 15: 14
5: 16: 15
0: 62: 2
0: 63: 2
0: 64: 2
0: 65: 2
0: 66: 2
0: 67: 2
0: 68: 2
0: 69: 2
0: 70: 2
0: 71: 2
1: 41: 2
1: 42: 13
1: 43: 2
1: 44: 13
1: 45: 2
1: 46: 23
1: 47: 3
2: 31: 3
2: 32: 2
2: 33: 2
2: 34: 2
2: 35: 3
3: 24: 3
3: 25: 13
3: 26: 3
3: 27: 23
4: 20: 8
4: 21: 7
4: 22: 9
4: 23: 12
5: 17: 14
5: 18: 14
5: 19: 24
0: 72: 3
0: 73: 2
0: 74: 2
0: 75: 2
0: 76: 2
0: 77: 2
0: 78: 2
0: 79: 2
0: 80: 2
0: 81: 2
1: 48: 14
1: 49: 2
1: 50: 13
1: 51: 2
1: 52: 13
1: 53: 6
1: 54: 13
2: 36: 5
2: 37: 2
2: 38: 3
2: 39: 2
2: 40: 2
3: 28: 3
3: 29: 13
3: 30: 3
3: 31: 13
4: 24: 9
4: 25: 8
4: 26: 9
5: 20: 14
5: 21: 14
5: 22: 14
0: 82: 3
0: 83: 2
0: 84: 2
0: 85: 2
0: 86: 2
0: 87: 2
0: 88: 2
0: 89: 2
0: 90: 2
0: 91: 2
0: 92: 2
1: 55: 3
1: 56: 18
1: 57: 2
1: 58: 13
1: 59: 2
1: 60: 17
1: 61: 2
2: 41: 4
2: 42: 2
2: 43: 3
2: 44: 2
2: 45: 2
3: 32: 3
3: 33: 18
3: 34: 16
3: 35: 14
3: 36: 3
4: 27: 9
4: 28: 8
4: 29: 7
5: 23: 14
5: 24: 25
5: 25: 19
0: 93: 1
0: 94: 2
0: 95: 2
0: 96: 2
0: 97: 2
0: 98: 2
0: 99: 2
1: 62: 13
1: 63: 3
1: 64: 13
1: 65: 2
1: 66: 17
1: 67: 6
2: 46: 2
2: 47: 3
2: 48: 2
2: 49: 2
2: 50: 2
3: 37: 13
3: 38: 2
3: 39: 16
3: 40: 14
4: 30: 4
4: 31: 8
4: 32: 8
4: 33: 9
5: 26: 14
5: 27: 14
5: 28: 14
real 0m0.166s
user 0m0.002s
sys 0m0.005s
time hackbench -l 100
Running in process mode with 10 groups using 40 file descriptors each (== 400 tasks)
Each sender will pass 100 messages of 100 bytes
Time: 0.283
real 0m0.321s
user 0m0.093s
sys 0m1.432s
Test suite documentation¶
Updated by riafarov about 5 years ago
- Due date set to 2019-02-26
@mloviska, could you please put AC for it?
Updated by okurz about 5 years ago
- Category changed from New test to Bugs in existing tests
- Priority changed from Normal to High
- Target version set to Milestone 23
As you mentioned this ticket in the test scenario on the currently failing test module I recommend to treat it with higher prio. However, you could simply remove the failing test module for now from the test plan and we plan with less urgency.
Updated by mloviska about 5 years ago
- Subject changed from [sle][functional][rt][y] - replace or remove rt_preempt_test to [sle][functional][rt][y] - replace rt_preempt_test by rt-tests ( cyclictest & hackbench )
Updated by mloviska about 5 years ago
- Status changed from New to In Progress
- Assignee set to mloviska
Updated by mloviska about 5 years ago
- Due date changed from 2019-02-26 to 2019-02-12
- Status changed from In Progress to Feedback
Updated by mloviska about 5 years ago
- Related to action #47162: [sle][functional][rt][y] - run cyclictest & hackbench tests on bare metal for Milestone RC1 added
Updated by riafarov about 5 years ago
- Due date changed from 2019-02-12 to 2019-02-26
- Status changed from Feedback to Blocked
https://bugzilla.suse.com/show_bug.cgi?id=1123315
As Martin has mentioned, we have a hope to get it fixed in the next sprint.
Updated by riafarov about 5 years ago
- Blocks action #45152: [sle][functional][y][rt] extend test coverage of RT installation added
Updated by mloviska about 5 years ago
- Status changed from Blocked to Resolved
Actions