Team, We are reviewing and compiling our results and will send out in the next couple hours.
Thanks, Mark From: SOON HWANG CHOI [mailto:[email protected]] Sent: Wednesday, October 14, 2015 5:41 AM To: ??? Cc: iotivity-dev at lists.iotivity.org; Sung-Kyu Ko; Mirani, Jawid; Tung, Mark Y; sean.berry at intel.com; Munimallappa, Jayadev; Yemane, Habteab L; ???; ???; ???; ???; ???; ???; Lankswert, Patrick; Kesavan, Vijay S Subject: Re: Request for IoTivity 1.0.0 QA result Dear June Here is Samsung QA report for IoTivity 1.0 RC3 1. QA Summary - Total Pass Rate : 98.8% (5,582/68/5,650, Pass/Fail/Total) - Active Defect : 12 (0/3/9, Critial/Major/Minor) : Registered in JIRA 2. Test results API & Sample App Test Summary (Pass Rate 98.8 %) No. Component ? Total Ubuntu Tizen Android Arduino Ubuntu (by ver) ? All Ver 2.3 5.0 (Lollipop) AT Mega 2560 12.04(32bit) 12.04(64bit) 14.04(32bit) 14.04(64bit) ? Pass Fail Total Pass % Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total 1 TM ? 695 4 699 99.4% 488 0 488 112 4 116 95 0 95 0 0 0 122 0 122 122 0 122 122 0 122 122 0 122 2 RH ? 261 0 261 100.0% 180 0 180 37 0 37 44 0 44 0 0 0 45 0 45 45 0 45 45 0 45 45 0 45 3 RE ? 751 11 762 98.6% 596 8 604 121 2 123 34 1 35 0 0 0 149 2 151 149 2 151 149 2 151 149 2 151 4 IS ? 364 8 372 97.8% 364 8 372 0 0 0 0 0 0 0 0 0 91 2 93 91 2 93 91 2 93 91 2 93 5 CA ? 2292 28 2320 98.8% 1604 24 1628 115 2 117 412 2 414 161 0 161 401 6 407 401 6 407 401 6 407 401 6 407 6 PM ? 675 8 683 98.8% 604 8 612 59 0 59 12 0 12 0 0 0 151 2 153 151 2 153 151 2 153 151 2 153 7 PHY ? 42 0 42 100.0% 0 0 0 0 0 0 39 0 39 3 0 3 0 0 0 0 0 0 0 0 0 0 0 0 8 RD ? 108 8 116 93.1% 108 8 116 0 0 0 0 0 0 0 0 0 27 2 29 27 2 29 27 2 29 27 2 29 9 RC ? 394 1 395 99.7% 312 0 312 82 1 83 0 0 0 0 0 0 78 0 78 78 0 78 78 0 78 78 0 78 Total ? 5582 68 5650 98.8% 4256 56 4312 526 9 535 636 3 639 164 0 164 1064 14 1078 1064 14 1078 1064 14 1078 1064 14 1078 API Test (Pass Rate 99.1 %) No. Component ? Total Ubuntu Tizen Android (5.0) Arduino Ubuntu (by ver) ? All Ver 2.3 5.0 (Lollipop) AT Mega 2560 12.04(32bit) 12.04(64bit) 14.04(32bit) 14.04(64bit) ? Pass Fail Total Pass % Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total 1 TM 447 0 447 100.0% 316 0 316 76 0 76 55 0 55 NA NA 0 79 0 79 79 0 79 79 0 79 79 0 79 2 RH 140 0 140 100% 100 0 100 20 0 20 20 0 20 NA NA 0 25 0 25 25 0 25 25 0 25 25 0 25 3 RE 458 0 458 100.0% 360 0 360 90 0 90 8 0 8 NA NA 0 90 0 90 90 0 90 90 0 90 90 0 90 4 IS 268 0 268 100.0% 268 0 268 0 0 0 0 0 0 NA NA 0 67 0 67 67 0 67 67 0 67 67 0 67 5 CA 1964 28 1992 98.6% 1380 24 1404 100 2 102 364 2 366 120 0 120 345 6 351 345 6 351 345 6 351 345 6 351 6 PM 475 0 475 100.0% 404 0 404 59 0 59 12 0 12 NA NA 0 101 0 101 101 0 101 101 0 101 101 0 101 7 PHY 32 0 32 100.0% 0 0 0 0 0 0 29 0 29 3 0 3 0 0 0 0 0 0 0 0 0 0 0 0 8 RD 56 8 64 87.5% 56 8 64 0 0 0 0 0 0 NA NA 0 14 2 16 14 2 16 14 2 16 14 2 16 9 RC 330 0 330 100.0% 264 0 264 66 0 66 0 0 0 NA NA 0 66 0 66 66 0 66 66 0 66 66 0 66 Total ? 4170 36 4206 99.1% 3148 32 3180 411 2 413 488 2 490 123 0 123 787 8 795 787 8 795 787 8 795 787 8 795 Sample App Test (Pass Rate 97.8 %) No. Component Total Ubuntu Tizen Android Arduino Ubuntu (by ver) All Ver 2.3 5.0 (Lollipop) AT Mega 2560 12.04(32bit) 12.04(64bit) 14.04(32bit) 14.04(64bit) Pass Fail Total Pass % Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total Pass Fail Total 1 TM 248 4 252 98% 172 0 172 36 4 40 40 0 40 NA NA 0 43 0 43 43 0 43 43 0 43 43 0 43 2 RH 121 0 121 100% 80 0 80 17 0 17 24 0 24 NA NA 0 20 0 20 20 0 20 20 0 20 20 0 20 3 RE 293 11 304 96.4% 236 8 244 31 2 33 26 1 27 NA NA 0 59 2 61 59 2 61 59 2 61 59 2 61 4 IS 96 8 104 92.3% 96 8 104 0 0 0 0 0 0 NA NA 0 24 2 26 24 2 26 24 2 26 24 2 26 5 CA 328 0 328 100.0% 224 0 224 15 0 15 48 0 48 41 0 41 56 0 56 56 0 56 56 0 56 56 0 56 6 PM ? 200 8 208 96.2% 200 8 208 0 0 0 0 0 0 NA NA 0 50 2 52 50 2 52 50 2 52 50 2 52 7 PHY 10 0 10 100.0% 0 0 0 0 0 0 10 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 8 RD 52 0 52 100.0% 52 0 52 0 0 0 0 0 0 NA NA 0 13 0 13 13 0 13 13 0 13 13 0 13 9 RC 64 1 65 98.5% 48 0 48 16 1 17 0 0 0 NA NA 0 12 0 12 12 0 12 12 0 12 12 0 12 Total ? 1412 32 1444 97.8% 1108 24 1132 115 7 122 148 1 149 41 0 41 277 6 283 277 6 283 277 6 283 277 6 283 3. Active Defect List Active defect is registered in IoTivity Jira 1. https://jira.iotivity.org/browse/IOT-801 2. https://jira.iotivity.org/browse/IOT-802 3. https://jira.iotivity.org/browse/IOT-803 4. https://jira.iotivity.org/browse/IOT-804 5. https://jira.iotivity.org/browse/IOT-805 6. https://jira.iotivity.org/browse/IOT-806 7. https://jira.iotivity.org/browse/IOT-807 8. https://jira.iotivity.org/browse/IOT-808 9. https://jira.iotivity.org/browse/IOT-<https://jira.iotivity.org/browse/IOT-809>809<https://jira.iotivity.org/browse/IOT-809> 10. https://jira.iotivity.org/browse/IOT-<https://jira.iotivity.org/browse/IOT-810>810<https://jira.iotivity.org/browse/IOT-810> 11. https://jira.iotivity.org/browse/IOT-811 12. https://jira.iotivity.org/browse/IOT-812 4. Excluded features of1.0 Release and QA - CA Tizen BT/BLE - Resource Container Android - Resource Directory Tizen, Android Regards Soonhwang Choi ------- Original Message ------- Sender : ???<juney at samsung.com<mailto:juney at samsung.com>> S6(??)/??/IoT Solution Lab(S/W??)/???? Date : 2015-10-14 18:16 (GMT+09:00) Title : Request for IoTivity 1.0.0 QA result George, Jawid, Mark / Intel SoonHwang / Samsung Could you provide the 1.0.0 QA result, so that we can decide 1.0.0 release tomorrow. Regards June June Yong Young OIC Open Sourece WG Project Planning & Requirement TG Chair IoTivity Release Function Lead Samsung Electronics Co.,Ltd. Software R&D Center, IoT Solution Lab. | Web & Convergence Team Principal Engineer T: +82-31-301-6107, M: +82-10-9530-6107 E-mail :juney at samsung.com Choi, Soon Hwang Senior Engineer / Ph. D. Software Engineering Team (SE Team) Software R&D Center SAMSUNG ELECTRONICS CO.,LTD AnyCall +82-10-7311-0206 e-mail soonhwang.choi at samsung.com<mailto:soonhwang.choi at samsung.com> [http://ext.samsung.net/mailcheck/SeenTimeChecker?do=cb027b4aba19c2dc6493244119c804dcd76a0833148b31198bdb9940d733fa4e936d3ec707deeb425eb58cb4a337b810aa8f112c08b63c45db9fdddda33e82cbe4a391424e62fcf6cf878f9a26ce15a0] -------------- next part -------------- A non-text attachment was scrubbed... Name: ATT03972 1.jpg Type: image/jpeg Size: 24010 bytes Desc: ATT03972 1.jpg URL: <http://lists.iotivity.org/pipermail/iotivity-dev/attachments/20151014/3f772015/attachment.jpg>
