Changes between Version 9 and Version 10 of GSoC/2017/RTEMSTesterImprovements


Ignore:
Timestamp:
May 24, 2017, 8:43:28 AM (15 months ago)
Author:
Tanu Hari Dixit
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • GSoC/2017/RTEMSTesterImprovements

    v9 v10  
    1818* Currently, the tests that are expected to fail, the results of which are indeterminate and those which timeout because they expect input from user, all are counted as failed (or timeouts in the last case). This masks the actual reasons why a certain test failed (or timed out) and eventuate into test statistics that can be easily misunderstood. Therefore, one objective of the project is to add support for test states “expected-fail”, “indeterminate” and “user-input”, so that they can be tracked separately.
    1919* Furthermore, regression analysis is another objective of the project. Adding YAML files for each bsp that contain an expected statistic for the tests, shall help the cause. Hence, this statistic can be compared with the current number of failed tests and help determine if the BSP has regressed against a change in rtems (or the test results in RTEMS need updating.)
    20 * The present console support in the back end of rtems-tester is given by termios[https://docs.python.org/2/library/termios.html 2]. This python library does not work on Windows[https://docs.python.org/2/library/termios.html#module-termios 3]. Hence, my goal is to integrate PySerial[https://github.com/pyserial/pyserial 4] so that the benefits of it being a cross-platform tool help support consoles on both Windows and Unix.
    21 * Ser2net[7] is used for providing remote access to a unit’s server ports over telnet. It is proposed to add support for a telnet console in rtems-tester so that it becomes convenient to telnet into serially connected devices and test applications on them, remotely.
    22 * I’ll add simulator recipes for RTEMS to work with gem5[8] for sparc64/usiii and arm/realview_pbx_a9_qemu BSPs.
     20* The present console support in the back end of rtems-tester is given by termios[https://docs.python.org/2/library/termios.html 2]. This python library does not work on Windows[https://docs.python.org/2/library/termios.html#module-termios 3]. Hence, my goal is to integrate PySerial [https://github.com/pyserial/pyserial 4] so that the benefits of it being a cross-platform tool help support consoles on both Windows and Unix.
     21* Ser2net is used for providing remote access to a unit’s server ports over telnet. It is proposed to add support for a telnet console in rtems-tester so that it becomes convenient to telnet into serially connected devices and test applications on them, remotely.
     22* I’ll add simulator recipes for RTEMS to work with gem5 for sparc64/usiii and arm/realview_pbx_a9_qemu BSPs.
    2323* I also plan to export the results of rtems-tester to xml format so that it can be plotted easily and used for other analysis as developers and users deem fit.
    2424Why isn't captcha allowing me to go through with this change :(