wrote up explaining why tests are done on committed code.
[openocd.git] / testing / index.html
index dc02bb605eb0b420f56e0b7a63b7a5d41e4e7e3d..267c2a7be33353dd467296ffc5a1c6d857d44aaa 100644 (file)
@@ -3,8 +3,18 @@
        <meta http-equiv="content-type" content="text/html;charset=iso-8859-1">
 
        <body>
-               <h1>Testing</h1>
-               A test should be done on code committed to svn. Commit, then test. That way one can know for sure *what* code was actually tested.
+               <h1>Release testing</h1>
+               A release test must be done on code committed to svn. Commit, then test. That way one can know for sure *what* code was actually tested.
+               <p>
+               Note that this testing document does not have anything to do with testing that is done 
+               before committing to svn. It is a test document for released code. Pre-commit testing
+               is done mostly by the developer who has written the change. Release testing is
+               done on code believed to be stable, often a couple of weeks old, and not by
+               the developers, but rather users and community testers who has the requisite hardware
+               and test setup. Also the testing can take place over an extended period of time.
+               <p>
+               All of the above makes it imperative that there can be no doubt about *which* code
+               is tested and thus all tests refer to committed code by subversion number.  
                <h1>Release procedure</h1>
                OpenOCD trunk is work in progress. Expect it to change daily and to have some work in progress.
                <p>If you need the latest released and tested version, look for binary snapshots of OpenOCD. Worst case look up the test result table below for the features that are important to you and extract and build the version that has the right cocktail of working features for you. You can also work with the community to address the problems you are seing. Testing work and bug reports are highly appreciated.</p>
                <table border="1">
                        <tr>
                                <th width="65">ID</th>
-                               <th width="150">Synopsis</th>
+                               <th width="165">Synopsis</th>
+                               <th align="center" width="110">JTAG device</th>
                                <th align="center" width="110">Passed version</th>
                                <th align="center" width="110">Broken version</th>
                        </tr>
                        <tr>
                                <td width="65">ocd1</td>
-                               <td width="150">Telnet Windows</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">Telnet Windows</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65">ocd2</td>
-                               <td width="150">Telnet Linux</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">Telnet Linux</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65">ocd3</td>
-                               <td width="150">Telnet Cygwin</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">Telnet Cygwin</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65"><a href="#test_ocd4">ocd4</a></td>
-                               <td width="150">ARM7 debugging</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">ARM7 debugging</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65">xscale1</td>
-                               <td width="150">XScale debugging</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">XScale debugging</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65">xscale2</td>
-                               <td width="150">XScale MMU</td>
-                               <td align="center" width="110">291</td>
+                               <td width="165">XScale MMU</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
+                               <td width="165">str710 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
+                               <td width="165">str710 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
+                               <td width="165">str912 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
+                               <td width="165">str912 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
+                               <td width="165">lpc2148 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
+                               <td width="165">lpc2148 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
-                               <td width="150">str710 ram debugging</td>
-                               <td align="center" width="110">320</td>
+                               <td width="165">lpc2294 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
-                               <td width="150">str710 rom debugging</td>
-                               <td align="center" width="110">320</td>
-                               <td align="center" width="110"><b>406</b></td>
+                               <td width="165">lpc2294 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
-                               <td width="150">str912 ram debugging</td>
-                               <td align="center" width="110">320</td>
+                               <td width="165">sam7s256 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
                                <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
-                               <td width="150">str912 rom debugging</td>
-                               <td align="center" width="110">320</td>
+                               <td width="165">sam7s256 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
+                               <td width="165">sam7x256 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
+                               <td width="165">sam7x256 rom debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+                       <tr>
+                               <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
+                               <td width="165">at91r40008 ram debugging</td>
+                               <td align="center" width="110">JTAGkey</td>
+                               <td align="center" width="110">423</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                </table>
                <hr>
                <h1>OpenOCD JTAG device test results</h1>
                Each JTAG device must be tested
+               
                <table border="1">
                        <tr>
-                               <th align="center" width="45">ID</th>
-                               <th width="65">Synopsis</th>
+                               <th align="center" width="40">ID</th>
+                               <th width="90">Synopsis</th>
                                <th width="110">Passed version</th>
                                <th width="110">Broken version</th>
                        </tr>
                        <tr>
-                               <td width="45">jtag1</td>
-                               <td width="65">Wiggler</td>
-                               <td align="center" width="110">291</td>
+                               <td width="40">jtag1</td>
+                               <td width="90">Parport</td>
+                               <td align="center" width="110">n/a</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
-                               <td width="45">jtag2</td>
-                               <td width="65">Parport</td>
-                               <td align="center" width="110">291</td>
+                               <td width="40">jtag2</td>
+                               <td width="90">JTAGkey</td>
+                               <td align="center" width="110">432</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
                        <tr>
-                               <td width="45">jtag3</td>
-                               <td width="65">JTAGkey</td>
-                               <td align="center" width="110">406</td>
+                               <td width="40">jtag3</td>
+                               <td width="90">Turtelizer2</td>
+                               <td align="center" width="110">432</td>
                                <td align="center" width="110">n/a</td>
                        </tr>
+                       <tr>
+                               <td width="40">jtag4</td>
+                               <td width="90">add new one</td>
+                               <td align="center" width="110">n/a</td>
+                               <td align="center" width="110">n/a</td>
+                       </tr>
+               </table>
+               <p></p>
+               <hr>
+               <h1>OpenOCD JTAG device speed test result</h1>
+               <p>The test result is in KB/sec.</p>
+               <table border="1">
+                       <tr>
+                               <th align="center" width="50">ID</th>
+                               <th width="90">Synopsis</th>
+                               <th width="40">r320</th>
+                               <th width="40">r420</th>
+                               <th width="40">r423</th>
+                       </tr>
+                       <tr>
+                               <td width="50"><a href="#speed1">speed1</a></td>
+                               <td width="90">JTAGkey</td>
+                               <td align="center" width="40">93</td>
+                               <td align="center" width="40">64 </td>
+                               <td align="center" width="40">93</td>
+                       </tr>
+                       <tr>
+                               <td width="50">speed2</td>
+                               <td width="90">add new one</td>
+                               <td align="center" width="40">n/a</td>
+                               <td align="center" width="40">n/a</td>
+                               <td align="center" width="40">n/a</td>
+                       </tr>
                </table>
                <p></p>
                <hr>
                <p>This test was made under Eclipse with the Zylin Embedded CDT&nbsp;plugin. For the GDB &quot;Initialize commands&quot; take a look in the examples/&lt;target&gt;/prj/<b>eclipse_rom.gdb</b> file.</p>
                <p>Start debugging, the debugger should download and store the program in the flash of the target.</p>
                <p>Now you can make some tests like described in the <a href="#bdte-ram">bdte-ram</a> section above too.</p>
-               <p></p>
+               <hr>
+               <h1>speed1 - Download speed test<a id="speed1" name="speed1"></a></h1>
+               <p>For this test a STR710 with external memory was used. The example project can be found under examples/STR710JtagSpeed. Here Eclipse or the arm-elf-gdb can be used to download the test.elf file into the RAM. The result of the GDB&nbsp;can look like:</p>
+               <p>Loading section .text, size 0x6019c lma 0x62000000<br>
+                       Start address 0x62000040, load size 393628<br>
+                       Transfer rate: 93 KB/sec, 2008 bytes/write.</p>
+               <p>In this example a speed of 93 KB/sec was reached. The hardware which was used for the test can be found <a href="http://www.yagarto.de/projects/str7usbmsd/index.html" target="new">here</a>.</p>
                <p></p>
        </body>
 

Linking to existing account procedure

If you already have an account and want to add another login method you MUST first sign in with your existing account and then change URL to read https://review.openocd.org/login/?link to get to this page again but this time it'll work for linking. Thank you.

SSH host keys fingerprints

1024 SHA256:YKx8b7u5ZWdcbp7/4AeXNaqElP49m6QrwfXaqQGJAOk gerrit-code-review@openocd.zylin.com (DSA)
384 SHA256:jHIbSQa4REvwCFG4cq5LBlBLxmxSqelQPem/EXIrxjk gerrit-code-review@openocd.org (ECDSA)
521 SHA256:UAOPYkU9Fjtcao0Ul/Rrlnj/OsQvt+pgdYSZ4jOYdgs gerrit-code-review@openocd.org (ECDSA)
256 SHA256:A13M5QlnozFOvTllybRZH6vm7iSt0XLxbA48yfc2yfY gerrit-code-review@openocd.org (ECDSA)
256 SHA256:spYMBqEYoAOtK7yZBrcwE8ZpYt6b68Cfh9yEVetvbXg gerrit-code-review@openocd.org (ED25519)
+--[ED25519 256]--+
|=..              |
|+o..   .         |
|*.o   . .        |
|+B . . .         |
|Bo. = o S        |
|Oo.+ + =         |
|oB=.* = . o      |
| =+=.+   + E     |
|. .=o   . o      |
+----[SHA256]-----+
2048 SHA256:0Onrb7/PHjpo6iVZ7xQX2riKN83FJ3KGU0TvI0TaFG4 gerrit-code-review@openocd.zylin.com (RSA)