<meta http-equiv="content-type" content="text/html;charset=iso-8859-1">
<body>
- <h1>Testing</h1>
- A test should be done on code committed to svn. Commit, then test. That way one can know for sure *what* code was actually tested.
+ <h1>Release testing</h1>
+ A release test must be done on code committed to svn. Commit, then test. That way one can know for sure *what* code was actually tested.
+ <p>
+ Note that this testing document does not have anything to do with testing that is done
+ before committing to svn. It is a test document for released code. Pre-commit testing
+ is done mostly by the developer who has written the change. Release testing is
+ done on code believed to be stable, often a couple of weeks old, and not by
+ the developers, but rather users and community testers who has the requisite hardware
+ and test setup. Also the testing can take place over an extended period of time.
+ <p>
+ All of the above makes it imperative that there can be no doubt about *which* code
+ is tested and thus all tests refer to committed code by subversion number.
<h1>Release procedure</h1>
- OpenOCD trunk is work in progress. Expect it to change daily and to have some work in progress.
+ OpenOCD trunk is work in progress. Expect it to change daily and to have some quirks.
<p>If you need the latest released and tested version, look for binary snapshots of OpenOCD. Worst case look up the test result table below for the features that are important to you and extract and build the version that has the right cocktail of working features for you. You can also work with the community to address the problems you are seing. Testing work and bug reports are highly appreciated.</p>
<p>The OpenOCD community may decide to create release branches. If this happens, then a branch will be created from OpenOCD trunk. The particular version to create that branch might be an older version rather than the latest and greatest. Fixes are then ported to that release branch from OpenOCD trunk.</p>
<h2>Vocabulary</h2>
<table border="1">
<tr>
<td width="100">Passed version</td>
- <td>The latest version on which the test is known to pass</td>
+ <td>The latest branch and version on which the test is known to pass</td>
</tr>
<tr>
<td width="100">Broken version</td>
- <td>The latest version on which the test is known to fail. n/a when older than passed version.</td>
+ <td>The latest branch and version on which the test is known to fail. n/a when older than passed version.</td>
</tr>
<tr>
<td width="100">ID</td>
- <td>A unqiue ID to refer to a test. The unique numbers are maintained in this file.</td>
+ <td>A unqiue ID to refer to a test. The unique numbers are maintained in this file. Note that the same test can be run on different hardware/interface. Each combination yields a unique id. </td>
</tr>
</table>
<p></p>
<p>The latest version in which the test is known to have passed is in the table below.</p>
<table border="1">
<tr>
- <th width="65">ID</th>
- <th width="150">Synopsis</th>
+ <th width="100">Unique ID</th>
+ <th width="165">Synopsis</th>
+ <th align="center" width="110">JTAG device</th>
<th align="center" width="110">Passed version</th>
<th align="center" width="110">Broken version</th>
</tr>
<tr>
- <td width="65">ocd1</td>
- <td width="150">Telnet Windows</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td >fill_malloc</td>
+ <td width="165">Fill malloc() memory with garbage</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65">ocd2</td>
- <td width="150">Telnet Linux</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td >ocd1</td>
+ <td width="165">Telnet Windows</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65">ocd3</td>
- <td width="150">Telnet Cygwin</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td >ocd2</td>
+ <td width="165">Telnet Linux</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#test_ocd4">ocd4</a></td>
- <td width="150">ARM7 debugging</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td >ocd3</td>
+ <td width="165">Telnet Cygwin</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65">xscale1</td>
- <td width="150">XScale debugging</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td ><a href="#test_ocd4">ocd4</a></td>
+ <td width="165">ARM7 debugging</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65">xscale2</td>
- <td width="150">XScale MMU</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td >SAM9260</td>
+ <td width="165">SAM9260 debugging</td>
+ <td align="center">ft2232 </td>
+ <td align="center">500</td>
+ <td align="center">n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
- <td width="150">str710 ram debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110">n/a</td>
+ <td >xscale1</td>
+ <td width="165">XScale debugging</td>
+ <td align="center" >bitbang</td>
+ <td align="center" >505</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
- <td width="150">str710 rom debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110"><b>406</b></td>
+ <td >xscale2</td>
+ <td width="165">XScale debugging</td>
+ <td align="center" >FT2232</td>
+ <td align="center" >202</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
- <td width="150">str912 ram debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110">n/a</td>
+ <td ><a href="#bdte-ram">bdte-ram1</a></td>
+ <td width="165">str710 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
- <td width="150">str912 rom debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110">n/a</td>
+ <td ><a href="#bdte-rom">bdte-rom2</a></td>
+ <td width="165">str710 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-ram">bdte-ram</a></td>
- <td width="150">lpc2148 ram debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110">n/a</td>
+ <td ><a href="#bdte-ram">bdte-ram3</a></td>
+ <td width="165">str912 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="65"><a href="#bdte-rom">bdte-rom</a></td>
- <td width="150">lpc2148 rom debugging</td>
- <td align="center" width="110">320</td>
- <td align="center" width="110">n/a</td>
+ <td ><a href="#bdte-rom">bdte-rom4</a></td>
+ <td width="165">str912 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-ram">bdte-ram5</a></td>
+ <td width="165">lpc2148 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-rom">bdte-rom6</a></td>
+ <td width="165">lpc2148 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-ram">bdte-ram7</a></td>
+ <td width="165">lpc2294 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-rom">bdte-rom8</a></td>
+ <td width="165">lpc2294 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-ram">bdte-ram9</a></td>
+ <td width="165">sam7s256 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-rom">bdte-rom10</a></td>
+ <td width="165">sam7s256 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-ram">bdte-ram11</a></td>
+ <td width="165">sam7x256 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >517</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-rom">bdte-rom12</a></td>
+ <td width="165">sam7x256 rom debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >517</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td ><a href="#bdte-ram">bdte-ram13</a></td>
+ <td width="165">at91r40008 ram debugging</td>
+ <td align="center" >JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
</tr>
</table>
<p></p>
<hr>
<h1>OpenOCD JTAG device test results</h1>
Each JTAG device must be tested
+
<table border="1">
<tr>
- <th align="center" width="45">ID</th>
- <th width="65">Synopsis</th>
- <th width="110">Passed version</th>
- <th width="110">Broken version</th>
+ <th align="center" width="40">ID</th>
+ <th width="90">Synopsis</th>
+ <th >Passed version</th>
+ <th >Broken version</th>
</tr>
<tr>
- <td width="45">jtag1</td>
- <td width="65">Wiggler</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td width="40">jtag1</td>
+ <td width="90">Parport</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="45">jtag2</td>
- <td width="65">Parport</td>
- <td align="center" width="110">291</td>
- <td align="center" width="110">n/a</td>
+ <td width="40">jtag2</td>
+ <td width="90">JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
</tr>
<tr>
- <td width="45">jtag3</td>
- <td width="65">JTAGkey</td>
- <td align="center" width="110">406</td>
- <td align="center" width="110">n/a</td>
+ <td width="40">jtag3</td>
+ <td width="90">Turtelizer2</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td width="40">jtag4</td>
+ <td width="90">JTAGkey</td>
+ <td align="center" >536</td>
+ <td align="center" >n/a</td>
+ </tr>
+ <tr>
+ <td width="40">jtag5</td>
+ <td width="90">add new one</td>
+ <td align="center" >n/a</td>
+ <td align="center" >n/a</td>
+ </tr>
+ </table>
+ <p>jtag1:</p>
+ <p>jtag2: Tested on Windows XP Prof. (SP2) with original FTDI driver.</p>
+ <p>jtag3: Tested on Windows XP Prof. (SP2) with original FTDI driver.</p>
+ <p>jtag4: Tested on Mac OS X (10.5.2, Intel) with libftdi-0.10 and libusb-0.1.12</p>
+ <p>jtag5:</p>
+ <hr>
+ <h1>OpenOCD JTAG device speed test result</h1>
+ <p>The test result is in KB/sec.</p>
+ <table border="1">
+ <tr>
+ <th align="center" width="50">ID</th>
+ <th width="90">Synopsis</th>
+ <th width="40">r320</th>
+ <th width="40">r420</th>
+ <th width="40">r423</th>
+ <th width="40">r459</th>
+ <th width="40">r517</th>
+ <th width="40">r536</th>
+ </tr>
+ <tr>
+ <td width="50"><a href="#speed1">speed1</a></td>
+ <td width="90">JTAGkey</td>
+ <td align="center" width="40">93</td>
+ <td align="center" width="40">64 </td>
+ <td align="center" width="40">93</td>
+ <td align="center" width="40">93</td>
+ <td align="center" width="40">93</td>
+ <td align="center" width="40">93</td>
+ </tr>
+ <tr>
+ <td width="50"><a href="#speed2">speed2</a></td>
+ <td width="90">JTAGkey</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">52</td>
+ <td align="center" width="40">52</td>
+ </tr>
+ <tr>
+ <td width="50">speed3</td>
+ <td width="90">add new one</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
+ <td align="center" width="40">n/a</td>
</tr>
</table>
<p></p>
<p>This test was made under Eclipse with the Zylin Embedded CDT plugin. For the GDB "Initialize commands" take a look in the examples/<target>/prj/<b>eclipse_rom.gdb</b> file.</p>
<p>Start debugging, the debugger should download and store the program in the flash of the target.</p>
<p>Now you can make some tests like described in the <a href="#bdte-ram">bdte-ram</a> section above too.</p>
+ <hr>
+ <h1>speed1 - Download speed test<a id="speed1" name="speed1"></a></h1>
+ <p>For this test a STR710 with external memory was used. The example project can be found under examples/STR710JtagSpeed. Here Eclipse or the arm-elf-gdb can be used to download the test.elf file into the RAM. The result of the GDB can look like:</p>
+ <p>Loading section .text, size 0x6019c lma 0x62000000<br>
+ Start address 0x62000040, load size 393628<br>
+ Transfer rate: 93 KB/sec, 2008 bytes/write.</p>
+ <p>In this example a speed of 93 KB/sec was reached. The hardware which was used for the test can be found <a href="http://www.yagarto.de/projects/str7usbmsd/index.html" target="new">here</a>.</p>
+ <p>The test was made on Windows XP Prof. (SP2) with a JTAGkey and the original FTDI driver.</p>
+ <hr>
+ <h1>speed2 - Download speed test<a id="speed2" name="speed2"></a></h1>
+ <p>For this test a STR710 with external memory was used. The example project can be found under examples/STR710JtagSpeed. Here Eclipse or the arm-elf-gdb can be used to download the test.elf file into the RAM. The result of the GDB can look like:</p>
+ <p>Loading section .text, size 0x6019c lma 0x62000000<br>
+ Start address 0x62000040, load size 393628<br>Transfer rate: 52 KB/sec, 2008 bytes/write.</p>
+ <p>In this example a speed of 52 KB/sec was reached. The hardware which was used for the test can be found <a href="http://www.yagarto.de/projects/str7usbmsd/index.html" target="new">here</a>.</p>
+ <p>The test was made on Mac OS X (10.5.2, Intel) with a JTAGkey and the following driver:</p>
+ <p>- libftdi 0.10<br>
+ - libusb 0.1.12</p>
<p></p>
<p></p>
</body>
Code Review / openocd.git / blobdiff