Arduino TestSuite Error

Development Tools IDE 1.x
1

Hi,
the Adruino Testsuite ,from the examples, give me the following error:

ATS_Genaral:
info.MANUFACTURER    = Arduino
info.CPU-NAME        = ATmega328P
info.GCC-Version     = 4.3.5
info.AVR-LibC-Ver    = 1.6.8
info.Compiled-date   = Apr 29 2011
info.Test-Suite-Name = general
info.Free-memory     = 1394 bytes
DigitalReadWrite_02 (helper pin=03)                         ... FAIL
DigitalReadWrite_03 (helper pin=02)                         ... FAIL
DigitalReadWrite_04 (helper pin=05)                         ... FAIL
DigitalReadWrite_05 (helper pin=04)                         ... FAIL
DigitalReadWrite_06 (helper pin=07)                         ... FAIL
DigitalReadWrite_07 (helper pin=06)                         ... FAIL
DigitalReadWrite_08 (helper pin=09)                         ... FAIL
DigitalReadWrite_09 (helper pin=08)                         ... FAIL
DigitalReadWrite_10 (helper pin=11)                         ... FAIL
DigitalReadWrite_11 (helper pin=10)                         ... FAIL
DigitalReadWrite_12 (helper pin=13)                         ... FAIL
DigitalReadWrite_13 (helper pin=12)                         ... FAIL
DigitalReadWrite_14 (helper pin=15)                         ... FAIL
DigitalReadWrite_15 (helper pin=14)                         ... FAIL
DigitalReadWrite_16 (helper pin=17)                         ... FAIL
DigitalReadWrite_17 (helper pin=16)                         ... FAIL
DigitalReadWrite_18 (helper pin=19)                         ... FAIL
DigitalReadWrite_19 (helper pin=18)                         ... FAIL
PWMoutput_03  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
PWMoutput_05  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
PWMoutput_06  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
PWMoutput_09  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
PWMoutput_10  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
PWMoutput_11  (PWM=128 100% LOW 0% HIGH)                    ... FAIL
AnalogInput_00 (Low=   0 High=  31 helper pin=15)           ... FAIL
AnalogInput_01 (Low=1017 High=1017 helper pin=14)           ... FAIL
AnalogInput_02 (Low= 603 High= 660 helper pin=17)           ... FAIL
AnalogInput_03 (Low=1019 High=1020 helper pin=16)           ... FAIL
AnalogInput_04 (Low= 535 High= 602 helper pin=19)           ... FAIL
AnalogInput_05 (Low=1023 High=1023 helper pin=18)           ... FAIL
EEPROM_byte_rw  (addr= 0x0108)                              ... ok
EEPROM_word_rw  (addr= 0x00ED)                              ... ok
EEPROM_dword_rw (addr= 0x002F)                              ... ok
Memory Usage                                                ... ok
--------------------------
Ran 34 tests in 6.761s

FAILED (failures=30)
______________________________________________________________________

ATS_StringIndexOfMemory:
info.MANUFACTURER    = Arduino
info.CPU-NAME        = ATmega328P
info.GCC-Version     = 4.3.5
info.AVR-LibC-Ver    = 1.6.8
info.Compiled-date   = Apr 29 2011
info.Test-Suite-Name = String Memory Test
info.Free-memory     = 604 bytes
The index of > in the string <HTML><HEAD><BODY> is 5
The index of  the second > in the string <HTML><HEAD><BODY> is 11
The index of the body tag in the string <HTML><HEAD><BODY> is 12




Memory Usage (lost 547 bytes)                               ... FAIL
--------------------------
Ran 1 tests in 1.573s

FAILED (failures=1)
______________________________________________________________________

ATS_StringTest:
info.MANUFACTURER    = Arduino
info.CPU-NAME        = ATmega328P
info.GCC-Version     = 4.3.5
info.AVR-LibC-Ver    = 1.6.8
info.Compiled-date   = Apr 29 2011
info.Test-Suite-Name = Test of String Library
info.Free-memory     = 106 bytes
1. Adding a constant integer to a string:                   ... ok
2. Adding a constant long interger to a string              ... FAIL
3. Adding a constant character to a string                  ... FAIL
4. Adding a constant string variable to a string            ... FAIL
5. Adding a constant long interger to a string              ... FAIL
6. Two strings equal                                        ... ok
7. Two strings not equal                                    ... ok
8. Two strings not equal [case sensitivity matters]         ... ok
9. Equals() method equals                                   ... ok
10. Not equals() method equals                              ... ok
11.  EqualsIgnoreCase() method equals                       ... ok
12.  A numeric string compared to the number it represents  ... ok
13.  Two numeric strings compared                           ... ok
18.  The compareTo() operator also allows you to compare strings... ok
19.  The compareTo() String with integers                   ... FAIL
20.  The compareTo()  compare strings with appended integers... FAIL
21. Adding string to string +=                              ... ok
22.  The compareTo()  compare strings with appended integers... ok
--------------------------
Ran 18 tests in 2.592s

FAILED (failures=6)
______________________________________________________________________

ATS_ToneTest:
info.MANUFACTURER    = Arduino
info.CPU-NAME        = ATmega328P
info.GCC-Version     = 4.3.5
info.AVR-LibC-Ver    = 1.6.8
info.Compiled-date   = Apr 29 2011
info.Test-Suite-Name = ToneTest
info.Free-memory     = 1246 bytes
ToneTest.02 (out freq= 1111 measured freq=    0 err= 100%)  ... FAIL
ToneTest.03 (out freq=  263 measured freq=    0 err= 100%)  ... FAIL
ToneTest.04 (out freq=  750 measured freq=    0 err= 100%)  ... FAIL
ToneTest.05 (out freq=  282 measured freq=    0 err= 100%)  ... FAIL
ToneTest.06 (out freq=  293 measured freq=    0 err= 100%)  ... FAIL
ToneTest.07 (out freq= 1415 measured freq=    0 err= 100%)  ... FAIL
ToneTest.08 (out freq=  478 measured freq=    0 err= 100%)  ... FAIL
ToneTest.09 (out freq=  207 measured freq=    0 err= 100%)  ... FAIL
ToneTest.10 (out freq= 1692 measured freq=    0 err= 100%)  ... FAIL
ToneTest.11 (out freq= 1383 measured freq=    0 err= 100%)  ... FAIL
ToneTest.12 (out freq=  613 measured freq=    0 err= 100%)  ... FAIL
ToneTest.13 (out freq= 1930 measured freq=    0 err= 100%)  ... FAIL
ToneTest.14 (out freq=  845 measured freq=    0 err= 100%)  ... FAIL
ToneTest.15 (out freq=  314 measured freq=    0 err= 100%)  ... FAIL
ToneTest.16 (out freq= 1876 measured freq=    0 err= 100%)  ... FAIL
ToneTest.17 (out freq= 1769 measured freq=    0 err= 100%)  ... FAIL
ToneTest.18 (out freq= 1772 measured freq=    0 err= 100%)  ... FAIL
ToneTest.19 (out freq= 1276 measured freq=    0 err= 100%)  ... FAIL
ToneTesDurationt.02 (durationTime =   0/1000 freq err= 100%)... FAIL
ToneTesDurationt.07 (durationTime =   0/1000 freq err= 100%)... FAIL
ToneTesDurationt.12 (durationTime =   0/1000 freq err= 100%)... FAIL
ToneTesDurationt.17 (durationTime =   0/1000 freq err= 100%)... FAIL
Memory Usage                                                ... ok
--------------------------
Ran 23 tests in 28.913s

FAILED (failures=22)

Is this normal? During the tests, nothing was connected (on the Arduino 2009).

2

senden9:
...

ATS_Genaral:

...
DigitalReadWrite_02 (helper pin=03)                         ... FAIL
...



...nothing was connected (on the Arduino 2009).

I'll just take the first Failure message:
The test sketch calls ATS_TEST_DigitalPin(2). Look at the code in the ArduinoTestSuite/ArduinoTestSuite.cpp

It sets pin 2 high and reads pin 3 if pin 3 is high then it sets pin 2 low and reads pin 3. The test fails if the value read from pin 3 is not equal to the value written to pin 2.

So...connect a jumper from pin 2 to pin 3 and try again.

To see whether other test results are significant, read the code and see if you can figure out how to explain the results and to see whether something can be done to "fix" the results. See Footnote.

Regards,

Dave

Footnote:
Test programs are, well, programs. Sometimes there are bugs (or "issues") that causes such a program to report bugs in whatever it is testing, but which are actually bugs (or "issues") in the test program itself.

For example:
There are a couple of Failures in the ATS_StringTest sketch that are not due to any external connections, but are actually bugs. The failures can be explained and they can be "fixed" by minor changes in the test sketch. That makes no nevermind to me, since I do not (and will not) use Arduino Strings in any of my personal programs.

3

Ah, OK thanks.