Re: Testsuite for avr-as

[Erik Christiansen <erik at dd dot nec dot com dot au>]

On Thu, Dec 09, 2004 at 06:20:31AM -0500, Hans-Peter Nilsson wrote:
> On Thu, 9 Dec 2004, Erik Christiansen wrote:
> > On Tue, Dec 07, 2004 at 08:06:34AM -0500, Hans-Peter Nilsson wrote:
> > > Ignore site.exp, it's just there to confuse you.  No magic. Copy
> > > the .exp:s I quoted and just s/mmix/avr/.  All framework set, no
> > > need to copy anything else; go write the actual tests.
> >
> > Maybe not magic, but that was truly the map through the minefield.
> 
> Now, really.  I don't see how it could be much simpler, save
> for not writing any files at all.

Oh-Oh!! I've offended with my praise of help received! Sorry. :-(

It is the benefit of your knowledge which has made it simpler for me too.
Thankyou! :-)

> > After rebuilding binutils, to detect the new testsuite directory, we
> > have:
> >
> > Running /usr/local/src/binutils-041119/gas/testsuite/gas/arm/arm.exp ...
> > Running /usr/local/src/binutils-041119/gas/testsuite/gas/avr/avr.exp ...
> > Running /usr/local/src/binutils-041119/gas/testsuite/gas/cfi/cfi.exp ...
> 
> Do I understand correctly that you have tests in
> gas/testsuite/gas/avr but that they aren't run?

Nope, my message was intended to be positive, but here I failed to make
clear that the tests are running. I was, and am, thrilled with the
progress. :-)

In fact, the informative error messages shown in the log erased any
doubts that dejagnu is the way to go. 

[snip]

> > a) Figure out how to specify the assembler path, so we can regression
> >    test a newly built one. (Doesn't seem to be an option in the *.d
> >    head)
> 
> No, you don't have to do this, the framework does it for you.
> What I said should be all that's needed.  Did you change all
> mmix-* to avr-*?

Nope, I followed the Dec 07 advice, quoted at the top of this email,
copying only mmix.exp to gas/testsuite/gas/avr/avr.exp, and performing
the substitution. Was that the right thing to do?

Would you be able to hint how "the framework does it for you"?
Looking in the Makefile in obj-avr/gas, to find out where config is
picked up, the "check" target becomes "check-recursive", which doesn't
seem to be there. So now I'm digging through run_dump_test, since it
must be revealed that way. (Eventually :-)

> > b) Figure out why the test run gobbles up 250 ptys, then resumes after a
> > 2 minute wait:
> >
> > Running /usr/local/src/binutils-041119/gas/testsuite/gas/all/gas.exp ...
> > ERROR: Can't run gas/all/comment.s: The system has no more ptys.  Ask
> > your system administrator to create more.
> > ERROR: timeout
> 
> I have no idea.  Using an old tcl or expect version?

Thanks for the tip! I'll try upgrading related debian woody packages.

> Usually people build in a directory other than where the source
> is.  Maybe you don't do that and there are issues with running
> the testsuite in the source directory.

No way! Though I had been getting away with that for several years,
there has been enough traffic on this topic, on several lists,
indicating that it is not supported.

Thanks & Regards,
Erik