Test Manager and continuous integration

[Helene]

We are looking for tools to create unittests for pl/SQL code, and have been trying to set up some tests using Test Manager in pl/SQL Developer. What I need to make this work, is a way to be able to run a complete set of test sets automatically on an unattended build server, and report the results.

Is this possible? If not, do you have any plans for this?

Is the file format for the ts and tst files something you might change in the future, or can we rely on this to be permanent in case we should try to make a utility of our own for this purpose?

With regards,
Helene

 

[Marco Kalter]

This is currently not possible. It should be doable though, and I have added this to the list of enhancement requests.

 

[Helene]

Could you give any hint on a timeframe for this? This is a very crucial requirement, and if it is not available within a reasonable time we will have to look for other alternatives.

With regards, Helene

 

[Marco Kalter]

I think we can add this for version 8.0, which will be available in the first quarter of next year.

 

[Steve Pence]

Hi,
We have an identical requirement. Hopefully more customers expressing interest creates more motivation for you to include this feature in your next release. We have been considering paying significant money for the testing tool offered by your competitor. (I'm sure you know who.) But we would much rather stay with you!
Steve

 

[ScottMattes]

i'd hate to say it, but i tried out the Quest tool before Steven sold it to them and I don't think that All Around could possibly get the same coverage be version 8.0 (they are good, but Steven's tool is way good).

I may be wrong, void where prohibited by law. Tax, title and tags are extra.

 

[Steve Pence]

I just checked the New Features list on the v8 alpha page. I didn't see anything about this ability "to run a complete set of test sets automatically on an unattended build server, and report the results."

Did this make the cut? This feature really is huge for us. The Quest tool may be good, but it is overkill. All we need is the ability to run a set of tests.

Steve

 

[Marco Kalter]

This is still on the to-do list, and may make indeed it into the 8.0.0 release.

 

[Steve Pence]

Thanks, Marco. I still have hope.

Steve

 

[Bernhard S]

Hello, I would very much appreciate that feature too.

 

[Chris-R-O]

More feature requests for test manager that I would find useful - not sure if this is the best place to add this request -

Can a test manager script have a description field?

Can we provide connection details (like a project file) for the test manager to use to run the tests (we use multiple schemas and its not obvious which schema each set of scripts have to be run as) - might be good for unattended running?

Could we have a way to run multiple test manager scripts - maybe a list on the command line? Or could a test manager script run other test manager scripts?

Hopefully these are features that are not too different from other features in PLSD.

Thanks,
Chris

 

[Marco Kalter]

Can a test manager script have a description field?

I have added this to the list of enhancement requests.

Can we provide connection details (like a project file) for the test manager to use to run the tests (we use multiple schemas and its not obvious which schema each set of scripts have to be run as) - might be good for unattended running?

In version 8.0 you can run a test set from the command window. The command file can make a connection, or you can supply a userid= parameter on the PL/SQL Developer command-line.

Could we have a way to run multiple test manager scripts - maybe a list on the command line?

This is possible in version 8.0 from the command window.

 

[Helene]

Running test manager scripts using the command window is not a satisfactory solution for unattended testruns on a build server, since it opens a pl/Sql developer instance. We made our own utility for running tests, and have built an extensive test library using test manager.

A separate testGui with the ability to enable or disable tests or entire test sets, like most xUnit frameworks supply would also be a very nice and most welcome addition. This should also allow for standalone, noGui running on a build server.

Our testsets are often built using a single (or just a few) tst-file, which is repeated in many cases in the test set, with different input and different required output. This practice allows for easy creation of a number of variations of required input and expected output, with a minimum of coding (and test code maintenance).

In order to quickly create new test cases we would very much like the ability to MARK a test case, and COPY it into a new test case. I actually often resort to copy /paste in the test set-file using Notepad, due to the lack of a copy function in Test Manager.

We also have a convention that the variables for required input should start with "IN_" and those for required output start with "OUT_". It would be helpful if input value or output value could be set automatically when including the test into a test set.

with regards
Helene

 

[Helene]

Oh - and one more request: please add a yes/no dialog, when the delete button is used. More than once I have accidently deleted a test case, when I wanted to push the insert button - they are quite close.

On the other hand, I never use the "create new test window" when I use the new button, and I always get the variables from the test file when I include a new file. So there are some dialogs I would like to skip

 

[mike]

Hi Helene,

You wrote:
"In order to quickly create new test cases we would very much like the ability to MARK a test case, and COPY it into a new test case. I actually often resort to copy /paste in the test set-file using Notepad, due to the lack of a copy function in Test Manager."

In the upper right corner of the test manager, there is a "new" icon. If you press CTL when you click it, it will copy the test that is highlighted. I do that all the time and then make minor changes to the test cases. The only bother is it shows, "New New New New New test" if I copy "test" 5 times.

 

[Helene]

Thanks a lot Mike, this information was very helpful indeed :-D

Marco, maybe you could include information about this copy functionality in the button hint?

I would also like to know your view on my other request:
"A separate testGui with the ability to enable or disable tests or entire test sets, like most xUnit frameworks supply would also be a very nice and most welcome addition. This should also allow for standalone, noGui running on a build server."

Is this something you will consider building? Or will we eventually need to build this ourselves?