Log In
Home
02/02/2016
Offline
Hi,
We found there are test scripts for the OPC UA HDA under C:\Program Files (x86)\OPC Foundation\UA 1.02\Compliance Test Tool\ServerProjects\CTT_Server_HDA\maintree\History, so we manually update the uaprofiles.xml file to run them in the CTT tool.
After running them with our server application who enables HDA and is added the nodes in addressspace to support the HDA test scripts, we saw many errors as the test result. By taking a close look at the test script, we found some test cases are not aligned with the OPC UA specification part 11. Take the returnbounds as an example:
In Historical Access Read Raw test 007.js
// TEST 2: repeat test #1 (// TEST 1: start=good; end=valid but no data; expects start-time) but while requesting bounds; expect timestamp1 (start-bound)
It expects only one data (start-bound) returned, but with the table 1 in Part 11, chapter 4.4, it should return 2 data (start-bound and end-bound).
I understand these test scripts are not with release quality yet and it is reasonable that there are bugs. What worries us is that some of the comments (which describes the test purpose) are not aligned with our understanding of the Specification. We did some "fix" of the ctt test script with the understanding of the UA specification part 11 (especially example in table 1 of returnbounds) . We'd like to ask your help to review these changes if it makes sense. And we are willing to help improve the ctt test script for HDA later on.
Please let us know if there is already a better version of these tests, and where we can post the changes we did so that you can help review them.
Thanks,
-Daniel
Hello Daniel,
I wouldn't use any script in the CTT that is not listed in the tool. They're not supposed to be there.
For UA HA, we actually have another version of CTT that was made for testing UA HA here: https://opcfoundation.org/deve.....ool-uactt/
Now, these scripts have not been completely verified simply for a lack of access to reference implementations to test against. We definitely need your help to validate them. We've been waiting for help.
All of the test-scripts were developed "blind" in that we didn't have any HA servers to work with. Instead, we used Part 13 and the annex that contains the sample datasets, queries, and results; and we built a suite of unit-tests that match them. You'll find the unit tests in the script library under "__regressionTesting/_HA.js". There's a couple of other scripts too which you can look at.
Email me directly at compliance@opcfoundation.org and we can work on this.
02/02/2016
Offline
Hey Nathan,
Thanks for the fast response. We did use the CTT tool in the link of https://opcfoundation.org/deve.....ool-uactt/ with the latest version (1.02.336.273) We didn't find any HA test scripts in the standard uaprofiles for this tool. Please guide us to it if possible.
We are happy to help testing the HA scripts with our server application. I will email you with the screenshots how we use the CTT tool now. Thanks for the help,
-Daniel
02/02/2016
Offline
Nathan Pocock said
Hello Daniel,I wouldn't use any script in the CTT that is not listed in the tool. They're not supposed to be there.
For UA HA, we actually have another version of CTT that was made for testing UA HA here: https://opcfoundation.org/deve.....ool-uactt/
Now, these scripts have not been completely verified simply for a lack of access to reference implementations to test against. We definitely need your help to validate them. We've been waiting for help.
All of the test-scripts were developed "blind" in that we didn't have any HA servers to work with. Instead, we used Part 13 and the annex that contains the sample datasets, queries, and results; and we built a suite of unit-tests that match them. You'll find the unit tests in the script library under "__regressionTesting/_HA.js". There's a couple of other scripts too which you can look at.
Email me directly at compliance@opcfoundation.org and we can work on this.
Hello Nathan,
I found that "__regressionTesting/_HA.js" under the library tab is more focus on the aggregates of the historian data (Part 13), while the scripts under history folder in the conformance units focus on the server history services (Part 11). Since our server application hasn't support aggregates now, we think those scripts in conformance units are more useful to test our server app.
Let me just send you an email lists with our modification of these test scripts, and please help review it and let us know if these changes conform to the specification part 11.
Appreciate your time on this,
-Daniel
1 Guest(s)
Usage Policy