3600DateDate: 2018-06-13
Time: 13:00-15:00 CEST
...
The first version (1.0) of the Testbed will cover the following PEPPOL AS2 profile use cases:
- System under test (SP AP) is receiving
- Positive tests
- TB AP sends a valid document to service provider (SP) AP using a valid certificate (should pass) (of reasonable size)
- Document type ID/process ID/no SMP lookup (URL must be provided by test user in the Test Controller, forwarded to Backbone APs)
- Tast for the Testbed Controller: it must be possible to identify which Backbone AP sent out which file - correlate Backbone AP and sent out file;
- Verification; SP AP send file back to Testbed AP (see 2. a. i.)
- Handle different Content-Transfer-Encodings (binary, base64, 7bit etc.) - for the payload (AS2 specific)
- Support SHA-1 and SHA-256 as MIC algorithms (AS2 specific)
- Document type ID/process ID/no SMP lookup (URL must be provided by test user in the Test Controller, forwarded to Backbone APs)
- TB AP sends a valid large (50 MB+) document to SP AP (should pass)
- Verification; SP AP sends file back in 2.a.ii
- TB AP sends a valid document to service provider (SP) AP using a valid certificate (should pass) (of reasonable size)
- Negative tests
- TB AP sends an invalid document (valid SBDH without a payload) to SP AP (should fail with negative MDN)
- TB AP sends an invalid document (No SBDH, no payload at all) to SP AP (should fail with negative MDN)
- TB AP sends an invalid document (No SBDH, valid payload only) to SP AP (should fail with negative MDN)
- TB AP sends an invalid document (Invalid SBDH, XML syntax error) to SP AP (should fail with negative MDN)
- TB AP sends an invalid document (Invalid SBDH, missing mandatory field) to SP AP (should fail with negative MDN)
- TB AP sends an invalid document (SBDH endpoint ID differs from the Payload endpoint ID/or document type mismatch) to SP AP (out of scope for V1)
- TB AP sends a valid document to SP AP using an invalid certificate (expired PEPPOL AP certificate) (should fail)
- TB AP sends a valid document to SP AP using an invalid certificate (revoked PEPPOL AP certificate) (should fail) - may cause problems in practise; Error level warning only?
- TB AP sends a valid document to SP AP using an invalid certificate (with a non-PEPPOL certificate) (should fail)
- TB AP sends a valid document to SP AP using an invalid certificate (with a PEPPOL SMP certificate) (should fail)
- TB AP sends a valid document to SP AP using an old TLS version (e.g. TLS 1.1) (should be rejected by SSL handshake)
- Positive tests
- System under test is sending
- Positive tests
- SP AP sends a valid document to TB AP using a valid certificate
- Sending more than one different document type might be an issue for testing with real-life-test systems (out of scope for V1)
- Handle different Content-Transfer-Encodings (binary, base64, 7bit etc.) - for the MDN (AS2 specific)
- Verify if all the AS2 HTTP headers have correct values (according to the AS2 specs and the PEPPOL pro
- SP AP sends a valid large (50 MB+) document using a valid certificate
- Consider reasonable read timeout values
- SP AP sends a valid document to TB AP using a valid certificate
- Negative tests
- Meeting 2018-06-13 ended here. Discussion on how to verify the negative tests
- SP AP requested to send to TB AP that uses an expired certificate in SMP response (transaction should never be initiated)
- SP AP requested to send to TB AP that uses a revoked certificate in SMP response (transaction should never be initiated)SP AP is sending a document type that is not supported by the TB AP (e.g. OrderResponse) (should fail with negative MDN) (for a later version of the Testbed)
- Verification: verify that the negative MDN was received
- Out of scope version 1: list of negative self-tests, that cannot be verified by the Testbed
- Meeting 2018-06-13 ended here. Discussion on how to verify the negative tests
- Positive tests
The first version (1.0) of the Testbed will also cover the following use cases (utilising an AS4 implementation):
...
- Onboarding test (in TEST environment using SMK)
- Compliance test (in PRODUCTION environment using SML)
- Compliance monitoring (automated monitoring of deployed APs and SMPs)
- BIS document validation (automated Schematron validation of BIS profiles – Self test)
Requirements for the Testbed software
Attachments
Attachments |
---|