february 9th 2005ihe-eu conference workshop connectathon organization eric poiseau version 1.0...

February 9th 2005 IHE-EU Conference Workshop

Connectathon OrganizationConnectathon OrganizationEric PoiseauEric Poiseau

Version 1.Version 1.00

(Integrating the Healthcare Enterprise)(Integrating the Healthcare Enterprise)

IHE IHE in Europein Europe


Who are you ?Who are you ?

77 companies77 companies120 systems120 systems4 domains (RAD, IT-I, CARD, LAB)4 domains (RAD, IT-I, CARD, LAB)RAD : 90 systemsRAD : 90 systems IT-I: 78 systems (XDS 22)IT-I: 78 systems (XDS 22)CARD : 28 systemsCARD : 28 systemsLAB: 21 systemsLAB: 21 systems


ProgressionProgression

0

20

40

60

80

100

120

2002 2003 2004 2005

Companies

Systems

+ 50 %


We need to get preparedWe need to get prepared

Pre-connectathon periodPre-connectathon period– 10 weeks10 weeks

ConnectathonConnectathon– 5 days (9 am to 6 pm)… but in the fact only 5 days (9 am to 6 pm)… but in the fact only

4 days for testing4 days for testingNeed for optimization Need for optimization

– A lot to do before A lot to do before – To perform more testing during CATTo perform more testing during CAT


A few numbers…A few numbers… 10 weeks gives 400 hours of work10 weeks gives 400 hours of work ~ 2700 logs are required~ 2700 logs are required

– 5 min per log file makes 225 hours5 min per log file makes 225 hours ~ 120 systems~ 120 systems

– 1 hour on phone/email makes 120 hours1 hour on phone/email makes 120 hours

That gives me 155 hours for the rest…That gives me 155 hours for the rest…– Lab tools, connectathon preparation, webtool Lab tools, connectathon preparation, webtool

maintenance, test data,….maintenance, test data,….

No time for Baby sitting


Pre-ConnectathonPre-Connectathon Check your registrationCheck your registration

– I do not want you to tell me during the connectathon : « I I do not want you to tell me during the connectathon : « I have forgotten to sign up for PIR, I though…. »have forgotten to sign up for PIR, I though…. »

Configuration information gathering (Configuration information gathering (you to meyou to me))– Dicom Conformance Statements Dicom Conformance Statements – Port numbers, URI, AE Titles….Port numbers, URI, AE Titles….

Configuration of your system (Configuration of your system (me to youme to you))– Before Monday morning….so before shippingBefore Monday morning….so before shipping– You need to configure your system You need to configure your system

With your peer information With your peer information With the connectathon network informationWith the connectathon network information With the testing datasetWith the testing dataset

Mesa Test Mesa Test Object Rendering Tests Object Rendering Tests New


Registration CheckingRegistration CheckingCombined actors/profileCombined actors/profile

– PPSM for OF and IM/IAPPSM for OF and IM/IA– PIR requires SWFPIR requires SWF– SWF and ARISWF and ARI– ……

Supportive or Thorough ?Supportive or Thorough ?– We do not know yet how supportive will be We do not know yet how supportive will be

reported in result matrix and if it willreported in result matrix and if it will

New


Supportive versus ThoroughSupportive versus Thorough ThoroughThorough

– This is what we have done so farThis is what we have done so far SupportiveSupportive

– You’re confident about this Actor/IP but you want You’re confident about this Actor/IP but you want to bring it at the connectathonto bring it at the connectathon

– You have already tested it at a previous CATYou have already tested it at a previous CAT– Need to provide URL to IS (published)Need to provide URL to IS (published)

Result matrix will show thorough resultsResult matrix will show thorough results

New

System Configuration / InformationSystem Configuration / Information


System InformationSystem Information

Dicom Conformance StatementDicom Conformance Statement– Upload Upload formform

Practical InformationPractical Information– Power informationPower information– Number of chairsNumber of chairs– StorageStorage– Special requirements -> contact meSpecial requirements -> contact me

Please provide this information before Please provide this information before March 1stMarch 1st

New


Configuration InformationConfiguration Information Have your configuration ready and confirmed before Have your configuration ready and confirmed before

the deadline (April 15th)the deadline (April 15th)– I have assigned some default valuesI have assigned some default values– If you change it… your peer will have to change it also….If you change it… your peer will have to change it also….

How important is it ? How important is it ? – Most of the time spend in doing a connectathon test is spend Most of the time spend in doing a connectathon test is spend

checking/changing the configuration parameters.checking/changing the configuration parameters.– More systems more choices of peers…. Try not to be the More systems more choices of peers…. Try not to be the

bad guy.bad guy. Q : How to provide my configuration information ?Q : How to provide my configuration information ?

– AnswerAnswer Q : How to find my peer configurations parameters ?Q : How to find my peer configurations parameters ?

– AnswerAnswer


Configuration InformationConfiguration Information If you feel that there are missing parameters, If you feel that there are missing parameters,

– this is highly probable. Let me know ASAPthis is highly probable. Let me know ASAP

No confirmation will be understood as a No confirmation will be understood as a confirmation!confirmation!– This means that your peers will configure their This means that your peers will configure their

systems with information that may be erroneous ! systems with information that may be erroneous !

Configure your systems before arriving to the Configure your systems before arriving to the connectathonconnectathon

Mesa TestingMesa Testing

General InformationGeneral Information


Why Do We Have Test Tools ?Why Do We Have Test Tools ?

1.1. Reduce the number of systems to 80 Reduce the number of systems to 80 because the room we have reserved because the room we have reserved for the connectathon is too small !for the connectathon is too small !

2.2. The project manager is evil and he The project manager is evil and he likes to make you suffer with buggy likes to make you suffer with buggy mesa tools !mesa tools !

3.3. Prepare your systems for the Prepare your systems for the connectathon !connectathon !


Why Do We Have Test Tools ?Why Do We Have Test Tools ?

Test tools prepare you for the Test tools prepare you for the connectathonconnectathon– Provides a minimum set of test to prepare Provides a minimum set of test to prepare

your systemsyour systemsTools are a benefit of participationTools are a benefit of participation

– As a participant you get them before the As a participant you get them before the public releasepublic release

Tools are released to the public later onTools are released to the public later on


How Do Tests Help You ?How Do Tests Help You ? Tests encourage you and your peers to read Tests encourage you and your peers to read

details of the Technical Frameworkdetails of the Technical Framework– You may find you do not agree with our You may find you do not agree with our

interpretation of the TFinterpretation of the TF– You may not agree with the TFYou may not agree with the TF

If you and your peers complete the tests, we If you and your peers complete the tests, we can avoid a lot of wasted time at the can avoid a lot of wasted time at the Connectathon Connectathon

Thus we can prepare more complex Thus we can prepare more complex demonstrations and do more complex demonstrations and do more complex connectathon testsconnectathon tests


Test CoverageTest Coverage

Test software do NOT cover all aspects Test software do NOT cover all aspects of the Technical Framework of the Technical Framework

Test software do NOT guarantee Test software do NOT guarantee compliance with DICOM or HL7.compliance with DICOM or HL7.

All what it does, is provide a reasonable All what it does, is provide a reasonable preparation for the Connectathon.preparation for the Connectathon.


Test Cases versus DemonstrationTest Cases versus Demonstration

MESA tests cover more transactions than MESA tests cover more transactions than will be demonstratedwill be demonstrated

Participants are required to complete all test Participants are required to complete all test cases, even if they do not lead directly to cases, even if they do not lead directly to demonstrationdemonstration

Thus : Your system may perform one Thus : Your system may perform one transaction at transaction at a a demonstration but perform demonstration but perform several transactions with the MESA tests several transactions with the MESA tests (and the Connectathon)(and the Connectathon)

Mesa TestingMesa Testing

How toHow to


Rad – Card – IT-I (except XDS)Rad – Card – IT-I (except XDS)


MESA ToolsMESA ToolsSimulate your peersSimulate your peers

Order

Filler

MESA

ADT, OP, IM/IA

TCP/IP

Network

System being testedWin32 / Linux / Solaris

MESA OS is independant of system under test OSMESA OS is independant of system under test OSChoosing NTChoosing NT, , Linux Linux or Solaris or Solaris is a question of tasteis a question of taste

Mesa SimulatorWin32 / Linux / Solaris


Hardware/network requirement Hardware/network requirement for testingfor testing

One computer system can :One computer system can :– Support all of the MESA actors Support all of the MESA actors – Can serve as the driver for any system under test. Can serve as the driver for any system under test.

Only one computer required to test an IHE actor. Only one computer required to test an IHE actor. It is impossible to test multiple systems It is impossible to test multiple systems

simultaneously simultaneously – (sockets are not multithreaded). (sockets are not multithreaded).

You need to test separate systems serially with You need to test separate systems serially with little or no reconfiguration.little or no reconfiguration.


Mesa test how toMesa test how toWhere do I get the tools from ?Where do I get the tools from ?

– http://ihe.univ-rennes1.fr/testinghttp://ihe.univ-rennes1.fr/testing– If you’re logged in you’ll get the last releaseIf you’re logged in you’ll get the last release– If not you’ll get the public releaseIf not you’ll get the public release

Who writes the tools ?Who writes the tools ?– MIR, Offis, NIST, IDMMIR, Offis, NIST, IDM

What if I find a bug in a tool ?What if I find a bug in a tool ?– MIR, Offis : MIR, Offis : http://http://rome.wustl.edu/bugzillarome.wustl.edu/bugzilla– NIST, IDM : contact me !NIST, IDM : contact me !


InstallationInstallation

Make sure you follow the installation Make sure you follow the installation instructions provided by Steven Mooreinstructions provided by Steven Moore

Do not try to install from the sourcesDo not try to install from the sources– Sources are provided for informationSources are provided for information


Most common errors encounteredMost common errors encounteredEnvironment variables not setEnvironment variables not setMesa_storage files not installedMesa_storage files not installedWrong version of Win32 PerlWrong version of Win32 PerlSQL server is not installedSQL server is not installedDatabase tables are not installedDatabase tables are not installed

But also possible errors in the tools !But also possible errors in the tools !


Recommendations for MESA Recommendations for MESA SoftwareSoftware

We recommend that you install and test We recommend that you install and test the software as soon as possiblethe software as soon as possible

The authors try to make the installation The authors try to make the installation process simple, but there will be some process simple, but there will be some difficultiesdifficulties

It is better to go through a round of It is better to go through a round of installation now rather than waiting until installation now rather than waiting until the “final/next” release is available; the “final/next” release is available;


MESA Test InteractionsMESA Test InteractionsMost MESA tests are independent of Most MESA tests are independent of

other tests. You can run them in any other tests. You can run them in any order.order.

Most tests overwrite common data Most tests overwrite common data areas. They do not overwrite the output areas. They do not overwrite the output of the evaluation scripts.of the evaluation scripts.

This implies you should run a test and This implies you should run a test and perform the evaluation before starting perform the evaluation before starting another test.another test.


MESA Test OverviewMESA Test Overview Each actor/integration profile has several tests, Each actor/integration profile has several tests,

each test is assigned a number (101, 102, …)each test is assigned a number (101, 102, …) 100 series tests are for the Scheduled 100 series tests are for the Scheduled

Workflow / Patient Information ReconciliationWorkflow / Patient Information Reconciliation Other series of tests are for different features Other series of tests are for different features

of the Technical Framework (for actors or of the Technical Framework (for actors or classes of actors)classes of actors)

How to know what test your systems have to How to know what test your systems have to pass ? pass ? – Check the web tool on your system pageCheck the web tool on your system page


General Test InstructionsGeneral Test Instructions Start MESA servers on test machineStart MESA servers on test machine Run an interactive perl script that leads you Run an interactive perl script that leads you

through the test scenariothrough the test scenario Run a second perl script that evaluates your Run a second perl script that evaluates your

messagesmessages Check the logs for errors and try to Check the logs for errors and try to

understand the problemsunderstand the problems Send output of evaluation script to Project Send output of evaluation script to Project

ManagerManager Please comment your logs if this is neededPlease comment your logs if this is needed


Test logs returnTest logs return (2) (2)Do not send logs if you know that they Do not send logs if you know that they

will be rejected. will be rejected. – Check Bugzilla pages for informationCheck Bugzilla pages for information– Ask for some helpAsk for some help

When “error” please explain the errorsWhen “error” please explain the errorsUpload form for log returnUpload form for log return

– Please mention if you are resubmitting Please mention if you are resubmitting “old” logs“old” logs

New


XDSXDS


NIST ToolkitNIST Toolkit Remote Registry and Repository hosted by Remote Registry and Repository hosted by

NISTNIST Sources can submit documents to the NIST Sources can submit documents to the NIST

serverserver Consumer can query and retrieve documents Consumer can query and retrieve documents

from the NIST serverfrom the NIST server Java tool to submit and query a registryJava tool to submit and query a registry Log browser for PM to check/help testersLog browser for PM to check/help testers

New


Laboratory ToolsLaboratory Tools

Not script for the momentNot script for the momentMessage validation softwareMessage validation software

– http://ihe.univ-rennes1.fr/HL7http://ihe.univ-rennes1.fr/HL7

New


Connectathon LogisticsConnectathon Logistics


Connectathon CodesConnectathon Codes Tables and codes used for the connectathon will be Tables and codes used for the connectathon will be

provided :provided :– HL7 user tables HL7 user tables – MD’s MD’s – Beds, Facilities, Assigning authoritiesBeds, Facilities, Assigning authorities– Procedures codes (lab, radio, and cardio)Procedures codes (lab, radio, and cardio)– XDS Affinity domain informationXDS Affinity domain information

OIDsOIDs– Set of patients ID and identities for non ADT clientsSet of patients ID and identities for non ADT clients

If you think there are some missing tables and/or If you think there are some missing tables and/or information, please let me knowinformation, please let me know


ADTADT

Each ADT actor will be assigned a Each ADT actor will be assigned a range of pid to avoid confusion.range of pid to avoid confusion.– Patient Identifiers are 6 digit identifiers that Patient Identifiers are 6 digit identifiers that

begin with a two-digit code that identifies begin with a two-digit code that identifies the system producing the ID. the system producing the ID.

– Thus, if your prefix is 10, your Patient Thus, if your prefix is 10, your Patient Identifiers will be in the range of 100000 to Identifiers will be in the range of 100000 to 109999.109999.


Digital CertificatesDigital Certificates I’ll provide you with private key and certificateI’ll provide you with private key and certificate One certificate assigned for each secure One certificate assigned for each secure

systemsystem Certificates to be used only for connectathon Certificates to be used only for connectathon

and demonstrationsand demonstrations Certificates are not meant to be used in a Certificates are not meant to be used in a

production environmentproduction environment We provide no guidance on how to manage We provide no guidance on how to manage

those in a clinical environmentthose in a clinical environment


Webtool for test managementWebtool for test management

Provides list of possible peersProvides list of possible peersProvides chat/log Provides chat/log Provides verification loggingProvides verification loggingProvides information about « persistent Provides information about « persistent

objects » objects » New


Network InformationNetwork Information We will provideWe will provide

– IP Addresses and Host file IP Addresses and Host file – Local DNS (preferred to host file)Local DNS (preferred to host file)– NetmaskNetmask– GatewaysGateways– Time ServerTime Server– Kerberized ServerKerberized Server– Mail Server Mail Server – LDAPLDAP– XDS Repository and RegistryXDS Repository and Registry

New

New

New


Network InformationNetwork Information Intranet will be at least 100 Mb/sIntranet will be at least 100 Mb/s Internet will be at least 10 Mb/sInternet will be at least 10 Mb/s

– Internet is used for convenience for email Internet is used for convenience for email and communication of files with home and communication of files with home based team.based team.

– Internet access is not guaranteed Internet access is not guaranteed You will get on drop per systemYou will get on drop per system

– It is your responsibility to bring a hub It is your responsibility to bring a hub


Power SupplyPower Supply

240 Volts240 VoltsA power strips with 3-5 slots per tableA power strips with 3-5 slots per tableUK plugs do not fit to NL outlet !! UK plugs do not fit to NL outlet !!

– Are we not talking about interoperability !Are we not talking about interoperability !

If you need more than 240 V, please let If you need more than 240 V, please let me know ASAP !me know ASAP !


Tables and chairsTables and chairs

120 tables 120 tables – One per systemOne per system– Please use the table that will be assigned Please use the table that will be assigned

to your systemto your system– If your company brings 2 systems, they If your company brings 2 systems, they

might not be close to each other !!! might not be close to each other !!!


Connectathon TestConnectathon Test


Preliminary Connectathon Preliminary Connectathon ScheduleSchedule

Monday :Monday :– am : installation of your systems am : installation of your systems

Systems deliverySystems delivery Check network access, correctness of configurationCheck network access, correctness of configuration

– pm : start of testing (p2p)pm : start of testing (p2p)

…….. Wednesday : Wednesday :

– start of scenario testingstart of scenario testing Friday : Friday :

– am : very last testsam : very last tests– pm : packingpm : packing

Package pick-upPackage pick-up


Peer To Peer Tests (P2P)Peer To Peer Tests (P2P)

You have to test with some peersYou have to test with some peersYou need to get at least 3 instances of a You need to get at least 3 instances of a

test verified per testtest verified per testPeer are prioritizedPeer are prioritized

You can do more testing.You can do more testing.


Peer To Peer Tests (P2P)Peer To Peer Tests (P2P)

Enhancement :Enhancement :– Use of a chat room for peers to Use of a chat room for peers to

communicate and keep track of the communicate and keep track of the transactions.transactions.

– Use of log storage mechanism : (cut and Use of log storage mechanism : (cut and paste the logs in text file)paste the logs in text file)

Other suggestions/ideasOther suggestions/ideas

New


Scénarii TestsScénarii Tests

Compared to last yearCompared to last year– Increased complexityIncreased complexity

Could combine RSWF, LSWF, PIX, RID, EUA, Could combine RSWF, LSWF, PIX, RID, EUA, XDS…XDS…

– Increased number of peersIncreased number of peersWill have a schedule, so will need you Will have a schedule, so will need you

to be ready at the time of the test.to be ready at the time of the test.Will have a list of difficulties to check.Will have a list of difficulties to check.


HintsHints

Switching peer should be an easy and Switching peer should be an easy and rapid task.rapid task.– Try to avoid need of rebootingTry to avoid need of rebooting– Try to avoid typing the peer configuration Try to avoid typing the peer configuration

each time you need to switch.each time you need to switch.Have the procedure codes entered in Have the procedure codes entered in

your systems. your systems.


How can I failHow can I fail

I have not a single test verified by I have not a single test verified by Wednesday evening !!! Wednesday evening !!!

I am spying my colleagues !!!I am spying my colleagues !!! I am not fair to the PM !!!I am not fair to the PM !!!


Special CasesSpecial Cases You all are in a special case !!!!You all are in a special case !!!! I have finished all my testing on Monday, I have finished all my testing on Monday,

shall I leave ????shall I leave ????– Print Server case Print Server case

I have 5 zillion tests to perform during the I have 5 zillion tests to perform during the week, …can we stay for another 2 weeks…week, …can we stay for another 2 weeks…– Register more systemsRegister more systems– Register fewer profiles/actorsRegister fewer profiles/actors


ResultsResults

Concerns only positive resultsConcerns only positive resultsTest failure are “forgotten”Test failure are “forgotten”Matrix published in the following weeksMatrix published in the following weeks

Diverse IssuesDiverse Issues


CommunicationCommunication

Me to youMe to you– Email (mailing list)Email (mailing list)– News on IHE-Europe Web (RSS)News on IHE-Europe Web (RSS)– PhonePhone

You to Me :You to Me :– Email +++Email +++– Phone ---Phone ---


CommunicationCommunication Protocol (are we not dealing with interoperability):Protocol (are we not dealing with interoperability):

– CompanyCompany– SystemSystem– Operating systemOperating system– Actor testedActor tested– Tool Version…Tool Version…

Any information about your context will help me Any information about your context will help me – Remember that you have an open credit of ½ hour per Remember that you have an open credit of ½ hour per

systems… do not waste it !!!!systems… do not waste it !!!!


ShippingShippingShipping informationShipping information

– We will let you know in time.We will let you know in time.StorageStorage

– We will have a space for storageWe will have a space for storage– If possible, for small boxes store in your If possible, for small boxes store in your

roomroomSecurity during the nightsSecurity during the nights

– Security from the hotelSecurity from the hotel


CConnectathononnectathon Check List Check List Swimming Suit and squash equipmentSwimming Suit and squash equipment Bowling bowl Bowling bowl Technical FrameworkTechnical Framework Your system fully configured Your system fully configured

– NetworkNetwork– Codes, procedures, tables….Codes, procedures, tables….

Laptop to run the webtoolLaptop to run the webtool– Could be also used to sniff messages or service you systemCould be also used to sniff messages or service you system

Power strip + power cord extensionPower strip + power cord extension Hub (preferred to switch)Hub (preferred to switch) Calibration material for CPI profile actorsCalibration material for CPI profile actors

– Print Server and print composerPrint Server and print composer


Thank youThank you

february 9th 2005ihe-eu conference workshop connectathon organization eric poiseau version 1.0...

Documents