Skip duplicate message in a file

I've got a new project to strip out duplicate HL7 messages within a file.



I need to loop through a file and skip a message that is in the file more than once. Once I have the duplicate message I want to write that off to a new file which will contain only unique messages.



What do you recommend is the best way to do that...in MIRTH?

Skip duplicate message in a file