Sending two files with duplicate records at the same time

Hi Experts,

I want to joined two data files together, but they have different data fields, the same records such as employee Lucy Smith (ID: 123) as below appear in both files and the duplicates have to be removed. I am wondering how is it possible to be done in SAP PI, using ccBPM?

Below is the sample data:

1. Data in file 1, the first data field is Employee ID:

    234, Debbie, White

    123, Lucy, Smith

    225, Mark, Jones

2. Data in file 2, the first data field is Employee ID:

    567, Lisa, Brown, Research and Development, Contractor

    896, Kevin, Davis, Sales, Regular Employee

    123, Lucy, Smith, Human Resources, Regular Employee

The expected output data file should look like:

    234, Debbie, White, ,

    123, Lucy, Smith, Human Resources, Regular Employee

    225, Mark, Jones, ,

    567, Lisa, Brown, Research and Development, Contractor

    896, Kevin, Davis, Sales, Regular Employee

Thanks in advance!

Blue