FlowHeater Demo Video
 
FlowHeater - The Data Import / Export Specialist
 
Welcome, Guest
Username: Password: Remember me
See also the existing examples of using the TextFile Adapter , which may answer your question: text file codepage converting 1 / 2 , processing of CSV header and footer rows , Import/Export vCard (line based) text files
  • Page:
  • 1

TOPIC: Ignore duplicate line(s) of data

Ignore duplicate line(s) of data 7 months 1 week ago #3492

One of our customer’s system is mysteriously duplicating lines in some orders.  Their IT department is trying to find solution. But, until they do they’ve reached out to me and ask that we ignore duplicates in the order file.  I’m trying to create a .NET to identify the duplicates and change the item to ‘xxxx’ so I can filter it on the other side.  But, I’m not having any success.  Ignoring it in the .NET script would be even better.  In the attached file there are three orders with two lines each.  I want to ignore the second line for order B456.
As always, thanks for the help.
Attachments:

Please Log in or Create an account to join the conversation.

Ignore duplicate line(s) of data 7 months 1 week ago #3493

Well...I never thought of using GroupBy.  I use it all the time to combine duplicates and sum the quantities.
I guess I was over thinking it.  Thanks, I got it.

Please Log in or Create an account to join the conversation.

Ignore duplicate line(s) of data 7 months 1 week ago #3494

Just for your information. A better way to filter duplicate lines/contentis to use the Filter Heater with the enabled option “Filter duplicates out”, like the screenshot below.

Note: To use the GroupBy Heater for filtering duplicate line just working when the input stream is sorted based on the grouped field!
 

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.
Attachments:

Please Log in or Create an account to join the conversation.

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.

Ignore duplicate line(s) of data 7 months 1 week ago #3495

Thanks Robert,

That is a better option and clears up the line count issue I was having with the GroupBy.

JD

Please Log in or Create an account to join the conversation.

  • Page:
  • 1

other Languages

de

FlowHeater Home

de en

Imprint/Contact

Privacy Statement

Copyright © 2009-2019 by FlowHeater GmbH.
All rights reserved.

Follow us on

twitter  facebook

YouTube

 de en