FlowHeater Demo Video
 
FlowHeater - The Data Import / Export Specialist
 
Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1

TOPIC: Newbie Question - More advanced than me....?

Newbie Question - More advanced than me....? 2 months 3 weeks ago #3460

  • Keith Weatherhead
  • Keith Weatherhead's Avatar Topic Author
  • Offline
  • Posts: 16
I have a big CSV file (1.2MM lines, 385MB in size) containing 42 fields, lines can be in excess of 1,000 chars/line.
Of those 42 fields...

a. I have 4 date fields in... "yyyymmdd" format that I want to put in "mmddyyyy" format
b. I have 26 fields that may have a trailing negative field "123-" that I want to format as "-123

I presume that the Heaters can handle such transformations, am I correct? Which are the best
to use to make these transformations? I do not mind going from CSV to CSV if I need to, but the
ultimate solution is to get the O/P as a SQLite file if I can make a single transformation.

Any help or guidance would be most appreciated, the project was supposed to be done days ago
and life has simply got in the way as usual.

Please Log in or Create an account to join the conversation.

Newbie Question - More advanced than me....? 2 months 3 weeks ago #3461

Hi Keith,

For this you do not need any Function/Heater . You just have to use the “magic” automatically type transformation.

How to configure this:
Open the TextFile Apdater on the READ side and swich to the tab “Format”. Apply the format settings you expect on the READ side for data type Date and Number fields. After that you have to change for the certain fields the data type from default data type “STRING” to “DATE” or “NUMBER” (Decimal). Just switch to the tab “Fields / Data types” mark one field and select the desired type. This you have to do with all field you would like to transform.

Close this and open the TextFile Apdater or even the SQLite Adapter on the WRITE side. Switch to the “Format” tab and apply your desired format setting you wants to export to CSV or import into the SQLite database. On the WRITE you can use the default data type “STRING”, only in special case you have to change here some data types.

That’s all. Youl find a short example of this magic format transformation attached.









File Attachment:

File Name: type-trans...tion.zip
File Size:2 KB

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.

Please Log in or Create an account to join the conversation.

Best wishes
Robert Stark

Did this answer your question? We would be grateful if you provide a brief comment as feedback. It may also help others who may have encountered a similar problem.

Newbie Question - More advanced than me....? 2 months 3 weeks ago #3462

  • Keith Weatherhead
  • Keith Weatherhead's Avatar Topic Author
  • Offline
  • Posts: 16
WOW, Robert

Thank-you... within 30 minutes of configuring & doing some test runs, I was ready to rip the entire file (1.2 million lines) and 12 minutes later I had a patched file !!! Fantastic !!! FlowHeater just won a much higher position in my toolbox ! Thanx !! Keith

Please Log in or Create an account to join the conversation.

  • Page:
  • 1

other Languages

en
GB | US

de
DE | AT | CH

FlowHeater Home

de en

Imprint/Contact

Privacy Statement

Copyright © 2009-2018 by FlowHeater GmbH. All rights reserved.

Follow us on

twitter  facebook

YouTube

 de en