Options

Perofrmance while importing large Files (~80 MByte)

QuongElvisQuongElvis Member Posts: 22
HI.

i have written Code to import a large File, size ~80MByte into different tables. The Code works well and fast with Files up to ~ 20Mbytes. With larger Files the Import is running fast at the beginning, but after importing ~20 MBytes the import gets more and more slow. :oops:
I have tried several things to speed up, tried to commit for each 1000 records, close, clear and reopen the file after 1000 records, nothing helped increasing import-speed.

Does anyone have any Idea for that?

Carsten

Comments

  • Options
    Luc_VanDyckLuc_VanDyck Member, Moderator, Administrator Posts: 3,633
    You can divide your file into 4 parts of 20 MB, and import those 4 files.
    No support using PM or e-mail - Please use this forum. BC TechDays 2024: 13 & 14 June 2024, Antwerp (Belgium)
  • Options
    bostjanlbostjanl Member Posts: 107
    You can divide your file into 4 parts of 20 MB, and import those 4 files.

    Or use COMMIT on every 1000 (100,10000,..) records.


    BostjanL
  • Options
    KowaKowa Member Posts: 918
    Hi Carsten,

    maybe drive C: is almost full. There is always a temp file in the temp path which is created during imports and is then deleted afterwards.

    Kowa
    Kai Kowalewski
Sign In or Register to comment.