Dataport limitation

jimmyf
jimmyf Member Posts: 104
I have a csv file that I need to import into a custom table. The table has around 20 fields and the csv file has over 250,000 records.
Are there any issues I should consider before importing a file of this size?

Comments

  • Karenh
    Karenh Member Posts: 209
    You may want to commit every 100 records or so. Then the cache is not filled, and if there is an error partway through, you still have the records imported before you got to the error.
  • Alex_Chow
    Alex_Chow Member Posts: 5,063
    If you're using the C/SIDE database, you may also want to consider expanding the database first.
  • kine
    kine Member Posts: 12,562
    And do not forget to remove or replace all " (double quotes) in the exported text before saving it into CSV if possible. NAV parser have problems with double quotes inside strings...
    Kamil Sacek
    MVP - Dynamics NAV
    My BLOG
    NAVERTICA a.s.
  • David_Singleton
    David_Singleton Member Posts: 5,479
    jimmyf wrote:
    I have a csv file that I need to import into a custom table. The table has around 20 fields and the csv file has over 250,000 records.
    Are there any issues I should consider before importing a file of this size?

    Convert it to an XML file and use an xmlport to import. Dataports are horrible for stuff like this. One question are you importing this to a customer table or a standard one in NAV?
    David Singleton
  • Asallai
    Asallai Member Posts: 142
    jimmyf wrote:
    I have a csv file that I need to import into a custom table. The table has around 20 fields and the csv file has over 250,000 records.
    Are there any issues I should consider before importing a file of this size?

    Hi,

    I did the same, but if you have csv and use NAV4 or NAV5 you can use the Administrating tool, Excel import (it is standard function) for this importing process. In NAV5 you can use XML import too.
  • David_Singleton
    David_Singleton Member Posts: 5,479
    jimmyf wrote:
    I have a csv file that I need to import into a custom table.

    One question are you importing this to a customer table or a standard one in NAV?

    #-o Sorry I should have read closer.
    David Singleton