Import large size data into Navision

asembereng
Member Posts: 220
I have a data of 100,000 records to import but it fails without giving me any error message. Do you know the problem? And can i avoid this?
0
Comments
-
Did you use any error checking method to filter out bad data and SKIP them? You can use a temp table to store skipped values.
Or you can use a variable to count number of lines input and use COMMIT to save the records.
These are the methods I used when import huge amount of data.0 -
what are you error checking methods?0
-
If you are trying to use a dataport to import, you should know that when you run a dataport while it is in design mode, it will not actually import the data. So it could be that it works perfectly, it is not showing you an error message, but because it is not actually importing enything you *think* it fails. You need to save the object and run it in run mode, and test it that way.0
-
yes, DenSter is right, this is the most significant "error" of an user which use a dataport in design mode. Take a look also here. It's an other situation, but the same problem / solution
http://www.mibuso.com/forum/viewtopic.p ... t=dataport
regardsDo you make it right, it works too!0 -
I find dataports are always tricky for precicesly this reason. So to get around it I almost always read all the data into text variables instead of the actual fields in the table and write an error file. Then have 2 ways of running it - import all or show error.
1) If all values are read into text variable that are 1024 characters wide there is very little chance that an error will occur. If you use an array then you can easily pass the data around with one variable.
2) Build a codeunit to do all of the work of inserting customer, vendor, or whatever record you need to create. Then you can use theIF CODEUNIT.RUN
call to write the data - if it fails then you know the data couldn't be written. Note that this step should only be run in the "show error" mode
3) Write any records to an error file that failed the import process in step 2. This will allow only those records that were in error to be processed again. This follows the paradigm of writing the records that you can and saving the records you can't.
This will then allow a user to run the data port repeatedly until all of the records are imported and they can run it to show the error (e.g. posting group X does not exist).0 -
The Migration tool does this. The only reason we created an extra import option to our AddOn is because the tool import the field in order of field number.0
Categories
- All Categories
- 73 General
- 73 Announcements
- 66.6K Microsoft Dynamics NAV
- 18.7K NAV Three Tier
- 38.4K NAV/Navision Classic Client
- 3.6K Navision Attain
- 2.4K Navision Financials
- 116 Navision DOS
- 851 Navision e-Commerce
- 1K NAV Tips & Tricks
- 772 NAV Dutch speaking only
- 617 NAV Courses, Exams & Certification
- 2K Microsoft Dynamics-Other
- 1.5K Dynamics AX
- 320 Dynamics CRM
- 111 Dynamics GP
- 10 Dynamics SL
- 1.5K Other
- 990 SQL General
- 383 SQL Performance
- 34 SQL Tips & Tricks
- 35 Design Patterns (General & Best Practices)
- 1 Architectural Patterns
- 10 Design Patterns
- 5 Implementation Patterns
- 53 3rd Party Products, Services & Events
- 1.6K General
- 1.1K General Chat
- 1.6K Website
- 83 Testing
- 1.2K Download section
- 23 How Tos section
- 252 Feedback
- 12 NAV TechDays 2013 Sessions
- 13 NAV TechDays 2012 Sessions