NAV and SQL handling batch data
Taiki_Yoshida
Member Posts: 3
Hello all,
This is my first post on Mibuso, so let me know if I'm posting incorrectly... (fingers crossed...)
I have had complaints from my client that an interface function which my team developed to create Sales Orders from a CSV file is "slow".
Now, my role has been to do some "performance tuning" for the past several weeks and one of the interesting results that I retrieved is how NAV (or maybe SQL) handles the orders if it exceeds a certain number of CSV entries.
Shown in the attached image, I could see that up to 7000 CSV lines, the trend was that NAV was getting "slower" with higher times taken to process each sales order. The difference been 1000 lines and 7000 lines was in fact, 33% increase in time / order.
However, what puzzled me was when I started doing tests for 8000 lines and above.
All of a sudden, the time taken for each order dropped dramatically and the trend was reversed as more the CSV lines I had on each file, the processing time for each order was getting shorter.
What I would like to know is what is causing this to happen?
Is it the SQL? Or is it NAV handling this? I'm looking and searching for the specifications but I've had no luck so far...
Many thanks in advance for your input!
_________________
Taiki Yoshida
LinkedIn
This is my first post on Mibuso, so let me know if I'm posting incorrectly... (fingers crossed...)
I have had complaints from my client that an interface function which my team developed to create Sales Orders from a CSV file is "slow".
Now, my role has been to do some "performance tuning" for the past several weeks and one of the interesting results that I retrieved is how NAV (or maybe SQL) handles the orders if it exceeds a certain number of CSV entries.
Shown in the attached image, I could see that up to 7000 CSV lines, the trend was that NAV was getting "slower" with higher times taken to process each sales order. The difference been 1000 lines and 7000 lines was in fact, 33% increase in time / order.
However, what puzzled me was when I started doing tests for 8000 lines and above.
All of a sudden, the time taken for each order dropped dramatically and the trend was reversed as more the CSV lines I had on each file, the processing time for each order was getting shorter.
What I would like to know is what is causing this to happen?
Is it the SQL? Or is it NAV handling this? I'm looking and searching for the specifications but I've had no luck so far...
Many thanks in advance for your input!
_________________
Taiki Yoshida
0
Categories
- All Categories
- 75 General
- 75 Announcements
- 66.7K Microsoft Dynamics NAV
- 18.8K NAV Three Tier
- 38.4K NAV/Navision Classic Client
- 3.6K Navision Attain
- 2.4K Navision Financials
- 116 Navision DOS
- 851 Navision e-Commerce
- 1K NAV Tips & Tricks
- 772 NAV Dutch speaking only
- 610 NAV Courses, Exams & Certification
- 1.9K Microsoft Dynamics-Other
- 1.5K Dynamics AX
- 251 Dynamics CRM
- 103 Dynamics GP
- 6 Dynamics SL
- 1.5K Other
- 991 SQL General
- 383 SQL Performance
- 34 SQL Tips & Tricks
- 28 Design Patterns (General & Best Practices)
- Architectural Patterns
- 9 Design Patterns
- 4 Implementation Patterns
- 53 3rd Party Products, Services & Events
- 1.6K General
- 1K General Chat
- 1.6K Website
- 77 Testing
- 1.2K Download section
- 23 How Tos section
- 249 Feedback
- 12 NAV TechDays 2013 Sessions
- 13 NAV TechDays 2012 Sessions