Categories
View Replies (6)

Resolved List of server load problems

  1. rainbow69
    rainbow69
  2. RO CSVI
  3. Monday, 11 July 2016
  4.  Subscribe via email
Hello!
I created an ecommerce site using:
- joomla 3.5.1
- virtuemart 3.0.16
- csvi pro 6.6.0
I have to load the list of products on my site http://www.smar-tech.it.
The price list is very large are 47000 products and the file is 170 MB (the file is called WS-LIST-GD.csv), loading from my pc works but the time to do it is really long. To speed up the process I loaded the list (in a folder, which I called "listino";), in the site root folder (/http://www.smar-tech.it/listino/) and I'm trying to do is upload the file with source "load from server" to "load from FTP servers" but both methods do not work. I have two attached screenshot with the error reports. I would understand if it is a hosting problem (I called technical support and by testing everything seems to work), if it is a configuration problem of CSVI, or is it a bug CSVI.
Thanks for the answers.
0
Responses (6)
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
The price list is very large are 47000 products and the file is 170 MB (the file is called WS-LIST-GD.csv), loading from my pc works but the time to do it is really long. To speed up the process I loaded the list (in a folder, which I called "listino";), in the site root folder (/http://www.smar-tech.it/listino/) and I'm trying to do is upload the file with source "load from server" to "load from FTP servers" but both methods do not work. I have two attached screenshot with the error reports. I would understand if it is a hosting problem (I called technical support and by testing everything seems to work), if it is a configuration problem of CSVI, or is it a bug CSVI.
Thanks for the answers.

For "load from server" option, you need to use the directory path of the file instead of absolute url and include the filename in your path. For "load from FTP servers" the error says that username and password is not correct. Can you check on it by trying with any file transfer protocol?
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
rainbow69
rainbow69
Accepted Answer Pending Moderation
For "load from server" option, if I type on my browser (firefox) http://www.smar-tech.it/listino/WS-LIST-GD.csv opens the download window and I can download the file. Because when I post the same link in CSVI does not work? It is wrong as I write the link?
  1. more than a month ago
  2. RO CSVI
  3. # 2
rainbow69
rainbow69
Accepted Answer Pending Moderation
For "load from server" option, you need to use the directory path of the file instead of absolute url and include the filename in your path. For "load from FTP servers" the error says that username and password is not correct. Can you check on it by trying with any file transfer protocol?


I'm sorry I misunderstood your answers. By entering the absolute path "/web/htdocs/http://www.smar-tech.it/home/listino/WS-LIST-GD.csv" loading works.
Using as a load from the source server must continue to keep the options in the tab limit? I have attached a screenshot of my settings. The "limit advanced option" I had on when I was using "load from your computer" to upload the .csv file.
Attachments (1)
LIMIT.jpg LIMIT.jpg
  1. more than a month ago
  2. RO CSVI
  3. # 3
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

Using as a load from the source server must continue to keep the options in the tab limit?
It will be good to keep them as the size of your import file is large and will never complete within 30 seconds so this way the process can loop until it reaches the end.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 4
rainbow69
rainbow69
Accepted Answer Pending Moderation
Thank you,
It will be good to keep them as the size of your import file is large and will never complete within 30 seconds so this way the process can loop until it reaches the end.


Doing the accounts unfortunately serve 22 hours to complete the file import process. Surely a little more than 30 seconds :( .
There is a method to speed up the loading? 150 lines every 5 minutes are too few.
How long should the life of the session in joomla (1320 minutes?)?
  1. more than a month ago
  2. RO CSVI
  3. # 5
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

Doing the accounts unfortunately serve 22 hours to complete the file import process.
There are a lot of contributing factors to this. Image handling is one of them especially if you are retrieving them from an external source. The idea would then be to run 2 separate imports with the same file. First import the products and second import the images.

You can also have a look at the Speed up product import article.

Another measure could be to use a dedicated server with SSD disks and an optimized connection to the database. How to do this is out of my area of expertise and out of range for support.

The Joomla session has nothing to do with this, it is the maximum execution time you need to be aware of. You can find more info in the Manage timeouts document on this.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 6
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!