Resolved Virtuemart Product Import On Cron Hanging As Running Process

Hello Tim,
May i know how many products you are trying to import? What if you try the import with just 5 products? does the import finish then? Are you downloading any images and from remote server? The import time would be longer with many number of products and if there are images for processing. Try the import with 5 products and if you still have issues post the debug log of import of these 5 products which will be of smaller size to attach here.

Forgot to mention in my previous reply that you are not using the latest CSVI version, would recommend to update your CSVI to latest 7.1.0 version.

thanks Tharuna, will update to 7.1.0 and try a small upoad cron and advise

Kind regards

Tim

Hi Tharuna

Using 7.1.0 now and have changed import to a single line. This seems to work ok but does remain in the running processes area.

I have attached the log for the import as well as a screen shot of last nights log and running processes.

Our setup is that we run a cron import at 8pm and then a product export at 10pm

As this is a daily excercise i am concerned that the running processes will keep building and adversely affect server performance. I am also unsure why the export shows with two entries on the log?

Kind regards

Tim croninfo.docx com_csvi.log.171.zip

Hello Tim,

Using 7.1.0 now and have changed import to a single line. This seems to work ok but does remain in the running processes area.

I have attached the log for the import as well as a screen shot of last nights log and running processes.

As per your debug log, you are processing multiple images for a product and thumbnail is generated for these images. I am thinking if this image processing is what taking time in your import.

As this is a daily excercise i am concerned that the running processes will keep building and adversely affect server performance.

I don't see anything wrong with your import other than process on images. One thing to try is on your import template settings, click on advanced button on top right to see limit tab. Try setting lines per import to some lesser number, default is 1000 and see how import goes. Please have a look at Managed timeout document which explains more on this setting.

I am also unsure why the export shows with two entries on the log?

Do you mean to say you are seeing two entries in debug log file? If yes, can you post the debug log?

Hello Tim,

What you are seeing looks like something I have seen on occasion as well, the import is actually finished but the Running Processes isn't updated accordingly. Your import shows that the import has finished in the log settings. The log settings are more accurate than the running processes.

Another way you can check if the process has really finished is by having the cron email you the output of the cron import. Since CSVI will output the import results you should get those in the email, so you know the cron job actually finished.

The Manage timeout as mentioned by Tharuna won't have an effect on the cron job because the cron runs in it's own environment and can't run in batches.

The double logging of the export, looks like the entry has been written at the same time. This may be a glitch if you run it via the cron that the "preview", which you don't have, causes this. We can check this if you see it for every cron job.

Morning Roland,

On last nights cron import i amended the template to not process images, but same result in that both the log and also the server email message shows successful. The process is still present in running processes however, but i guess if its not causing any harm i can just periodically go in and delete these.

I have attached a log for your reference.

com_csvi.log.174.zip

On the double logging of product exports it does seem to be present all the time on this site and others that replicate a similar csvi cron product export. I can supply further info if it helps? Again i guess its not doing any harm, but worth you guys being aware.

Kind regards

Tim

Hello Tim,

On the double logging of product exports it does seem to be present all the time on this site and others that replicate a similar csvi cron product export. I can supply further info if it helps? Again i guess its not doing any harm, but worth you guys being aware.

Yes, please provide us the information on export if you come across the double logging frequently and we will take a look.

Hello,

Thank you for letting us know. I have put both issues on the todo list so we can investigate them.