Resolved New user to CSV Improved need help with csv import from local ftp

Hello,
You said you have 100 lines per import, what if you reduce it to 50 and do the import?

I seem to be having the issue again when getting at the 2200 mark processing 100 at a time.
[img ]https://image.prntscr.com/image/83b9db4ef52246c780d6af022660f676.png[/img]

i think I have solved it.

even thought the max execution time was set to 0 it has no effect, i had to change the http, https and nginx directives to add extended timeouts.

If anyone else has this issue then these are the settings from my plesk panel which seem to be working atm without any errors or timeouts.
[img ]https://image.prntscr.com/image/18bd75f8add14a3ba72ae7929679463f.png[/img]

Hello,

could this script not be releasing memory on the import cycles and running out of memory?

Every time the number of lines per import is reached the script restarts and by doing so the import cycles and memory are released. That is why Tharuna is asking to lower the number of Lines per import in your template.

If you keep getting the same error, check if you are not hitting another server limit regarding the number of requests that can be send. Lowering the number of lines per import should also help because the script will sleep the number of seconds set in the template.

Hello,
You havent mentioned on how much lines you have limited on import but what if you reduce it to 50 lines and do the import? Does it still fails after 2k?

could this script not be releasing memory on the import cycles and running out of memory?

i have tried reducing the amount of items to import at a time in the limits but it only get to around 2k then fails...

It says they are writable.

[img ]https://image.prntscr.com/image/88b7c5395a8749a59abce622e7d34596.png[/img]

Hello,
The error in your log "End of script output before headers: " is mostly because of permission issues. Can you check if there is right permissions set for your tmp folder? The CSVI About page will tell you the permission of folders used by CSVI, check if they are all writable. Along with that check if the permissions of your files and folder are of 0755 and 0644. You can also specifically check administrator/component/com_csvi and components/com_csvi folders.

thank you guys that fixed the categories and file urls, but after running small tests and then moving over to a full import job i get an error 500 page during the import and it refers me to my server logs.


[Mon Jun 05 18:16:48.421586 2017] [fcgid:warn] [pid 28074] (32)Broken pipe: [client 86.184.240.194:47466] mod_fcgid: ap_pass_brigade failed in handle_request_ipc function, referer: https://www.pmc.solutions/results/?q=VER-53194
[Mon Jun 05 18:25:11.041460 2017] [fcgid:warn] [pid 13081] (104)Connection reset by peer: [client 86.184.240.194:48152] mod_fcgid: error reading data from FastCGI server, referer: https://www.pmc.solutions/administrator/index.php?option=com_csvi&view=import
[Mon Jun 05 18:25:11.041652 2017] [core:error] [pid 13081] [client 86.184.240.194:48152] End of script output before headers: rantai.php, referer: https://www.pmc.solutions/administrator/index.php?option=com_csvi&view=import

Hello,
You have created combine rules but havent applied them on category_path and file_url field as per your screenshot. In your template field page, click on category_path field and in the Rules field select the rule your created for category_path field which is Combine category and save the field. Do the same for file_url applying the rule created for file_url field and then run the import.

looks like combine isnt working + it is giving numbers for some weird reason.

product_weight field has been used as category_path in your import. In your template settings on File tab, set Use file for configuration to No and save the template.

With all the above mentioned changes your import should run good. If there is still a problem, post your latest debug log to check.

can one of you guys either teamviewer in or I can setup a temp account as i need to get this sorted.

looks like combine isnt working + it is giving numbers for some weird reason.

[img ]https://image.prntscr.com/image/cd44ad3c314b47c599a0663b08a49014.png[/img]

Yes I have created as you can see here.
[img ]https://image.prntscr.com/image/6a88bb6eb7a64a4eae242b0d5c3edd97.png[/img]

[img ]https://image.prntscr.com/image/b3f5c1caaf24431b845ccd47c7f1eb8e.png[/img]

[ img]https://image.prntscr.com/image/2ca53934869f42ea8fbd7ab51b7c3c51.png[/img]

Hello,

setup the combine on both category and file url

In the template you posted, I don't see any combine rules. Did you create them? I don't see the combine field either in your template. There should be only one category_path and one file_url as shown in the tutorial I linked earlier.

i have altered my csv file, changed the layout, setup the combine on both category and file url and still not working.

Hello,

It worked on another plugin I used as i could just put a single name in and it would match up but this....

That is interesting because let's say your category is pants and this is your category structure:
Clothes/Men/Pants
Clothes/Women/Pants

How would it know which category to take? That is why we require the full path.

I see that your sample.csv file does have a parent and a child name. Namely Components and Cooling. What needs to be done is that you combine these two to a full path. No, you don't have to do this by hand but you can just make a replacement rule so it happens on the fly. We have this explained in the Combine plugin tutorial. That should solve your issue of the categories.

Your images are also in 3 different columns I see file_url1, file_url2, and file_url3. These also need to be combined into a single field called file_url. The same applies here, you can use the combine rule to combine them all three together as CSVI an import multiple images at once. Multiple images are separated by the |-symbol.

Have a look at that and let us know how you get on.

i think some of the issue is my feed the category is only listed as the category name not a full path. It worked on another plugin I used as i could just put a single name in and it would match up but this....

Is there anyway of me just inputting the category name in the product import without the full path as this feed updates every few hours and it is not possible to get the feed modified to a full category path.

just lists category name and parent name

I have no idea about the images though, unless that has to be run as a separate import job which would slow down the process and would mean importing over 12k of products twice.

I was trying anything and everything to try and get the images to upload.

here is xml as requested for product import.

Hello,
Your debug log shows there is no process on image happened on import. I also see that you are doing ICECat import, How did you do field mapping? Can you also post the template XML file? To get template XML file go to CSVI maintenance page, Select CSVI Pro on first option and Backup template on second option. Select your template and click continue. Download the XML file and post it.