Categories
View Replies (8)

Resolved import fails but exports ok

  1. gardenho
    gardenho
  2. RO CSVI
  3. Tuesday, 15 May 2018
  4.  Subscribe via email
Hello,
I created a new import template for updating a couple joomla custom fields values. It keeps failing, and furthermore the log shows no problems that I can see and it also will not create a backup of a single template either as a download or saving to folder on server. When I try to backup a template it says it did but it does not. So I cannot give you a copy of the actual template, I made screenshots instead. I have verified the fields I am using are used for Joomla Content and reviewed your troubleshooting notes.

I did not screenshot the options tab for the template, it is just one setting and it is set to NO for keep existing ID.

I have attached a copy of the import file, it is only 4 items. Also a copy of the import log. I tried to download a copy of the template backup log but it says no log available. I successfully updated almost 10,000 articles without issues using CSVI Pro version 7.6.1. This import template was newly created in 7.6.1 but never tested or used until today. I updated CSVI Pro to 7.6.2 within the past week and today was first opportunity to test it works correctly. I successfully exported many files today though.

One of the screenshots shows the onscreen log result after failed import and I think it is saying it failed because there is no fulltext, but that isn't a mandatory field unless it changed? My very first attempt resulted in fail as well saying it required title, so I added it but I thought your docs say for content only alias was mandatory along with category_path and ID of course.

This site was also just moved from staging to live server. I did change the url in CSVI options, and I also tried the import on the staging site which has not changed at all other than the same updates to extensions, and it fails exactly the same way there too. There are no other issues with the site that I can see.

Joomla version 3.8.7
CSVI Pro version 7.6.2
CSVI J2store addon plug 7.6.2

fit-update-test.csv fitment-import-update-fields-screenshot.jpg csvi-pro-log-fit-update-fails.jpg fit-import-tpl-detail-screen.jpg fit-import-tpl-file-screen.jpg com_csvi.log.360.zip
0
Responses (8)
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
I created a new import template for updating a couple joomla custom fields values. It keeps failing, and furthermore the log shows no problems that I can see and it also will not create a backup of a single template either as a download or saving to folder on server. When I try to backup a template it says it did but it does not. So I cannot give you a copy of the actual template, I made screenshots instead. I have verified the fields I am using are used for Joomla Content and reviewed your troubleshooting notes.

Check if your tmp folder has right permissions for backup template problem.

One of the screenshots shows the onscreen log result after failed import and I think it is saying it failed because there is no fulltext, but that isn't a mandatory field unless it changed? My very first attempt resulted in fail as well saying it required title, so I added it but I thought your docs say for content only alias was mandatory along with category_path and ID of course.

Yes, fulltext or introtext are not mandatory but CSVI had it in its check and that is fixed with the attached patch file. Load the patch file and run the import again.
Also, title is not a needed field, if you see the message it says id or title or alias and category_path or catid fields. If no alias is given in import file, with title CSVI can generate alias field and with alias and categoryid ID field can be identified.

Test the patch and let me know how it goes.

patch_content_2018_05_15.zip
Attachments (1)
patch_content_2018_05_15.zip
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
gardenho
gardenho
Accepted Answer Pending Moderation
OK, with the patch the import works although the screen still showed error beside Joomla content line after it was done. Sorry I forgot to take a screenshot before I closed it. The error said no text added to introtext or fulltext but it did still update the values.

I checked my tmp directory perms and they were fine at 755. On the staging site the dir was above the public_html dir and on the live they were within public_html so I changed them to above the root too because on the live site when I attempted to create a template backup before the patch was loaded I saw COM_CSVI_TEMP_PATH_NOT_FOUND and I did not see that message on the staging server. On the live site there is an htaccess file in the tmp dir which prevents anyone trying to add or execute various file types I'm betting that was part of the problem on the live site.
  1. more than a month ago
  2. RO CSVI
  3. # 2
gardenho
gardenho
Accepted Answer Pending Moderation
I can import now but I still cannot download or save template backups on the server. When trying to save it on the server the box opens up to enter the path to save it to but it doesn't respect what I enter and in the log it shows Joomla default tmp directory according to the log but no backup is found there either. The permissions are all good, and both the staging site and the live site have identical problem. I tried without the htaccess file in the default tmp folder but same issue.
  1. more than a month ago
  2. RO CSVI
  3. # 3
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
OK, with the patch the import works although the screen still showed error beside Joomla content line after it was done. Sorry I forgot to take a screenshot before I closed it. The error said no text added to introtext or fulltext but it did still update the values.

Yes, the message was left in there so users would know that introtext or fulltext are not added during import. And we are glad to know that patch worked so you can continue with your import.

I can import now but I still cannot download or save template backups on the server. When trying to save it on the server the box opens up to enter the path to save it to but it doesn't respect what I enter and in the log it shows Joomla default tmp directory according to the log but no backup is found there either. The permissions are all good, and both the staging site and the live site have identical problem. I tried without the htaccess file in the default tmp folder but same issue.

Can you load the attached patch file? You can try setting a different location for saving the backup template file and see if it is working for you.

patch_csvi_2018_05_16.zip
Attachments (1)
patch_csvi_2018_05_16.zip
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 4
gardenho
gardenho
Accepted Answer Pending Moderation
I'm sorry I could not attend to this issue the last couple weeks but I'm back on it now. I tested it out again this morning before trying to apply this second patch and it appears I can save and export templates now, so assuming the second patch addressed just that issue I do not need it, and I never applied it.

What fixed the issue for me was this: I had seen another post with similar issue and noted that they had to create the com_csvi folder under the tmp folder and then it worked, so I did the same and voila my template export worked as a download AND to save on the server. This was necessary even though my config has a temp folder set above the site root, and CSVI pro was using it correctly to load the patch file but it must be hard coded to use the public_html/tmp folder for template backups?

Now that is fixed, I discovered another problem when trying to export using a template based on J2store products fields.

When I export, it seems limited to just 871 lines. I used the template to export each category seperately because there are over 1000 items in each one but every time it only exported 871 items, even from categories where I confirmed there are over 1800 items it should have exported. I have Joomla content export templates set up for each category too, and using those they export the correct number. So something is wrong with the J2store export function. Unless, the settings under 'file' tab require a number in 'From record' and 'To record' because I left them blank expecting it to get all records.

I attached the log of an export as well as the template com_csvi.log.401.zip csvi_template_j2-id-sku-alias-20180602.xml
Attachments (2)
com_csvi.log.401.zip
csvi_template_j2-id-sku-alias-20180602.xml
  1. more than a month ago
  2. RO CSVI
  3. # 5
gardenho
gardenho
Accepted Answer Pending Moderation
I just tried something else - on the template I had it set to use manufacturers as my categories to export. I changed it by removing the manufacturers selected under manufacturers dropdown and used the product sku filter box instead. This time I got almost the correct number of products.

When I went back to review the logs of the first attempts when it used manufacturer I saw that every time at the bottom of the log it said manufacturer_id=1 but that id should have been different because I selected a manufacturer from the list in the dropdown and they all have different id of course. SO I think that is where the problem lies, is in that manufacturer field.
  1. more than a month ago
  2. RO CSVI
  3. # 6
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
What fixed the issue for me was this: I had seen another post with similar issue and noted that they had to create the com_csvi folder under the tmp folder and then it worked, so I did the same and voila my template export worked as a download AND to save on the server. This was necessary even though my config has a temp folder set above the site root, and CSVI pro was using it correctly to load the patch file but it must be hard coded to use the public_html/tmp folder for template backups?

Yes, CSVI looks for com_csvi folder for exports inside tmp folder. And for template backups if there is no backup location set default is tmp folder is used.

When I went back to review the logs of the first attempts when it used manufacturer I saw that every time at the bottom of the log it said manufacturer_id=1 but that id should have been different because I selected a manufacturer from the list in the dropdown and they all have different id of course. SO I think that is where the problem lies, is in that manufacturer field.

Yes, that is the problem as per your debug log. The query is looking for records with manufacturer_id set to 1 and so you must be seeing only the records which have the manufacturer_id set to 1.
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 7
gardenho
gardenho
Accepted Answer Pending Moderation
The backup folder was set but it still didn't work until I added the com_csvi folder to /tmp.

Indeed #1 had exactly 871 products. So I think I'm sorted out now and this is solved. Thanks for your time and help!
  1. more than a month ago
  2. RO CSVI
  3. # 8
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!