Categories
View Replies (4)

Resolved Illegal mix of collations

  1. konstantinos29
    konstantinos29
  2. RO CSVI
  3. Tuesday, 14 July 2020
  4.  Subscribe via email
Hello,

I import products from CSV into a Virtuemart (3.8.2) website.
All our CSVs are generated by a PHP platform, so they use the same specs/format.

I've been having a problem similar to the one in this thread:
https://rolandd.com/support/ro-csvi/illegal-mix-of-collations-utf8-general-ci-implicit-and-utf8mb4-general-ci-coercible-for-operation

But it does not happen to all CSV imports.

For example, the following category of products imported correctly.
Attachment: com_csvi.log.460.txt

But this category of products, did not:
Attachment: com_csvi.log.461.txt
(See error in the screenshot)

Both CSV files are UTF8, use the same fields, and are generated by the same software.

Yes, some tables have different collations but why would most other imports work fine?

We want to avoid having to mess with converting everything in the db to utf8mb4-general-ci because of unknown consequences with Joomla + extensions.

Could you help us maybe identify where exactly the problem lies, so we can target directly?

Thank you

PS. Also attaching a .zip with the 2 CSV import files
Failing CSV: vm_csvi_products_LAMPS-HEAD-import-2020-07-13--001.csv

PS2. For the failing CSV, the error doesn't happen from the beginning... products import fine, but the related products are not created.
0
Accepted Answer
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
Thank you for posting the debug log. I see that you are getting the error with product_sku AP-021805131 row which is the 675th record in import file. Checking this line on the import file, i am seeing some unreadable characters in product_mpn, custom_value and custom_param columns. These characters are also in the next row with product_sku AP-021805132. See screenshots attached. This should be the cause for the error. Can you edit these unreadable characters and run the import again?
Attachments (2)
Screenshot 2020-07-14 at 5.22.48 PM.png Screenshot 2020-07-14 at 5.22.48 PM.png
Screenshot 2020-07-14 at 5.27.37 PM.png Screenshot 2020-07-14 at 5.27.37 PM.png
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # Permalink
Responses (4)
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
First thing i wanted to tell you is that i ran the file vm_csvi_products_LAMPS-HEAD-import-2020-07-13--001.csv in my local import template and the import went without any errors. We now need to check why imports fails on your site. The debug log you sent for the failed file has only first 20 entries so we don't know where the import failed. Those 20 entries is the default number of entries set for a debug log in RO CSVI Global config page. We can increase these debug log entries and check on which line of the import file you are seeing the error. To increase the debug log entries go to RO CSVI Dashboard page >> Options >> Site tab >> set Number of lines in log file field to 795(number of lines in import file) and save the settings. Run the import and send the debug log with those entries. I can then check the row where the import fails.

One other way to test this is to check the import of this file on a fresh Joomla and RO CSVI installation. Check if you are seeing the same error.
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
konstantinos29
konstantinos29
Accepted Answer Pending Moderation
Hello and thanks for the quick reply.

Here's the complete log.
  1. more than a month ago
  2. RO CSVI
  3. # 2
konstantinos29
konstantinos29
Accepted Answer Pending Moderation
Right on target.
Our source data was not encoded properly, and we missed some very rare edge cases.

It now works great.

Thanks!
  1. more than a month ago
  2. RO CSVI
  3. # 3
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!