Categories
View Replies (20)

Resolved Sorting Custom Field Options - A to Z

  1. simonhodgkiss
    simonhodgkiss
  2. RO CSVI
  3. Monday, 04 May 2020
  4.  Subscribe via email
Hello,

I have multiple options for a Custom Field.

Is there anyway to sort them by A-Z as they appear all jumbled up once imported.

I've tired importing them A-Z on my import sheet.

I've tried importing them Z-A on my import sheet.

It appears to work for some products and their customer fields but not for all it seems really random how they get sorted.

Thanks
0
Accepted Answer
rolandd
rolandd
Accepted Answer Pending Moderation
Hello Simon,

I do see something which I think is significant. There is the field layout which changed from 0 to default. The 0 matches the option No override in the product edit page. After your save this is changed to default so that is a different layout I guess. See if you change the import product back to No override if that fixes the rendering.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # Permalink
Responses (20)
rolandd
rolandd
Accepted Answer Pending Moderation
Hey Simon,

Glad to hear that is indeed the issue :)

Our PayPal is contact@rolandd.com
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
rolandd
rolandd
Accepted Answer Pending Moderation
Thank you Simon.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 2
rolandd
rolandd
Accepted Answer Pending Moderation
Hello Simon,

You did not post a sample of your import file nor a debug log, so I am going to assume you are not using the custom_ordering field. See the Product import with custom fields tutoriald and specifically the section Ordering custom fields.

That should allow you to order the fields.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 3
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Thank you I didn't see that.

However I have over 65,000 to import in.

If I sort them correctly ? and number from 1 to 65,000 would that work?

Product 1 - would have say 1 to 30
Product 2 - would have 31 to 145
Product 3 - would have 146 to 156

Would this work?
  1. more than a month ago
  2. RO CSVI
  3. # 4
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
I appear to have some weird things going on I have a product with over 100 custom fields.

The import works but then for some reason it decided to delete part of them when I load the product in the front-end I can see them but then they disappear and it leaves about 10.
Attachments (1)
com_csvi.log.73.zip
  1. more than a month ago
  2. RO CSVI
  3. # 5
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

If I sort them correctly ? and number from 1 to 65,000 would that work?
That would work because the numbers are sequential.

I appear to have some weird things going on I have a product with over 100 custom fields.
That is weird because in your version, it is not current, we delete the custom fields assigned to a product and then add whatever is in your import file. Looking at the debug log it is adding 1 custom field per product.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 6
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Hello,

I have a file with over 65,000 lines to run into the Custom field options.

For some reason it adds some but not others please can you check why this is.

The product SKU is 171461 if you can check why the feed went wrong at this one from my log file this would be useful.

If you look at product SKU 000030 this product has about 80 options which worked fine.

I am unable to upload my CSV due to file size if you increase the upload size to 4mb I will add the CSV

Thanks
Attachments (1)
com_csvi.log.94.zip
  1. more than a month ago
  2. RO CSVI
  3. # 7
rolandd
rolandd
Accepted Answer Pending Moderation
Hello Simon,

The debug log only has the first 20 as set per the configuration. Instead of sifting through 65000 products, make a file with the problematic SKU(s) and import just that. This will make analyzing the issue much easier.

Please do that and let me know how it goes.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 8
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Hello,

Thank you for your feedback.

Your suggestion works by running the problematic SKU this fixes the issue.

However I currently have no way or idea how to discover any SKU's causing me issues out of 65,000.

I split the sheet down into blocks of 15,000 SKU's to import but this still has miseducating some of the lines somehow, yet when I run the SKU on its own it works fine.

Thanks
  1. more than a month ago
  2. RO CSVI
  3. # 9
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

The only thing that I can say at this point is to then increase the number of log lines to 15,000 in the global configuration of RO CSVI by going to Dashboard and click on the Options button in the top right corner. This will produce a huge logfile but perhaps it can shed some light on what is going on.

This is not an issue with the line itself then but rather something that creeps up, perhaps something to do with memory. You might also try to lower the lines per run in the template settings, to see if that makes any difference. It is a bit of a shot in the dark ;)
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 10
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Hello Roland,

I managed to fix this issue by telling the import to import 70,000 per import, the reason for this was because if I lowered the number to 150 if a product had 150 in the 1st run and 10 in the next run it wiped out the first 150 and only left the 10.

However, I have now discovered another issue not sure if this is CSVI related or Virtuemart but since the products are imported I guessed it could be CSVI.

If I edit a product manually which has the custom fields added the product it corrupts the product?

Any ideas why this would be?

Examples of how the product should look and how it looks after I've manually saved the product.
Attachments (2)
Screenshot 2020-05-11 at 11.26.41.png Screenshot 2020-05-11 at 11.26.41.png
Screenshot 2020-05-11 at 11.27.05.png Screenshot 2020-05-11 at 11.27.05.png
  1. more than a month ago
  2. RO CSVI
  3. # 11
rolandd
rolandd
Accepted Answer Pending Moderation
Hello Simon,

I managed to fix this issue by telling the import to import 70,000 per import, the reason for this was because if I lowered the number to 150 if a product had 150 in the 1st run and 10 in the next run it wiped out the first 150 and only left the 10.
What was deleted, the custom fields?

No clue on what is going wrong when you save the product as that is VirtueMart code but it almost looks like the product is using a different layout. When you edit the product again, are the custom fields still there? You could check the database if the custom fields are still there or export the product details.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 12
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
What was deleted, the custom fields?


Yes the custom fields are deleted when the import is across 2 import blocks.

EG: 1 product has 30 custom fields in the first import block of 150 lines and 40 custom fields in the 2nd block of 150 lines so at total of 70 custom fields.

However because the 2nd block was over writing the first block of 30 custom fields it only showed up the 40 custom fields in total so by changing the import to 70,000 lines all 65,000 custom fields are added correctly.


No clue on what is going wrong when you save the product as that is VirtueMart code but it almost looks like the product is using a different layout. When you edit the product again, are the custom fields still there? You could check the database if the custom fields are still there or export the product details.


1) The MySQL Database has the custom fields
2) The Product in the Admin has the custom fields
3) The front-end doesn't work
4) CSVI only exports the 1st value from Boiler and GC number
Attachments (2)
Screenshot 2020-05-11 at 11.55.14.png Screenshot 2020-05-11 at 11.55.14.png
Screenshot 2020-05-11 at 11.58.20.png Screenshot 2020-05-11 at 11.58.20.png
  1. more than a month ago
  2. RO CSVI
  3. # 13
rolandd
rolandd
Accepted Answer Pending Moderation
Hello Simon,

EG: 1 product has 30 custom fields in the first import block of 150 lines and 40 custom fields in the 2nd block of 150 lines so at total of 70 custom fields.
Ah yes, that makes sense actually.

3) The front-end doesn't work
A small detail, the front-end doesn't work after you save the product manually ;)

Did you check the layout I mentioned, if all the data is there, it has to be some kind of rendering issue unrelated to the custom fields. In your debug log you also only just import the custom fields. If you create 1 product manually, does that render OK? I am just struggling to find a relation between the custom fields and the front-end rendering.

The only other idea is to make an export of all VirtueMart tables, make a change in 1 product, export all VirtueMart tables again and compare them.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 14
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
A small detail, the front-end doesn't work after you save the product manually ;)


When I edit any product that has custom fields imported by CSVI the front-end view of the product is rendered corrupted which seems super strange I know.

Ive used CSVI since at least Joomla 1.5 days I think! it's the best tool ever!


I've just added a product manually added custom fields and edited the product without any issues.
  1. more than a month ago
  2. RO CSVI
  3. # 15
rolandd
rolandd
Accepted Answer Pending Moderation
Hey Simon,

Can you do the comparison I mentioned earlier? Perhaps it is enough to export the virtuemart_products table and compare that with a before and after. Just to see what has changed. This should only be something related to the 1 product changed.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 16
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Since my DB table is 4.7MB here is a snippet with the product I edited.

SKU: 173039

Before EDIT



INSERT INTO `jos_virtuemart_products` (`virtuemart_product_id`, `virtuemart_vendor_id`, `product_parent_id`, `product_sku`, `product_gtin`, `product_mpn`, `product_weight`, `product_weight_uom`, `product_length`, `product_width`, `product_height`, `product_lwh_uom`, `product_url`, `product_in_stock`, `product_ordered`, `product_stockhandle`, `low_stock_notification`, `product_available_date`, `product_availability`, `product_special`, `product_discontinued`, `product_sales`, `product_unit`, `product_packaging`, `product_params`, `product_canon_category_id`, `hits`, `intnotes`, `metarobot`, `metaauthor`, `layout`, `published`, `pordering`, `has_categories`, `has_manufacturers`, `has_medias`, `has_prices`, `has_shoppergroups`, `created_on`, `created_by`, `modified_on`, `modified_by`, `locked_on`, `locked_by`) VALUES

(1, 1, 0, '000711', NULL, '000711', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:38:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(2, 1, 0, '000441', NULL, '000441', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:43:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(3, 1, 0, '000471', NULL, '000471', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:43:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(4, 1, 0, '135527', NULL, '135527', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(5, 1, 0, '172428', NULL, '172428', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(6, 1, 0, '172441', NULL, '172441', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(7, 1, 0, '172666', NULL, '172666', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-05 15:26:33', 519, '0000-00-00 00:00:00', 0),

(8, 1, 0, '173039', NULL, '173039', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-05 15:26:33', 519, '0000-00-00 00:00:00', 0),

(9, 1, 0, '173136', NULL, '173136', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-05 15:26:33', 519, '0000-00-00 00:00:00', 0),

(10, 1, 0, '173236', '', '173236', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|shared_stock=0|product_box=\"\"|', NULL, 0, '', '', '', 'default', 1, 0, 1, 1, 0, 0, 0, '2020-05-05 09:12:49', 519, '2020-05-11 12:27:38', 519, '0000-00-00 00:00:00', 0),




After EDIT (Updated time is 2020-05-11 12:42:48)



INSERT INTO `jos_virtuemart_products` (`virtuemart_product_id`, `virtuemart_vendor_id`, `product_parent_id`, `product_sku`, `product_gtin`, `product_mpn`, `product_weight`, `product_weight_uom`, `product_length`, `product_width`, `product_height`, `product_lwh_uom`, `product_url`, `product_in_stock`, `product_ordered`, `product_stockhandle`, `low_stock_notification`, `product_available_date`, `product_availability`, `product_special`, `product_discontinued`, `product_sales`, `product_unit`, `product_packaging`, `product_params`, `product_canon_category_id`, `hits`, `intnotes`, `metarobot`, `metaauthor`, `layout`, `published`, `pordering`, `has_categories`, `has_manufacturers`, `has_medias`, `has_prices`, `has_shoppergroups`, `created_on`, `created_by`, `modified_on`, `modified_by`, `locked_on`, `locked_by`) VALUES

(1, 1, 0, '000711', NULL, '000711', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:38:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(2, 1, 0, '000441', NULL, '000441', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:43:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(3, 1, 0, '000471', NULL, '000471', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, NULL, NULL, NULL, NULL, NULL, '2020-05-05 08:43:14', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(4, 1, 0, '135527', NULL, '135527', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(5, 1, 0, '172428', NULL, '172428', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(6, 1, 0, '172441', NULL, '172441', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-07 09:13:15', 519, '0000-00-00 00:00:00', 0),

(7, 1, 0, '172666', NULL, '172666', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-05 15:26:33', 519, '0000-00-00 00:00:00', 0),

(8, 1, 0, '173039', '', '173039', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|shared_stock=0|product_box=\"\"|', NULL, 0, '', '', '', 'default', 1, 0, 1, 1, 0, 0, 0, '2020-05-05 09:12:49', 519, '2020-05-11 12:42:48', 519, '0000-00-00 00:00:00', 0),

(9, 1, 0, '173136', NULL, '173136', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|product_box=\"\"|', NULL, 0, '', '', '', '0', 1, 0, 1, 1, 0, 1, 0, '2020-05-05 09:12:49', 519, '2020-05-05 15:26:33', 519, '0000-00-00 00:00:00', 0),

(10, 1, 0, '173236', '', '173236', 0.0000, 'KG', 0.0000, 0.0000, 0.0000, 'M', '', 0, 0, '0', 0, '0000-00-00 00:00:00', '', 0, 0, 0, 'KG', 0.0000, 'min_order_level=\"\"|max_order_level=\"\"|step_order_level=\"\"|shared_stock=0|product_box=\"\"|', NULL, 0, '', '', '', 'default', 1, 0, 1, 1, 0, 0, 0, '2020-05-05 09:12:49', 519, '2020-05-11 12:27:38', 519, '0000-00-00 00:00:00', 0),




Let me know if you can see anything that stands out as I don't appear to see anything?
  1. more than a month ago
  2. RO CSVI
  3. # 17
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Super star Roland!

What's your PayPal email address?

Thanks
  1. more than a month ago
  2. RO CSVI
  3. # 18
simonhodgkiss
simonhodgkiss
Accepted Answer Pending Moderation
Thanks for your help.

Really much appreciated the effort.

Just sent you a little something extra for your time.

Thanks for everything
  1. more than a month ago
  2. RO CSVI
  3. # 19
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!