Categories
View Replies (28)

Resolved New user to CSV Improved need help with csv import from local ftp

  1. pmcsolutions
    pmcsolutions
  2. RO CSVI
  3. Sunday, 21 May 2017
  4.  Subscribe via email
I have a product feed which gets updated on a regular basis, I have attached the sample file i receive but seem to be having issues trying to run the import.

[img size=500 alt=image]https://image.prntscr.com/image/f8644505e4ec4318a0abfa416f6071d1.png[/img]

Can anyone help point me in the right direction?
0
Responses (28)
pmcsolutions
pmcsolutions
Accepted Answer Pending Moderation
i have changed a few things and removed the conf from file and skip the first row. field mappings added but still having issues with:-

categories
product unit of measurement
images

Im trying to add three images to the product. (can this only be done on a separate job?)
Attachments (2)
all_products.csv
com_csvi.log.41.zip
  1. more than a month ago
  2. RO CSVI
  3. # 21
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
There are two issues i can find from your debug log.
1. The second field in your import should be file_url instead of url. You can add product_sku and file_url as your template fields and set Use file for configuration as No in template settings and on file tab. This setting will tell CSVI to use template fields and not the column headers in import file.
2. Since you are processing external images you need to set Save images on server to Yes in your template settings and on image tab. This is needed because VirtueMart cannot store external links and need the images stored on server.

Try these changes and run the import again. If you still have issues attach the latest debug log along with sample import file.
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 22
pmcsolutions
pmcsolutions
Accepted Answer Pending Moderation
OK
I have cut down the import to just a few entries and i cannot seem to get the images to import from an external url.

The csv contains just two columns

product_sku and the url

Warning: Spoiler Alert! [Toggle message]

Details
Date 2017-05-29 21:30:28 UTC
Software Joomla Platform 13.1.0 Stable [ Curiosity ] 24-Apr-2013 00:00 GMT
Date Time Line Action Comment
Processed 155 lines
2017-05-29 21:30:28 0 [DEBUG] Clean up old logs. Found 24 logs and threshold is 25 logs
2017-05-29 21:30:30 0 [DEBUG] Retrieved from FTP: /images/all_images.csv
2017-05-29 21:30:30 0 [QUERY] SELECT `records` FROM `jos_csvi_logs` WHERE `csvi_log_id` = 24
2017-05-29 21:30:30 0 [DEBUG] Found field delimiter: ,
2017-05-29 21:30:30 0 [DEBUG] Found field delimiter: ,
2017-05-29 21:30:30 0 [DEBUG] Loading the supported fields for com_virtuemart, operation mediaproduct and action import
2017-05-29 21:30:30 0 [QUERY] SELECT `a`.`csvi_name` FROM `jos_csvi_availablefields` AS `a` LEFT JOIN `jos_csvi_availabletables` AS `t` ON `t`.`template_table` = `a`.`component_table` WHERE `a`.`component` = 'com_virtuemart' AND `t`.`component` = 'com_virtuemart' AND `t`.`task_name` = 'mediaproduct' AND `a`.`action` = 'import' AND `t`.`action` = 'import'
2017-05-29 21:30:30 0 [DEBUG] Load the fields to process
2017-05-29 21:30:30 0 [DEBUG] Setup field: product_sku
2017-05-29 21:30:30 0 [DEBUG] Use the file for configuration
2017-05-29 21:30:30 0 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:30 0 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:30 0 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:30 0 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:30 0 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 0 [DEBUG] Found field delimiter: ,
2017-05-29 21:30:33 0 [DEBUG] Loading the supported fields for com_virtuemart, operation mediaproduct and action import
2017-05-29 21:30:33 0 [QUERY] SELECT `a`.`csvi_name` FROM `jos_csvi_availablefields` AS `a` LEFT JOIN `jos_csvi_availabletables` AS `t` ON `t`.`template_table` = `a`.`component_table` WHERE `a`.`component` = 'com_virtuemart' AND `t`.`component` = 'com_virtuemart' AND `t`.`task_name` = 'mediaproduct' AND `a`.`action` = 'import' AND `t`.`action` = 'import'
2017-05-29 21:30:33 0 [DEBUG] Load the fields to process
2017-05-29 21:30:33 0 [DEBUG] Setup field: product_sku
2017-05-29 21:30:33 0 [DEBUG] Use the file for configuration
2017-05-29 21:30:33 0 [DEBUG] Clean up old logs. Found 24 logs and threshold is 25 logs
2017-05-29 21:30:33 0 [DEBUG] Found field delimiter: ,
2017-05-29 21:30:33 0 [DEBUG] Loading the supported fields for com_virtuemart, operation mediaproduct and action import
2017-05-29 21:30:33 0 [QUERY] SELECT `a`.`csvi_name` FROM `jos_csvi_availablefields` AS `a` LEFT JOIN `jos_csvi_availabletables` AS `t` ON `t`.`template_table` = `a`.`component_table` WHERE `a`.`component` = 'com_virtuemart' AND `t`.`component` = 'com_virtuemart' AND `t`.`task_name` = 'mediaproduct' AND `a`.`action` = 'import' AND `t`.`action` = 'import'
2017-05-29 21:30:33 0 [DEBUG] Load the fields to process
2017-05-29 21:30:33 0 [DEBUG] Setup field: product_sku
2017-05-29 21:30:33 0 [DEBUG] Use the file for configuration
2017-05-29 21:30:33 0 [DEBUG] ==========
2017-05-29 21:30:33 0 [DEBUG] CSVI Pro Version: 7.1.0
2017-05-29 21:30:33 0 [DEBUG] PHP version: 5.5.9-1ubuntu4.2
2017-05-29 21:30:33 0 [DEBUG] Action: import
2017-05-29 21:30:33 0 [DEBUG] Component: com_virtuemart
2017-05-29 21:30:33 0 [DEBUG] Operation: mediaproduct
2017-05-29 21:30:33 0 [DEBUG] Override:
2017-05-29 21:30:33 0 [DEBUG] Source: fromftp
2017-05-29 21:30:33 0 [DEBUG] Load from your computer: /var/www/vhosts/mydomain/httpdocs/tmp/com_csvi/2736182455/all_images.csv
2017-05-29 21:30:33 0 [DEBUG] Load from server:
2017-05-29 21:30:33 0 [DEBUG] Delete after import: No
2017-05-29 21:30:33 0 [DEBUG] Load from URL: http://
2017-05-29 21:30:33 0 [DEBUG] URL Username:
2017-05-29 21:30:33 0 [DEBUG] Name of username field: user
2017-05-29 21:30:33 0 [DEBUG] URL Password:
2017-05-29 21:30:33 0 [DEBUG] Name of the password field: password
2017-05-29 21:30:33 0 [DEBUG] Retrieve method: get
2017-05-29 21:30:33 0 [DEBUG] FTP Host: 127.0.0.1
2017-05-29 21:30:33 0 [DEBUG] FTP Port: 21
2017-05-29 21:30:33 0 [DEBUG] FTP Root Folder: /images/
2017-05-29 21:30:33 0 [DEBUG] FTP Filename: all_images.csv
2017-05-29 21:30:33 0 [DEBUG] Username:
2017-05-29 21:30:33 0 [DEBUG] Host:
2017-05-29 21:30:33 0 [DEBUG] Port:
2017-05-29 21:30:33 0 [DEBUG] Database name:
2017-05-29 21:30:33 0 [DEBUG] Database table:
2017-05-29 21:30:33 0 [DEBUG] Autodetect delimiters: Yes
2017-05-29 21:30:33 0 [DEBUG] Field Delimiter: comma
2017-05-29 21:30:33 0 [DEBUG] Text Enclosure:
2017-05-29 21:30:33 0 [DEBUG] Use file extension:
2017-05-29 21:30:33 0 [DEBUG] I'm Mac: No
2017-05-29 21:30:33 0 [DEBUG] Use file for configuration: Yes
2017-05-29 21:30:33 0 [DEBUG] Add extra fields: No
2017-05-29 21:30:33 0 [DEBUG] Skip first line: No
2017-05-29 21:30:33 0 [DEBUG] Overwrite existing data: Yes
2017-05-29 21:30:33 0 [DEBUG] Record name:
2017-05-29 21:30:33 0 [DEBUG] Location product files:
2017-05-29 21:30:33 0 [DEBUG] Delete image relations: No
2017-05-29 21:30:33 0 [DEBUG] Create image name: No
2017-05-29 21:30:33 0 [DEBUG] Image name based on: product_sku
2017-05-29 21:30:33 0 [DEBUG] Image name format: jpg
2017-05-29 21:30:33 0 [DEBUG] Change case: none
2017-05-29 21:30:33 0 [DEBUG] Fill media fields: No
2017-05-29 21:30:33 0 [DEBUG] Update media link only: No
2017-05-29 21:30:33 0 [DEBUG] Process images: Yes
2017-05-29 21:30:33 0 [DEBUG] Keep original file: No
2017-05-29 21:30:33 0 [DEBUG] Convert image type: none
2017-05-29 21:30:33 0 [DEBUG] Save images on server: No
2017-05-29 21:30:33 0 [DEBUG] Re-download image: Yes
2017-05-29 21:30:33 0 [DEBUG] Resize large image: No
2017-05-29 21:30:33 0 [DEBUG] Full image width:
2017-05-29 21:30:33 0 [DEBUG] Full image height:
2017-05-29 21:30:33 0 [DEBUG] Check filetype: No
2017-05-29 21:30:33 0 [DEBUG] Automatic thumbnail creation: No
2017-05-29 21:30:33 0 [DEBUG] Thumbnail type: none
2017-05-29 21:30:33 0 [DEBUG] Thumbnail width: 90
2017-05-29 21:30:33 0 [DEBUG] Thumbnail height: 90
2017-05-29 21:30:33 0 [DEBUG] Maximum width resize: 1024
2017-05-29 21:30:33 0 [DEBUG] Maximum height resize: 768
2017-05-29 21:30:33 0 [DEBUG] Watermark: No
2017-05-29 21:30:33 0 [DEBUG] Right margin:
2017-05-29 21:30:33 0 [DEBUG] Bottom margin:
2017-05-29 21:30:33 0 [DEBUG] Image:
2017-05-29 21:30:33 0 [DEBUG] Lines per import: 1000
2017-05-29 21:30:33 0 [DEBUG] Time between imports: 5
2017-05-29 21:30:33 0 [DEBUG] Override system limits?: No
2017-05-29 21:30:33 0 [DEBUG] Maximum execution time:
2017-05-29 21:30:33 0 [DEBUG] Maximum amount of memory:
2017-05-29 21:30:33 0 [DEBUG] Maximum size of POST data in megabytes:
2017-05-29 21:30:33 0 [DEBUG] Maximum allowed size for uploaded files in megabytes:
2017-05-29 21:30:33 0 [DEBUG] Template ID: 4
2017-05-29 21:30:33 0 [DEBUG] Tags:
2017-05-29 21:30:33 0 [DEBUG] ==========
2017-05-29 21:30:33 1 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 1 [DEBUG] Process line 1
2017-05-29 21:30:33 1 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 1 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11-REV2'
2017-05-29 21:30:33 1 [DEBUG] Processing item: ACO-AC-A11-REV2
2017-05-29 21:30:33 1 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11-REV2'
2017-05-29 21:30:33 2 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 2 [DEBUG] Process line 2
2017-05-29 21:30:33 2 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 2 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11GT-REV2'
2017-05-29 21:30:33 2 [DEBUG] Processing item: ACO-AC-A11GT-REV2
2017-05-29 21:30:33 2 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11GT-REV2'
2017-05-29 21:30:33 3 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 3 [DEBUG] Process line 3
2017-05-29 21:30:33 3 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 3 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11PRO-REV2'
2017-05-29 21:30:33 3 [DEBUG] Processing item: ACO-AC-A11PRO-REV2
2017-05-29 21:30:33 3 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A11PRO-REV2'
2017-05-29 21:30:33 4 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 4 [DEBUG] Process line 4
2017-05-29 21:30:33 4 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 4 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A20-PLUS-CO'
2017-05-29 21:30:33 4 [DEBUG] Processing item: ACO-AC-A20-PLUS-CO
2017-05-29 21:30:33 4 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A20-PLUS-CO'
2017-05-29 21:30:33 5 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 5 [DEBUG] Process line 5
2017-05-29 21:30:33 5 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 5 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A64GT'
2017-05-29 21:30:33 5 [DEBUG] Processing item: ACO-AC-A64GT
2017-05-29 21:30:33 5 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A64GT'
2017-05-29 21:30:33 6 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 6 [DEBUG] Process line 6
2017-05-29 21:30:33 6 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 6 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A64PRO2'
2017-05-29 21:30:33 6 [DEBUG] Processing item: ACO-AC-A64PRO2
2017-05-29 21:30:33 6 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-A64PRO2'
2017-05-29 21:30:33 7 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 7 [DEBUG] Process line 7
2017-05-29 21:30:33 7 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 7 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-ACCELERO-TT3'
2017-05-29 21:30:33 7 [DEBUG] Processing item: ACO-AC-ACCELERO-TT3
2017-05-29 21:30:33 7 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-ACCELERO-TT3'
2017-05-29 21:30:33 8 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 8 [DEBUG] Process line 8
2017-05-29 21:30:33 8 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 8 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-AF9PRPWM'
2017-05-29 21:30:33 8 [DEBUG] Processing item: ACO-AC-AF9PRPWM
2017-05-29 21:30:33 8 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-AF9PRPWM'
2017-05-29 21:30:33 9 [DEBUG] Use field value for field product_sku
2017-05-29 21:30:33 9 [DEBUG] Process line 9
2017-05-29 21:30:33 9 [DEBUG] Found updated based on field product_sku
2017-05-29 21:30:33 9 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-ARF12'
2017-05-29 21:30:33 9 [DEBUG] Processing item: ACO-AC-ARF12
2017-05-29 21:30:33 9 [QUERY] SELECT `virtuemart_product_id` FROM `jos_virtuemart_products` WHERE `product_sku` = 'ACO-AC-ARF12'
  1. more than a month ago
  2. RO CSVI
  3. # 23
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

If you get some errors, it is usually easier to import 5 products and check what is going on. The reason the log file is that big is because your import file is big as well. With a few products it is a lot easier to see what is happening.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 24
pmcsolutions
pmcsolutions
Accepted Answer Pending Moderation
Im starting to get somewhere now and thank you for the link to the guide.

I have ran an import now but it has given me some errors around a few fields im trying to import.

product image 1, 2 and 3 and i cannot find which field I should be using.

the log file is over 80 MB so im going to have a sift through it to see if i can see any alarm bells and post an update with them.
  1. more than a month ago
  2. RO CSVI
  3. # 25
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

The error message you see tells me you are trying to do a CSVI Custom table import but you have not selected in your template which table you want to import into. However the other screenshots indicate that you want to do a product import.

Did you create a template as explained in the documentation VirtueMart Product import? We have animations showing what needs to be done. I think that might be a good place to start.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 26
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
I have a product feed which gets updated on a regular basis, I have attached the sample file i receive but seem to be having issues trying to run the import.

image

Can anyone help point me in the right direction?

Can you post your debug log to check? To know on how to get the debug log, please check the blue box on top of this page.

I seem to be getting this error when running the import.

The second error you have posted shows that there is no database table loaded. If you can post the debug log, i should be able to help you with both errors you have posted.
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 27
pmcsolutions
pmcsolutions
Accepted Answer Pending Moderation
I seem to be getting this error when running the import.

[img size=500 ]https://image.prntscr.com/image/75aabec71be74d9eaff31a10baa8429f.png[/img]

The analyzer shows me the following though
[img size=500 ]https://image.prntscr.com/image/d3ad1943b1ff4f3f95b7a9c71e404d30.png[/img]
[img size=500 ]https://image.prntscr.com/image/3874bbc193c64ac7b73e1d7a6ecaa66e.png[/img]

still lost as to what to do.
  1. more than a month ago
  2. RO CSVI
  3. # 28
  • Page :
  • 1
  • 2


There are no replies made for this post yet.
Be one of the first to reply to this post!