Categories
View Replies (8)

Resolved Custom Table Import: No supported fields have been found in the import file

  1. stratacorps
    stratacorps
  2. RO CSVI
  3. Thursday, 16 May 2019
  4.  Subscribe via email
Okay, I've been really lazy about reporting this as I kept thinking I was doing something wrong. But after we update CSVI and to an Update Available Fields, our template fields are gone.

We have two custom import templates. These CSV files have 60+ columns. Every time we update CSVI we have to go back into the system and re-map each of the fields. This takes too much time to be of use...my hope was to pass the process of updating the site's membership records to either an automated task, or to staff, but this won't do for them what we need until I can figure out what I am doing wrong.

The process is that we have a working template. Fields are mapped, etc. and the import works fine. Until we update CSVI.

After the CSVI update we get an error saying that no fields in the CSV file match, and that we need to update our fields.

We update available fields, it does its thing, then when we go back to run the import, we get:

No supported fields have been found in the import file

We then have to go back into the template and re-map every field. With three main files, the smallest is 60 columns, it takes me hours to get this set back up again. It would be nice if the field mapping would find Field names and match them automatically--or even if it would keep things in order, but its not even alphabetic.

So what am I doing wrong? Is this not really made for custom tables? (Edit: just an FYI, our field names in the table are the same as the field names in the CSV file, which are also the same as defined in the template. Is the "Your Fields" column is still intact (but not sorted in any order) and the "CSVI Fields" that get cleared out every update).
0
Responses (8)
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

But after we update CSVI and to an Update Available Fields, our template fields are gone.
That definitely should not happen. Especially weird because the field names are stored with their exact names and not with any kind of reference. The only reference is the template ID.

This works the same way with making a backup and restoring a template. In your case, I assume you never made a backup of your template, if you have, you should be able to restore that.

With three main files, the smallest is 60 columns, it takes me hours to get this set back up again.
I feel the pain and want assure you this is not how it is supposed to work.

Is the "Your Fields" column is still intact (but not sorted in any order) and the "CSVI Fields" that get cleared out every update).
The Your Fields is only used for XML files and not for CSV files.

Could you make a backup of your template and post it here? I want to check it and see what happens with the fields. If you have CSVI 7.12.0 installed, you can click the Backup button at the top of the template list, otherwise you will need to go to Maintenance -> CSVI Pro -> Backup Templates.

Please allow us some time to investigate this, I believe you have given enough information to replay the scenario.

Thanks.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
tharuna
tharuna
Accepted Answer Pending Moderation
Hello,
We were able to reproduce this issue and have found that issue happens when the CSVI tasks are reloaded. Task reloading also happens on update of CSVI. The issue is fixed with the attached patch file. You can load the patch file and test by going to CSVI Tasks page and click on Reset button. You can also test your CSVI update.

Make sure that you take a backup of your templates as Roland mentioned in his reply. Let us know how it goes.
Attachments (1)
patch_csvi_2019_05_17.zip
Kind regards,

Tharuna

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 2
stratacorps
stratacorps
Accepted Answer Pending Moderation
Sorry, I didn't get an update on the thread and just happened to come in today to check on it.

I applied the patch. I went to a backup to recover my templates. I had a backup of them, but I've never been able to get the backup to work. That is, when I restore my template from the xml file, the fields in the CSV mapping aren't restored. I'm attaching a copy of the three templates here.

Note, I applied the patch, then restored my templates. I get the same message "No supported fields have been found in the import file"

Anyway, I did restore and tried to move past the warning that no fields are mapped, hoping that since my table and the source csv file headers are the same it would just import...but instead I got:
[20-May-2019 17:04:08 UTC] PHP Recoverable fatal error:  Object of class stdClass could not be converted to string in /xxx/public_html/administrator/components/com_csvi/helper/csvi.php on line 463
Attachments (1)
csvi_templates_localhost_20190520.xml
  1. more than a month ago
  2. RO CSVI
  3. # 3
stratacorps
stratacorps
Accepted Answer Pending Moderation
From a backup/localhost here is what I did to reproduce things:

1. Existing 7.11.0 installation, with CSV templates for custom table import.
2. Under Maintenance - Available Fields, I filter for IMport/CSVI Pro/Custom tables and it shows 128 fields...
screen_2019-05-20_12-14-39_PM.png
screen_2019-05-20_12-14-54_PM.png
3. Installed patch from this thread (verified I still have the above 128 fields)
4. Installed 7.12.0 update.
5. Now available fields are gone.
screen_2019-05-20_12-16-47_PM.png
6. Perform Update (from available fields page)...still no matching fields for custom tables
7. Restored templates from XML backup (provided above)...still no available fields
There are no errors in my PHP log or apache, etc.
Attachments (3)
screen_2019-05-20_12-14-39_PM.png screen_2019-05-20_12-14-39_PM.png
screen_2019-05-20_12-14-54_PM.png screen_2019-05-20_12-14-54_PM.png
screen_2019-05-20_12-16-47_PM.png screen_2019-05-20_12-16-47_PM.png
  1. more than a month ago
  2. RO CSVI
  3. # 4
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

Sorry, I didn't get an update on the thread and just happened to come in today to check on it.
We do send out a notification mail unless you have unsubscribed yourself.

I think I see where things are going wrong. As Tharuna wrote you need to go to the Tasks page and click on Reset. That step you don't mention in your report. Without making any further changes, assuming the patch is in place, can you click the Reset button on the Tasks page?

After that the fields should be back.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 5
stratacorps
stratacorps
Accepted Answer Pending Moderation
Okay, I forgot to mention that part. I got distracted. I was trying to build a log of what happened. When I originally hit reset under Tasks, I got an error "Unknown column 'Array' in 'where clause':

Nothing in the logs (php errors, etc.). If I delete my templates this error while resetting goes away, but then I re-import the templates and the same result.

So I tried to re-initialize the entire installation, removing all tables, un-installed csvi, etc. and tried again.

(steps: removed CSVI tables under maintenance, then uninstalled csvi, re-installed 7.12 and applied the patch)

After my templates are restored, the Tasks/Reset causes the Unknown column 'Array'... message to appear.
  1. more than a month ago
  2. RO CSVI
  3. # 6
rolandd
rolandd
Accepted Answer Pending Moderation
Hello,

Thank you for the feedback, that was helpful. Attached is a new patch file. If you could apply that and do the following:

  1. Apply patch

  2. Restore your templates

  3. Check if your fields are assigned to your template. They should be there

  4. Go to Tasks

  5. Click on Reset

  6. Check if your fields are assigned to your template. They should be there



This seems a bit weird but we are actually testing 2 scenarios here. The first one is that all your fields are back as soon as you restore your templates. No further steps should be needed here. The second scenario is for when you update CSVI, the fields should also be there after the update.

Let me know how it goes.
Attachments (1)
patch_custom_table_20190521.zip
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 7
stratacorps
stratacorps
Accepted Answer Pending Moderation
Worked like a charm! Both scenarios, before and after. Also went back to test system, went through upgrade process with patches and everything worked there as well!

Thank you1!
  1. more than a month ago
  2. RO CSVI
  3. # 8
  • Page :
  • 1


There are no replies made for this post yet.
Be one of the first to reply to this post!