Resolved RO CSVI cannot be installed

Hello,

So could you release a new version of the extension that will fix the custom fields for the different components like Contact?

Yes we have planned a new release with the fix for Contacts import and it will be out soon.

We used to import contact with custom fields for a Joomla 4 website, it was working fine.

This issue started with RO CSVI 8.11.2 version so any previous version would have worked fine.

Maybe this is a Joomla 5 website so need more adjustments?

You can update to new RO CSVI version when it is out and import should work without any problem.

Thank you. The import is working this time.

So could you release a new version of the extension that will fix the custom fields for the different components like Contact? We used to import contact with custom fields for a Joomla 4 website, it was working fine. Maybe this is a Joomla 5 website so need more adjustments?

Thank you

Hello,
Thank you for the details. FTP worked. I see that you are importing custom fields for contact in import. There is a known issue with contacts custom fields import. I updated code on your site and ran import with 2 records (the file you sent us) and import goes without any error. Can you check now?

Hi RolandD,

Please use FTP instead of SFTP to connect, it should work.

Thank you. Please just use FTP rather than SFTP to connect.

Thank you

Hello,

The SFTP details are working but not. The connection is actively refused. The default port is 22 but perhaps you are using a different port. Can you check the credentials and the port settings to connect?

The debug log number 60 shows that a contact has been imported but does not go to the second record and I guess that is where the 500 error is triggered.

OK log files attached.

Thak you. Here is the error we got if we turn on maximum error reporting. We tried both PHP 8.1 and 8.3, same error is observed.

**An error has occured during the import. Below the information received from the server.**

Status error: 200
Status message: parsererror

Deprecated: strtolower(): Passing null to parameter #1 ($string) of type string is deprecated in
plugins/csviaddon/contact/com_contact/model/import/contact.php on line 127

Thanks again for your help.

Hello,

It will immediately return a 500 Internal Server Error, without any other additional hints or message.

This is the worst error you can get. That is also the reason we have a dedicated page for 500 errors.

The server provider said the server is running fine and we need to consult the software developer.

They are correct but we want to see the server error log to know the real error. One thing you can try if you get an error is to set the Error Reporting to Maximum and see if you get more information on the error.

It said there are 35 rows to import, but we only have 2 rows.

The 35 lines come from the file, I opened the file in a text editor and I see 35 lines of data. These are 2 rows of data but spanning 35 lines of text. That is something we need to see if we can improve. You can always check your file in the Analyzer that is included in RO CSVI.

So I tested your file and imported fine. One thing I did notice is that there are a lot of empty columns in your import file, for example the published column. You can give this a value of 0 as that is the default.

So I did a test run with your file on your site and I still get the 500 error. There are 2 things I want to ask:

1. Please check with your hosting provider for the error log to see what the 500 error is
   
2. Please provide (S)FTP access to the site so we can also check what the 500 error is.
   

Hello,

Thank you for your help. We did re-adjusted the order and make sure the columns all aligned. The preview is correct this time so no column shifting any more. However, we still could get the import done. It will immediately return a 500 Internal Server Error, without any other additional hints or message. The server provider said the server is running fine and we need to consult the software developer.

I have attached a 2-row sample csv file for you to test. You could use the super admin information I provided in the very first post in this thread to try. As you could see here: https://mrkr.io/s/669a9b3ff9928ac1b69f1ee5/0

It said there are 35 rows to import, but we only have 2 rows. Therefore something is wrong. We could import other data like articles and users, just contact has a problem.

We need to get this done now as this issue had been pending for a while. Could you help as soon as possible?

Thank you.

Hello,

And is order of the fields also important? Not just the heading? As the data seems to be in the same columns, but just some columns are shifted, I think we just need to re-order to column to make the order to same?

Yes if you have template fields added and Use file for configuration is set to No in the import template on File tab then the order of template fields should match the order of column headers in import file.

Hi Roland,

I am using Google Sheets to edit the csv file as Microsoft Excel is not a good tool for csv editing. I could import articles, categories and users without any issues. Just not sure what contacts has issues. Maybe due to those custom fields. And is order of the fields also important? Not just the heading? As the data seems to be in the same columns, but just some columns are shifted, I think we just need to re-order to column to make the order to same?

Thank you.

Thank you.

Hello,

Removing the id column did the work!

My guess was good then When you are moving data into an existing system, it isn't really a migration anymore and as such settings must be adjusted to match your situation.

The data is well structured in Google Sheets like all other imported data

Are you importing from Google Sheets or from a CSV file? In case you are using a CSV file, you must use both delimiters. The field delimiter and the text enclosure. This can be as simple as a comma ( , ) as field delimiter and a double quote ( " ) as text enclosure.

You are correct, if data is shifted with CSV files, the delimiters are incorrect. If you are not using the default comma and double quote, it might be good to specify them in the template. If your CSV file has a BOM character, RO CSVI cannot reliabily detect the used delimiters.

What if you import the exported file without going through Google Sheets?

Thank you for your reply. Sorry but I don't understand what I need to do.

I have attached a downloaded file for the desinated website's export migrate template.

What is the best way to do the import?

Hello,

The data is well structured in Google Sheets like all other imported data, but the preview showed that we had a shift for the data. For example in this screenshot: https://mrkr.io/s/669803796d583fee5c1215db/0[b]

Are you using template fields added in template instead of column headers from file for import? This issue is also possible if you have template fields not added in the same order as column headers in import file. Can you check that?

If you want us to check post the template XML file. To get the template XML file from RO CSVI templates list page select the import template and click on Backup templates button. Post the downloaded XML file.

I tried to re-export the contact export migrate template and upload it to Google Sheet to re-enter the data. However we got the same column shifting issue still.

Thank you for your help.

Thank you. Removing the id column did the work!

Now, we need to import the Contacts component. However we got an immediate Server 500 Error without saying what is wrong:


An error has occured during the import. Below the information received from the server.

Status error: 500

Explanation: This error means that something has gone wrong but the server does not want to tell you what exactly happened. The only way to find out is to ask your hosting provider for the error message in the error log. For further information you can check the 500 Internal Server Error document on our site. Without the real error we will not be able to help you.

Status message: error

Upon inspection, we think it could be caused by the delimiliter.

The data is well structured in Google Sheets like all other imported data, but the preview showed that we had a shift for the data. For example in this screenshot: https://mrkr.io/s/669803796d583fee5c1215db/0[b]

We were able to import contacts in the past with a very similar, if it is not the exactly same structure csv file. I have attached a copy of the import sample data with just a few rows. Could you advise what we could do?

Thakn you.

Hello,

So if you import 100 or 1 rows that does not make a difference if there is a conflict, at least you know it happens with 1 record. So what happens is that you are importing a user whose username already exists in your target system with a different user ID. You can use the migration templates if you are importing into a clean system, in that case the IDs will not exist.

If you remove the ID field from your import file and run the import again I think it will run.

Let us know how that goes.

Hello,

No I even tried to upload a record with just one row, and it returned the same error.

The preview before importing is good so the data fields should be OK. My import file is from a Joomla 3's website using the export migrate template, and I am using the import migrate template to import data to a Joomla 5 website.

Thank you.

Hello,
In the import file do you have duplicated usernames for users? If so that is causing the error. Also check if the username you are importing already exists.

Thank you. After deleting the email field, it is working now. However, when I tried to import the users, I got the error:

An error has occured during the import. Below the information received from the server.

Duplicate entry '' for key 'o37n4_users.idx_username'

May I know how to fix it?

Thank you.