Resolved Product export Internal Server Error

Hello Dennis,

Seems like we are getting closer to identify what is going wrong with the site. So, you said the issue occurs even when the count is set to 10. Can you check if there is anything in the database table called csvi_sefurls?

The number 500 or 10 indicates how many URLs are posted to the server to translate into a SEF URL. The smaller the number the more requests are being send. How many products do you have? Perhaps it works if you not decrease but increase the number so less requests are send.

One other thing you may want to run by your hosting provider is to see if the website is allowed to call itself.

Hi Tharuna,

It's http://www.adagio.gr/2017 which is the directory the new site is located.

No, no firewalls yet... I have to finish up with the xml before I proceed to these ;-)

Thanks

Dennis

Hello Dennis,
Whats the hostname set in CSVI settings for your new site? You can check it by going to Dashboard page and click on Options button on right side. See if its set correct. One other thing you can check is if any firewall is enabled on your site. Firewall can block the requests sent to front end to generate SEF URLs.

Hi Tharuna,

It produces the same error even with 10 items... Something must be off... don't know what...

Any other ideas?

Thanks again!

Dennis

Hello,
Yes i understood that and the code change i sent in my previous post should finish creating the Refresh URLs without a timeout error. Can you give it a try?

I meant that it produces a timeout while trying to create the SEF urls...

D

Hello Dennis,
You can try to open the file plugins/csviaddon/virtuemart/com_virtuemart/model/maintenance.php and on line 1576 or around there where it says
if ($count > 500) change the 500 to 50 and then run the Refresh URLs. See if it completes then.

Hi Tharuna,

Great idea but this also produces an Internal Server Error

Any way we can fix this? It produces a time-out error after 600 seconds...

Thanks,

Dennis

Hello Dennis,

After numerous testing I found out that this only happens when I try to export SEF URLs. The new site is located in a folder of the old one. Could this be causing the problem?

I don't think location of the new site is a problem but the problem is with export SEF URLs.

Is this at all any help to you?

Yes, generating SEF URL could be a cause for your 500 error. It is very much possible that you reached timeout by generating the SEF URLs on export as Joomla sends request to front end for each and every SEF URL generated and that really takes time with many products.
So to avoid this issue, there is a option added in CSVI to generate SEF URLs before running the export. In CSVI maintenance menu select VirtueMart in first option and in the second option Refresh URLs and select the template and click continue. This option will generate SEF URLs and add them to a CSVI database table. Now when the export runs SEF URLs will be read from this table which in turn makes export to run faster. Can you try the same and see if your export works?

Hi again.

Here's what I found out...

The Server log (this one is not visible to me but got the response from my provider) registered a timeout.

After numerous testing I found out that this only happens when I try to export SEF URLs. The new site is located in a folder of the old one. Could this be causing the problem?

Is this at all any help to you?

Thanks!

Dennis

Thanks for your prompt respose.

Unfortunately I have already set Joomla to Developer in error reporting but with no luck...

I'll try with the provider and let you know.

Thanks

D

Hello Dennis,

I contacted my provider and they told me that if the problem is originated by a php script, no log will be formed...

That is a bit worrying because fatal errors should always be logged. Second, the Internal Server Error is generated by the webserver and not PHP. Quit disturbing that such errors are not logged in the error_log. The main problem with this is, we can't log anything because as soon as you get the 500 error, the webserver stops all execution.

One thing you could try is to set the error reporting to Developer in the Joomla config. Global configuration -> Server -> Error Reporting and set this to Developer. It may show some more information.

The final way of doing this is to debug the code line by line on your server to see why your server throws the internal server error. This should really be a last resort.

Hi Roland,

I know what you mean.

No, the server error log is accessible in my hosting but the problem is, there is none... I contacted my provider and they told me that if the problem is originated by a php script, no log will be formed...

I tried inserting a few lines in htaccess but I only got back template errors... Do you know of any other way we can produce this error log?

Thanks!

Dennis

Hello Dennis,

The server error log is sometimes available in the control panel provided by the hosting provider but unfortunately most of the time it is only accessible by the hosting provider. Fatal errors are always saved in the server error log rather than any other log, so they are not so easy to come by.

I understand that on the old site it runs all fine but this can't really be compared to the new site because the codebase of both CSVI and Joomla has changed considerably. Once we know the real error, we know where to look for the fix. The fix is most often a trivial one once you know the error it is spitting out.

I know...

Let me look into this a bit more and I'll get back to you.

Thanks for your time!

D

Hello,
Sorry to say but these are warnings which are related to your template. You can see it from the URLs in those warnings. These are not the real error what we are looking for and they have nothing to do with your internal server error.

Hi Tharuna,

I created a logging procedure through htaccess and here's the output:

[05-Oct-2017 14:19:47 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:19:47 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:20:18 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:22:32 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:22:32 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:22:55 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42
[05-Oct-2017 14:23:01 Europe/Berlin] PHP Warning: require_once(/usr/www/users/adagio/2017/libraries/joomla/document/html/renderer/head.php): failed to open stream: No such file or directory in /usr/www/users/adagio/2017/templates/vina_rossi/error.php on line 42

Hello,
Yes this is an error in PHP script, why and what is the error will be written to server logs. If you see them empty then all i can say is your server is not properly configured. CSVI debug logs wont give us any clue on internal server error. Unless we get the error from server error logs we wont be able to help you.

Hi Tharuna,

Server logs are empty since the error is in a php script and not on the server side.

I contacted my host and that's what they told me, I saw them myself... that's why I sent you csvi logs before.

D

Hello Dennis,
I did not ask for CSVI debug log but your server error logs where there will be entries related to internal server error. Can you please post that? If you don't know on how to get server error logs you can talk to your hosting provider.