Resolved maintenance/virtuemart/Refresh SEF URLs ->Template settings (my_template)

Hello Viacheslav,

When the update of SEF URLs is running, do you see any progress? The SEF URL process runs with 500 URLs at once, so in your case it should be around 9 calls, which is actually not so much.

Can you check if there are any URLs stored in the csvi_sefurls database table? If you do not know how to check the database, please run a custom table export for this table.

Now progress lasts for more than a minute and causes error 504
the table is filled, the size of it from start to start changes

Operation timed out after 5000 milliseconds with 119536 bytes received

Operation timed out after 5000 milliseconds with 131303 bytes received

Hello Viacheslav,

So we know that the server runs into a timeout because you have the same error but different amount of URLs. You mentioned there are about 4500 URLs but I see in the export file that it needs to run this for 2 languages, so in total we are talking about 9000 URLs. The languages are Russian and English. Do you need both languages? If not you can temporarily unpublish English by going to Extensions -> Language -> Content Languages. That should lessen the load a little bit. The question now is, is that enough to complete the request. Please run the Refresh again and see where it ends.

If that is not enough, you will have to look into running this as a cronjob or from shell access. How to run a cronjob is explained in the Setting up a cronjob document. In your case the arguments would look like

--task="maintenance" --addon="virtuemart" --operation="refreshsefurls"

. Now the cronjob doesn't empty the SEF table at the moment so you would need to do that manually.

Finally, you can also ask your host to increase the timeout, even if it is temporarily so you can read the SEF URLs.

Hello Rolland.


Currently the content language only ru (see scrin), but the table was unloaded again URL with a prefix lang=en
Remove half of the unneeded records from the table en а great idea, but how to do it?

Cache in the table is formed is a fact, because using the cached url I was able to unload into the sitemap 4431 product in 10 seconds. The only worry is that the formation of the cache is accompanied by the error message 504 Gateway Time-out


Now I know that I have published 4431 products and they are all cached, and with the next unloading of the exact number of the product will not be known, accordingly I will doubt whether all the pages were unloaded


I want caching to happen without error, I think if the table will not be unloaded prefixes en and without increasing the goods in two (which is not expected), caching url will not be a headache

I see in the export file a URL for 2 languages, although only one is published. What else can be done to unload only one language?

Hello,
The language en-GB is installed and unpublished? If yes then SEF URLs are generated inspite the language is published or unpublished.

Since you are the only user having difficulty with generating SEF URLs. I suggest you to try an alternative and see if it works for you. In your product export template you can add product_url field as a template fields along with other export fields so to generate SEF URLs for a product. It might take a bit of a time to generate SEF URLs so i suggest you to do the export in batches. To run export in batches, in your export template settings on File tab set From and To records in count of 1000 so you can do 5 batches to export 4431 products. Let me know if it helps.

Hello,

>>The language en-GB is installed and unpublished?
The language en-GB is installed, it can not be unpublished (please see The_language_en-GB_is_installed.jpg).
In content languages, only ru-RU is installed and published (please see In_content_languages_only_ru-RU_is_installed.jpg).

>>To run export in batches, in your export template settings on File tab set From and To records in count of 1000...
I run export From 1 and To 100(hundred) records but the script failed with error 504 (please see 504_Gateway_Time-out.jpg)
280 records were unloaded into the table _csvi_sefurls (please see _csvi_sefurls.csv)

Hello,

The language en-GB is installed, it can not be unpublished (please see The_language_en-GB_is_installed.jpg).
In content languages, only ru-RU is installed and published (please see In_content_languages_only_ru-RU_is_installed.jpg).

You do have en-GB language installed on your site as per The_language_en-GB_is_installed.jpg screenshot and so this language is also included in your SEF URLs.

I run export From 1 and To 100(hundred) records but the script failed with error 504 (please see 504_Gateway_Time-out.jpg)
280 records were unloaded into the table _csvi_sefurls (please see _csvi_sefurls.csv)

What if you try to export 50 or lesser records? You need to contact your hosting provider on this timeout error. They will be able to help you with increasing the server limits.

>>What if you try to export 50 or lesser records?
From 1 to 3 records is exported without error, 50 did not try.
Now I started exporting all records, the script ended in error, but _csvi_sefurls adds about 150-200 entries per minute

>>You need to contact your hosting provider on this timeout error
I have VPS and I can set any time to execute the script, but is this a good solution ??

>>You do have en-GB language installed on your site as per The_language_en-GB_is_installed.jpg screenshot and so this language is also included in your SEF URLs.
But when exporting a template, only ru_RU SEF URLs added in _csvi_sefurls table

make sure that only ru_RU is added via maintenance / virtuemart / Refresh SEF URLs because only ru_RU is set for the site content - and that's all I will be happy )

Hello,

From 1 to 3 records is exported without error, 50 did not try.
Now I started exporting all records, the script ended in error, but _csvi_sefurls adds about 150-200 entries per minute

I just wanted you to try lesser records to check where your server hits the limit on export. All records is not going to work when you are getting error for exporting 100 records.

I have VPS and I can set any time to execute the script, but is this a good solution ??

You cannot set any time and that is not a good solution. Check the time set for max_execution_time, try increasing it by 30 seconds and see how it goes.

But when exporting a template, only ru_RU SEF URLs added in _csvi_sefurls table

Yes and that is because ru_RU is set as Language in your export template on Options tab. By running Refresh SEF URLs in Maintenance page, we are inserting SEF URLs of all installed language into _csvi_sefurls table and so later in export, SEF URLs of language set in export template will be used. Hope it is clear.

before max_execution_time = 30 s
now max_execution_time = 60 s
export 1 to 50 for 40 seconds without error
export 1 to 99 error

Hello,
Try setting max_execution_time to 300s and check the export.

now max_execution_time = 300s
export 1 to 99 for 60 seconds without error
export 1 to 500 error after 60s - probably 60 seconds per script is the maximum possible.
What to do?

Hello,

export 1 to 500 error after 60s - probably 60 seconds per script is the maximum possible.

You can contact your hosting provider and ask for increasing the limits. Another way is that you can try setting as a cron job for export. See if it finishes then.

It works, thanks