Support is online

CSVI Pro 6 tempfiles #7562

Open plomp47 opened this topic Monday, 24 August 2015 · 7 replies
Author

Hello,

After a few test runs with templates i made CSVI didn't work anymore.
CSVi Pro was unable to create a map in de Joomla Temp directory.

When i looked on my webserver, the diskspace (2.5gb) was full??
My website is 300mb and the Temp directory was 2.2 gb big.
A map csvi_com was filled with small files, to delete all the files costed a few hours time.

Do you have any idea what caused this problem, so i can prevent it from happening again?

Support

Hello,

Since you didn't mention what kind of small files there were I do not know which files you are talking about. In the folder tmpl/com_csvi/export CSVI will put the export files and remove them once you downloaded them. In the tmp/com_csvi/xxxxxx folders CSVI will store the uploaded file so it can be imported. The xxxxxx folder is a timestamped folder and will be removed once the import is completed.

The log files are stored in the /logs folder.

On the Maintenance page there is an option to empty the temp folder. That can be used to clean it with the click of a button.

Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory

Author

Ok thanks.
I dont know whar kind of files they where. But if it happens again i will ler you know.

I will use the clean option to delete de files.

Author

it happend again...
I try to make a test import, with 2 productprices and it failed. (importfile in attachment)

2 times the run hangend and did not stop, so i cancelde it manualy.
the 3e time it gives an error "Copy file failed".

when i looked at my webspace (2.5 gb) it was full again, i started with 350 mb.

i don't untherstand what goes wrong??
earlier i did succesfull imports, why does this one go wrong?

Cleaning the tempfolder through Maintenance gives also an error "Cannot fput file for log"

please help...

Author
Details
Date 	2015-08-14 17:45:05 UTC
Software 	Joomla Platform 13.1.0 Stable [ Curiosity ] 24-Apr-2013 00:00 GMT
Date 	Time 	Line 	Action 	Comment
Processed 108 lines
2015-08-14 	17:45:05 	0 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	0 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	4 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	4 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	6 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	6 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	8 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	8 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	10 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	10 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	12 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	12 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	14 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	14 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	16 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	16 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	18 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	18 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	20 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	20 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	22 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	22 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	24 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	24 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	26 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	26 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	28 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	28 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:05 	30 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:05 	30 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	32 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	32 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	34 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	34 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	36 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	36 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	38 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	38 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	40 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	40 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	42 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	42 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	44 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	44 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	46 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	46 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	48 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	48 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	50 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	50 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	52 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	52 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	54 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	54 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	56 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	56 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	58 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	58 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	60 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	60 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	62 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	62 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	64 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	64 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	66 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	66 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	68 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	68 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	70 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	70 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	72 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	72 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	74 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	74 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	76 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	76 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	78 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	78 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	80 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	80 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	82 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	82 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	84 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	84 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	86 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	86 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	88 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	88 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	90 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	90 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:06 	92 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:06 	92 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	94 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	94 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	96 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	96 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	98 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	98 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	100 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	100 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	102 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	102 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	104 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	104 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	106 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	106 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
2015-08-14 	17:45:07 	108 	[DEBUG] 	COM_CSVI_CLEAN_OLD_LOGS
2015-08-14 	17:45:07 	108 	[QUERY] 	SELECT csvi_log_id FROM jos_csvi_logs ORDER BY csvi_log_id
Support

Hello,

2 times the run hangend and did not stop, so i cancelde it manualy.

If it hangs before the preview step it may be because of the upload that keeps repeating. What kind of files do you see in the com_csvi folder?

earlier i did succesfull imports, why does this one go wrong?

Let's first see why the file hangs. From what I can tell this file is not UTF-8 encoded, perhaps that is the issue. You can save the file again as UTF-8 and see.

Also take a look at the document Using Firebug to analyze import problems as this may tell you why the import hangs.

Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory

Author

Correct, it hangs on the preview. I tried to download the tempfiles but i can't, its to big.
So i made a screenshot. Every run that fails csvi-pro creates a mapstructure like in the screenshot.

I must delete the temp map otherwise my backend has troubles with some functions.

It must be the UTF-8 encoding that misses, the testfile was saves as an Excel-csv, ik created it myself.
I will try to make an new exportfile and then save it as it is, so i import the same file.

  • temp_example.jpg
Support

Hello,

Thank you for the screenshot, it explains a lot. There is a copy of your site inside the temp folder of CSVI. That should not happen, I will see if I can reproduce the issue or find a fix for that. Thanks for posting the screenshot.

Here is the article Save a CSVI file as UTF-8 in case you need it.

Edit: I have tried to reproduce the issue but I can't get it to do the same, even with your file. I can have a closer look if you send me the FTP/Joomla login details and the file to test with I can check why it happens on your site. You can send it via private message or email.

Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory

Log in to reply to this topic.