1. imthebige
  2. RO CSVI
  3. Tuesday, 01 November 2016
  4.  Subscribe via email
Hello,

As i mentioned in my earlier messages about cron issue that importing wrong entries in database.

category_path has been processed like Process path: product category/2016-10-25T10:43:26-07:00 which is product_modified date value in my import file.

Added like this way : category

2016-10-27 05:00:05
2016-10-27 05:00:05
2016-10-27 05:00:05
2016-10-27 05:00:05
2016-10-27 05:00:05
2016-10-27 05:00:05
2016-10-27 05:00:05

This is a old issue : https://csvimproved.com/forum?view=topic&catid=44&id=33529

As per Tharuna I emailed him all the details of my website earlier.and according to him :-

both the cron jobs running at same time. i think that would be a cause, why cant both cron run with some time difference? Try it and let me know.

So i send you my cron email timings below and cron url Please check

1) Product Cron job : Run (Once per 15 minutes)

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="testimport" --template_id="51" --file="/home/juicy672/public_html/cron/Tmpfile.csv"

2)Brands Cron job : Run (Once per hour)

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="Final Brand Cron" --template_id="56" --file="/home/juicy672/public_html/cron/1.csv"

See the screenshot : http://prntscr.com/d1jay9

http://prntscr.com/d1jb6d

Thanks & Regards
Accepted Answer Pending Moderation
Hello,

Thanks for the detailed explanation but the debug log is missing of your cron import. Please post those as well.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 1
Accepted Answer Pending Moderation
Hello,

category_path has been processed like Process path: product category/2016-11-03T11:48:37-07:00 which is product_modified date value in my import file.


Added like this way : category

2016-11-03T11:48:37-07:00
2016-11-03T11:39:51-07:00
2016-11-03T10:56:24-07:00
2016-11-03T10:44:24-07:00
2016-11-03T11:48:47-07:00

****This issue is with cron job****

Below is my cron Url's :-

1) Product Cron job : Run (Once per day)

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="testimport" --template_id="51" --file="/home/juicy672/public_html/cron/Tmpfile.csv"

2)Brands Cron job : Run (Once per week)

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="Final Brand Cron" --template_id="56" --file="/home/juicy672/public_html/cron/1.csv"

If the first cron job run only then it will be working fine.But when second cron job run in any of day then this problem occur.
category_path has been processed like Process path: product category/2016-11-03T11:48:37-07:00

I don't know what is going wrong with cron job...:(

See the screenshot : http://prntscr.com/d41kgk
http://prntscr.com/d41mwh
http://prntscr.com/d41n07

I have attached my debug log file also for both products and brands,also attached templates + csv

Please check this and let me know if you need any other thing to check.

Thanks & Regards
Attachments (5)
  1. more than a month ago
  2. RO CSVI
  3. # 2
Accepted Answer Pending Moderation
Hello,

I have merged your new topic with the old one that is still open where I was waiting for you to post the debug log. Now that I have the debug log let's see what we have.

In your 1.csv file you have the following columns (I stopped at PrimaryCategory) and let's match them with the fields in your template:
MerchantID - product_code
MerchantName - brand
Network - skip
NetworkID - network
NetworkNotes - product_name
DualMerchant - couponcode
RelatedMerchants - file_path
ParentMerchantID - enddate
AffiliateURL - getdeal
SkimlinksURL - skip
HomepageURL - skip
Status - skip
Added - category_path
LastUpdated - dealtypes
SelectedStatus - product_delete
RelationshipStatus - product_created
PrimaryCountry - product_modified
ShipsToCountries - product_price
APOFPO - product_msrp
PrimaryCategory - dollaroff

As you can see most of the fields don't really match up with the correct fields. Your category_path field matches the Added field, the Added field contains a date, that is why you see a date as category.

So you will need to update your template to match the fields correctly in your import file.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 3
Accepted Answer Pending Moderation
Hello Rolandd,

Thanks.. I will try it and let you know if it works or not.

Regards
  1. more than a month ago
  2. RO CSVI
  3. # 4
Accepted Answer Pending Moderation
Hello Roland,

1.csv is for brands to import column are correct but mapping is done with products column.how is that possible ?
Both templates and its fields are different.

For products ->Used Tmpfile.csv
For Brands ->Used 1.csv

At cron time for brands it take column of products csv which is weird.Product_code,brand,couponcode etc all these are mapping of products csv column.

MerchantID - product_code
MerchantName - brand
DualMerchant - couponcode
RelatedMerchants - file_path

Apart from all this Though I again created New template for it.

1)I have created new field mapper "Brands" and mapping the fields

See the screenshot : http://prntscr.com/d431e4
http://prntscr.com/d431iu

2)I have added template "Brands" for field mapper - Brands.

3)In Template fields by selecting template = "Brands".I have added 3 fields more which are not in my csv.

4)Now changed the cron url as per new template-

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="Brands" --template_id="59" --file="/home/juicy672/public_html/cron/1.csv"

Please check this screenshot : http://prntscr.com/d440yf

***Problem is that brand is import with product csv but why this happened ? as for both there is different template,csv files.

Please check

Thanks & Regards.
Attachments (4)
  1. more than a month ago
  2. RO CSVI
  3. # 5
Accepted Answer Pending Moderation
Hello,

1.csv is for brands to import column are correct but mapping is done with products column.how is that possible ?
Perhaps naming the files a bit more appropriate will help me understand what is what. A name like 1.csv doesn't mean anything to me but if it is brands.csv it is easier to make a connection.

Let's focus on 1 import first, the brand import because it is confusing me with 2 different imports. I see you have the filename in the cronjob, why not add it to the template itself? That will be easier to change if needed and it will prevent confusion as to know which file is being read. Can you make that change?

Is it correct that the brand import is a category type import?

When you do a category import, the category_path field is required to import a category. The category name alone is not enough. For example you sell shorts and you have the following categories Clothes/Men/Shorts and Clothes/Women/Shorts. When you set the category_name to Shorts, CSVI has no clue which category you mean, the Men or the Women.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 6
Accepted Answer Pending Moderation
Hello,

I have changed the names of my csv files.For Brands now-> Brands.csv and for Products->Products.csv file is used.

According to my need Both csv runs once per day to import as these are updating on my server every day.

And If only one cron job runs then no problem occurs to me so how can i focus on 1 import first..:) ,problem is occured when 2nd cron runs after one.

One cron file runs fine.But manufaturer which is brands update everyday in csv so need to import brands file with cron everyday.
Also products update everyday in products.csv file so need to import products also with cron everyday.

When i run products cron job only then it will work fine no issue there.But when after sometinme if brands cron url run then there is a problem

MerchantID - product_code
MerchantName - brand
Network - skip
NetworkID - network
NetworkNotes - product_name

As you can see MerchantID is with product_code how is it possible because MerchantId column is in brands.csv and mapping this field with skip.product_code is a column is products.csv file.

See the screenshot : http://prntscr.com/d45q6q

Hope now you will understand it..:)

Regarding : Is it correct that the brand import is a category type import?

->I have category_path field to import a brand in template for Brands.

So that they will go as like : manufacturer/Category_name.

See the screenshot : http://prntscr.com/d45qq5
http://prntscr.com/d45wab

If you need anything else.Please let me know.As this is important for me to run both cron url's once in a day.

Thanks & Regards.
  1. more than a month ago
  2. RO CSVI
  3. # 7
Accepted Answer Pending Moderation
Hello,

According to my need Both csv runs once per day to import as these are updating on my server every day.
I understand, that shouldn't be a problem.

problem is occured when 2nd cron runs after one.
Ah ok, I had another idea. I thought that running the same cron job more than once caused the issue you see.

So when the Brands import runs, it uses the Products file, correct?

Does the problem happen when you specify the file in the template and not in the cron command?
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 8
Accepted Answer Pending Moderation
Hello,

Regarding : So when the Brands import runs, it uses the Products file, correct?

->yes now you get it finally.. :)

Regarding : Does the problem happen when you specify the file in the template and not in the cron command?

->No when i import from backend it will import correctly.But in cron command it will not work

Regards
  1. more than a month ago
  2. RO CSVI
  3. # 9
Accepted Answer Pending Moderation
Hello,

Great, I get it :silly:

->No when i import from backend it will import correctly.But in cron command it will not work
That is not what I meant. If you edit your template and go to the Source tab, you can set the Source to Load from server. Put in the path and the name to the file you want to import and save your template. Remove the file from the cron command and see how it goes.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 10
Accepted Answer Pending Moderation
Hello,

Regarding : Put in the path and the name to the file you want to import and save your template.

See the screenshot : http://prntscr.com/d46b7d

Regarding : Remove the file from the cron command and see how it goes.

Dear it goes fine.I have checked it already.No problem with that one.

Regards
  1. more than a month ago
  2. RO CSVI
  3. # 11
Accepted Answer Pending Moderation
Hello,

Have you updated the cron command as well by removing the filename? If yes, does the cron import the correct file?
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 12
Accepted Answer Pending Moderation
Hello,

filename is not in my cron url .Please check below

/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="Brands" --template_id="59" --file="/home/juicy672/public_html/cron/Brands.csv

There is template_id i think
  1. more than a month ago
  2. RO CSVI
  3. # 13
Accepted Answer Pending Moderation
Hello,

Yes, you have a filename in your cron command, that is the --file="/home/juicy672/public_html/cron/Brands.csv part. You're cron command should look like this:
/usr/local/bin/php70 /home/juicy672/public_html/administrator/components/com_csvi/helper/cron.php --key="Brands" --template_id="59"


The filename will come from the template.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 14
Accepted Answer Pending Moderation
Hello,

Ok Understood.. :) ..Fron both cron url ?? products or brands ??
  1. more than a month ago
  2. RO CSVI
  3. # 15
Accepted Answer Pending Moderation
Hello,

Yes, both as you should have the filename for both in the template itself.
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 16
Accepted Answer Pending Moderation
Hello,

Ok i will check this..and let you know what happened..Thanks
  1. more than a month ago
  2. RO CSVI
  3. # 17
Accepted Answer Pending Moderation
Hello Roland,

I am checking it, 2-3 times cron import correct file but the recently again it import wrong file.

See the screenshot : http://prntscr.com/d4htbn

I don't understand sometimes it pick correct one while sometimes wrong one..:(

Can you please check

Thanks
  1. more than a month ago
  2. RO CSVI
  3. # 18
Accepted Answer Pending Moderation
Hello,

Again it works fine for 3 times and for 4th time again import incorrect file.

see the screenshot : http://prntscr.com/d4iaxo
http://prntscr.com/d4ibxa

Why it is not recognize a correct file ? In Template there is different file for both products and brands.
  1. more than a month ago
  2. RO CSVI
  3. # 19
Accepted Answer Pending Moderation
Hello,

Why it is not recognize a correct file ?
Honestly, it makes no sense to me. It almost seems there is some sort of caching going on. What is also weird, it is only the brands import that goes wrong. The product import never takes the brands file.

How have you setup the cron jobs now? Can you post the debug log of a failed brands import?
Kind regards,

RolandD

=========================
If you use our extensions, please post a rating and a review at the Joomla! Extension Directory
  1. more than a month ago
  2. RO CSVI
  3. # 20
  • Page :
  • 1
  • 2


There are no replies made for this post yet.
Be one of the first to reply to this post!