next »

[nattsurfaren]

My colleague is trying to make a script work on linux with cron.
What the scipt does is scrape 1 SERP and se what position a sertain website is on. Then is send report via mail.
First when running manually without cron the script work fine whithout problem.
The cron executes the script and php mail is sent. But serp scraping fails.
Only sometimes noted on monday and today (wednesday) the script scraped one time each day. It should scrape every hour.
Script is runned by root rights.
When running the same script on my reseller domain account in cpanel the script works fine without any problem.

What could be the problem. Appreciate your help on this.

Sincerely
Natt.

[perkiset]

Good lord Natt, you must think the folks here are magic.

You need to install a whole bunch of debug logging to see what happens. What you need is symptoms aplenty to triage the problem.

[nattsurfaren]

The linux is on a virtual machine.
After some tests we concluded that the machine goes into sleep mode and with a empty run on the cron we make the virtual machine wake up and second call succeeds with the scraping.
We could try to make a sleep of a couple of seconds before calling curl but I don't know if this will help.
I'm not familiar with this sleep procedure how this is working or how to turn it of.

/Natt

[perkiset]

Well done.