cutils extra sensors

[HansR]

I think you gave me the screen output and not the logfile (on level info).
Could you do that again? You will find the logs in the utilslog directory.

[Nossie]

log

[HansR]

OK, we're getting somewhere. There seems to be a synchronisation failure between the logging of the data and the frequency of fetching the data. The UserAskedData command (see the crontab entry) is done once per 10 minutes but apparently your logging of the sensors is done on a lower frequency because it cannot find any data from 10:40 onwards.

Code: Select all

2024-01-07 10:52:02.915 Information ExtraSensorslog: timeStart = 01/07/2024 10:46:00; timeEnd = 01/07/2024 10:45:00
2024-01-07 10:52:02.916 Information ExtraSensorslog: Require data/ExtraLog202401.txt to start
2024-01-07 10:52:03.022 DetectSeparators: date: / | Field: , | Decimal .
2024-01-07 10:52:03.167 Information ExtraSensorslog: Finished reading the log at 01/07/2024 10:45:00
2024-01-07 10:52:03.168 Information ExtraSensorslog: MainExtraSensorsValuesList created: 0 records.
2024-01-07 10:52:03.169 Information ExtraSensorslog: End

So far I do not understand why your CMX does not have data between xx:40 and xx:52. But that is the problem as the upload then returns a 500 error / No data:

Code: Select all

2024-01-07 10:52:03.330 Information InetPhp: extrasensorsdata.json: Response code = 500: InternalServerError
2024-01-07 10:52:03.331 Information InetPhp: extrasensorsdata.json: Response text follows:
No valid JSON data in the received data
2024-01-07 10:52:03.333 Information PHP UploadFile: Failed

Now it gets complex. Can you give me:

1. Your CMX log frequency (one, five, ten etc.... minutes)
2. Your Interval frequency (upload every 5, 10 , 15 etc.... minutes
3. it is now 11:25 for you. Can you post the logfile of 11:30 and when that is finished post the cumulusutils.ini as well (the last upload data are in there) adjust your times when you read this later.

[Nossie]

will add the intervals to this post once I find them

[HansR]

will add the intervals to this post once I find them

I saw your PM, the intervals are :

1. CMX Logging interval: Station Settings=>General Settings=>Log interval (in minutes)
2. CMX upload Interval: Internet Settings=>Normal Interval Settings=>Interval time (in munutes)

[Nossie]

I saw your PM, the intervals are :

1. CMX Logging interval: Station Settings=>General Settings=>Log interval (in minutes)
2. CMX upload Interval: Internet Settings=>Normal Interval Settings=>Interval time (in munutes)

1 minute for log interval
15 for interval time.

[HansR]

OK. So before I conitnue searching for clues, you need to check if it is correct that there missing minute data in the jan23log.txt (the main CMX data logfile) because that is what comes out of CUtils: it does not see data after xxh40 while at the whole hour it simply restarts reading. So I am missing the point completely if you log your data every minute.

Have to go now, back in the evening.

[Nossie]

I've changed both to 1 minute and restarted - I'm not too worried about resources.


I'll have a good think about what you have said above - thanks Hans.

[HansR]

I've changed both to 1 minute and restarted - I'm not too worried about resources.

Your interval at 1 minute is far too fast. Set it to 10 or 15 please. That value is correct.
Let's not change too much until we know what is going on....

[Nossie]

both updated to 10 minutes and restarted.

[HansR]

both updated to 10 minutes and restarted.

Not both updated: you can leave the intervals as they were:

1 minute for log interval
15 for interval time.

That is how we must find the error. The error is not in the intervals but must be somewhere else.
Those intervals are fine.

[Nossie]

Hans - you are a slave driver! hahaha

I'll revert them back to what they were and restart.

[HansR]

Hans - you are a slave driver! hahaha

Sorry for that.

I'll revert them back to what they were and restart.

You're a good slave

[HansR]

OK... no change. So, could you post the jan24log.txt.
If there is no explanation in there, we will change some timing parameters.

[HansR]

Hi Ian,

I experimented with the parameters you have, so I set my test environment on minute logging and an Interval of 15 minutes. I also activated the Lightning sensor. Unfortunately I cannot reproduce any of the observations we have on your installation.

So:

1. Because your install tries to create a timeseries for the lightning sensor which can't be with the version you are using;
2. Because your UserAskedData does not function;
3. Because you use version 6.23.1 (see footer bar);

And assuming your CMX installation functions properly (please check your datafile for a correct continuous logging of the data), I conclude that there must be something seriously wrong with your CUtils and/or CMX installation.

I suggest you check your CMX install very carefully. When done that and no serious things spotted, I suggest you remove CUtils installation completely, only keeping the files present in the CumulusMX directory (cumulusutils.ini, CUstringEN.ini)*, and reinstall from a fresh download of the current distribution.

*: you may want to save the CutilsCharts.def, CutilsMenu.def, CUhelptexts.txt and possible menufiles you created. Also make sure that any images you use for the backgrounds and/or header which reside in utils have a backup.

I have no idea what has happened or what causes the errors and I actually am sure it isn't the software.
Looking for the cause takes too much time.

Any other idea's: let me know.
Let me know how you get on.