Charts does'nt work after update

[Mrc]

Here's todays file.

[mcrossley]

Can you enable the debug option in the upload.php for me please?
Line 24:
$debug = true;

Do not restart Cumulus MX.

Then after the next half hour upload has failed, post the latest MXdiags file again.

Something very odd going on here.

[jank]

I habe probably the same problem, but in my case NOAA Report is being created and also uploaded, but since 15th of January the report has no data, starting with the 16th of January.
Log (with some erros near the noaa creation is here)

Code: Select all

2024-01-18 00:00:01.085 Creating NOAA monthly report for Mittwoch, 17. Januar 2024
2024-01-18 00:00:01.111 Creating NOAA monthly report
2024-01-18 00:00:25.724 Error at line 20446, column 1, value '02:02' of data/Jan24log.txt : System.FormatException: Input string was not in a correct format.
  at System.Number.ThrowOverflowOrFormatException (System.Boolean overflow, System.String overflowResourceKey) [0x0001a] in <d636f104d58046fd9b195699bcb1a744>:0
  at System.Number.ParseInt32 (System.ReadOnlySpan`1[T] value, System.Globalization.NumberStyles styles, System.Globalization.NumberFormatInfo info) [0x00016] in <d636f104d58046fd9b195699bcb1a744>:0
  at System.Int32.Parse (System.String s, System.IFormatProvider provider) [0x00017] in <d636f104d58046fd9b195699bcb1a744>:0
  at System.Convert.ToInt32 (System.String value) [0x0000b] in <d636f104d58046fd9b195699bcb1a744>:0
  at CumulusMX.Utils.ddmmyyhhmmStrToDate (System.String d, System.String t) [0x00045] in <2254c0dcfbb14b4e97c3995e92c4164b>:0
  at CumulusMX.NOAA.CreateMonthlyReport (System.DateTime thedate) [0x0088f] in <2254c0dcfbb14b4e97c3995e92c4164b>:0
2024-01-18 00:00:25.735 Please edit the file to correct the error
2024-01-18 00:00:25.775 Saving monthly NOAA report as Reports/NOAAMO0124.txt
2024-01-18 00:00:25.779 Creating NOAA yearly report
2024-01-18 00:00:25.788 Creating NOAA yearly report
2024-01-18 00:00:32.731 Saving yearly NOAA report as Reports/NOAAYR2024.txt
2024-01-18 00:00:32.733 NOAA reports will be uploaded at next web update
2024-01-18 00:00:34.439 If required the daily graph data files will be uploaded at next web update
2024-01-18 00:00:34.450 === Day reset complete

So maybe is is really caused by the malformed information in line: 20446
I have this binary code in the MMMYY.log.txt file from time to time and I have no Idea, what caused this problem.
The log snipped looks like this:

Code: Select all

16.01.24;00:47;0,2;80;-2,8;2;10;171;0,0;0,0;1019,3;63,6;13,7;47;7;0,2;0,2;0,0;0;0,00;0,07;-2,5;0;0,0;360;0,0;0,0;0,2;0,2
16.01.24;00:48;0,2;80;-2,8;2;10;190;0,0;0,0;1019,2;63,6;13,7;47;7;0,2;0,2;0,0;0;0,00;0,07;-2,5;0;0,0;180;0,0;0,0;0,2;0,2
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@>
16.01.24;02:04;0,2;80;-2,8;0;7;252;0,0;0,0;1019,4;63,6;13,7;47;1;0,2;0,2;0,0;0;0,00;0,07;-2,2;0;0,0;270;0,0;0,0;0,2;0,2

Unfortunately I have no idea how I can prevent this binary conrtent, what caused this code in my files and how I can remove this binary content automatically with some bash commands. (grep etc does not work)
Aynway, since 16th of January, when I updated to version Cumulus MX v.3.28.1 build 3278 no further content in the noaa files

[packman2008]

That looks like a bunch of nulls inserted into the file. There looks to have been an outage at the time too with records 00:47, 00:48 then 02:04. Sometimes files get extra junk added onto the end of them to fill up to a 512/1024 byte boundary when they're closed unexpectedly. Ideally they should be removed from the end of the file before it's next used.

I don't know if you run on Windows or Linux, but if it's Linux there are a number of ways of removing nulls included here - https://stackoverflow.com/questions/239 ... rs-in-unix

Try them on a copy of the file first!

[jank]

Ahhm wunderful....I will try this command next time I see this in my logfile
tr < file-with-nulls -d '\000' > file-without-nulls

Maybe this lines in the logfile prevent the noaa report being created.....I will check this.
Thanks so far, I will post the result as soon I tested it

Update: The missing NOAA Report lines in the NOAA Report suddenly appeared after using the NOAA Re-Create function in CumulusMX.
so the only thing whats left is, is solving the problem that binary code was written into the logfiles.

Update2:
tr < Dez23log.txt -d '\000' > Dez23log_new.txt

Code: Select all

root@CumulusMX:/tmp# less Dez23log.txt

07.12.23;03:10;0,5;99;0,4;0;1;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,5;0,5;0,0;0;0,00;0,00;-1,4;0;0,0;0;0,0;2,1;0,5;0,5
07.12.23;03:11;0,4;99;0,3;0;1;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;2,1;0,4;0,4
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
07.12.23;03:14;0,4;99;0,3;0;0;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:16;0,4;99;0,3;0;0;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4

root@CumulusMX:/tmp# less Dez23log_new.txt

07.12.23;03:11;0,4;99;0,3;0;1;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;2,1;0,4;0,4
07.12.23;03:14;0,4;99;0,3;0;0;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:16;0,4;99;0,3;0;0;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:17;0,4;99;0,3;0;0;0;0,0;2,1;1020,4;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:18;0,4;99;0,3;0;0;0;0,0;2,1;1020,6;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:19;0,4;99;0,3;0;0;0;0,0;2,1;1020,3;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4
07.12.23;03:20;0,4;99;0,3;0;0;0;0,0;2,1;1020,5;9,9;14,5;46;0;0,4;0,4;0,0;0;0,00;0,00;-1,5;0;0,0;0;0,0;0,0;0,4;0,4

As you can see, the command above removed the "bad lines" succsessfully between 07.12.23;03:11 and 07.12.23;03:14

Thank you so much @packman2008

[Mrc]

Can you enable the debug option in the upload.php for me please?
Line 24:
$debug = true;

Do not restart Cumulus MX.

Then after the next half hour upload has failed, post the latest MXdiags file again.

Something very odd going on here.

Here is the file.

[mcrossley]

Do you know what version of PHP your server is running?

[Mrc]

Do you know what version of PHP your server is running?

PHP Version 5.5.38

[mcrossley]

Ah, pretty ancient then. That *may* be the issue, that version was released in July 2016!

I suggest you upgrade your PHP - for lots of good security reasons too.

[Mrc]

Ok i updated it, let's see what happens.
Edit. Now everything seems to be ok Thank you for your help and sorry for the trouble.