Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.0.1 (build 4023) - 16 May 2024

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Scheduled uploads for extra web files

Please DO NOT use this to publish your entire wish. This Forum is for specific suggestions to enhance the usability of Cumulus MX for all users, NOT your personal requirements. Please check this forum and the rejected forum to make sure you are NOT posting a DUPLICATE suggestion. It will be heavily monitored by Admin and Mark Crossley to determine the feasibility and the difficulty of the suggestion. Those Topics that are deemed inadmissible will moved to the rejected Forum. The remaining Topics will be the Accepted list of future developments, and when our voluntary development group adds it to a build, the build number will be added to the Topic title.
Post Reply
broadstairs
Posts: 812
Joined: Thu 14 Aug 2008 7:17 am
Weather Station: Ecowitt GW1003/GW1103/GW2000
Operating System: Linux openSUSE
Location: Broadstairs, Kent, UK
Contact:

Scheduled uploads for extra web files

Post by broadstairs »

As part of my move to being able to use CMX I would like to be able to upload extra web files at certain times rather than the current method which uploads at every FTP interval. Some of my files are not updated more than between 1 and 4 times per day and one or two are quite large so uploading every minute waste bandwidth and adds to the overhead in FTP processing.

Is this a possible addition to CMX either to the existing settings or a new one for these types of file?

Stuart
Currently running CMX V4 4023
User avatar
HansR
Posts: 6058
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: Scheduled uploads for extra web files

Post by HansR »

Is your FTP interval one (1) minute?
Because that is what you say if I read you well.
Hans

https://meteo-wagenborgen.nl
CMX build 4023+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
water01
Posts: 3315
Joined: Sat 13 Aug 2011 9:33 am
Weather Station: Ecowitt HP2551
Operating System: Windows 10 64bit
Location: Burnham-on-Sea
Contact:

Re: Scheduled uploads for extra web files

Post by water01 »

For the ones that need to be uploaded only once you could use the "end of Day" setting in the Extra Web Files settings.

I would agree with Hans uploading every minute for normal files other than realtime files is a bit excessive, I would suggest 10 minutes is more than enough.
David
Image
User avatar
mcrossley
Posts: 12951
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Scheduled uploads for extra web files

Post by mcrossley »

One option is to call a script that performs those uploads, you can then put in that whatever rules you like about intervals.
broadstairs
Posts: 812
Joined: Thu 14 Aug 2008 7:17 am
Weather Station: Ecowitt GW1003/GW1103/GW2000
Operating System: Linux openSUSE
Location: Broadstairs, Kent, UK
Contact:

Re: Scheduled uploads for extra web files

Post by broadstairs »

There are three issues, the first is I need 1 minutes for the CU-tags as it runs my website, second the daily upload is needed to run after midnight or the data is wrong. The third issue is that the command line ftp in Linux is NOT secure so I can't use a script and Filezilla has no command line options.

WD does provide this as an option.

Stuart
Currently running CMX V4 4023
User avatar
mcrossley
Posts: 12951
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Scheduled uploads for extra web files

Post by mcrossley »

Is using lftp not an option?

Just thinking of how you can implement something now.
broadstairs
Posts: 812
Joined: Thu 14 Aug 2008 7:17 am
Weather Station: Ecowitt GW1003/GW1103/GW2000
Operating System: Linux openSUSE
Location: Broadstairs, Kent, UK
Contact:

Re: Scheduled uploads for extra web files

Post by broadstairs »

I obviously missed that lftp supports either SFTP or FTPS protocols. I was about to look into creating a PHP script to see if I could do it that way. Whatever I do use in the end has to be able to be created as a cron job so that I can upload the data when needed. I've been spoilt with WD which allows up to 3 independent FTP sessions to be run at differing timings, a very useful feature :roll:

Stuart
Currently running CMX V4 4023
User avatar
mcrossley
Posts: 12951
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Scheduled uploads for extra web files

Post by mcrossley »

you could have script called every interval and it checks the time and determines if an upload is due - but it's probably easier to set it up in cron. :)
User avatar
mcrossley
Posts: 12951
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Scheduled uploads for extra web files

Post by mcrossley »

Don't forget WD is a paid for app with what was/is(?) a full-time (aiui) developer. It does lots of stuff CMX will probably never do, but it is a complex beast because of that.
broadstairs
Posts: 812
Joined: Thu 14 Aug 2008 7:17 am
Weather Station: Ecowitt GW1003/GW1103/GW2000
Operating System: Linux openSUSE
Location: Broadstairs, Kent, UK
Contact:

Re: Scheduled uploads for extra web files

Post by broadstairs »

mcrossley wrote: Wed 30 Nov 2022 3:14 pm Don't forget WD is a paid for app with what was/is(?) a full-time (aiui) developer. It does lots of stuff CMX will probably never do, but it is a complex beast because of that.
No I realise that Mark, but it was worth asking :roll:

Stuart
Currently running CMX V4 4023
Post Reply