Hi, yes to clarify all the files are there, it's just a single file that has 0kb size. The two servers are completely different, one is my own virtual private server running Ubuntu and the other is a hosted Linux package. I'll try the level 2 debug and see if it shows up anything. Thanks!
On Monday, January 2, 2023 at 12:09:18 PM UTC tke...@gmail.com wrote: > I wanted to clarify something you said: > > there is a single HTML file on the remote server with 0kb file size > > > Does that mean it is the only file on the remote server? Or, it's the only > file of 0kb size? > > I would not rule out a server-side problem. Are the two servers hosted by > the same company? Can you check the type of ftp servers they use (the unix > command-line interface "ftp" is useful for this). > > I can't think of any reason why the presence (or absence) of a file on the > server would make any difference as far as weewx is concerned. It is > ignorant of the contents on the server and simply uploads anything that has > changed. > > Try setting debug=2 in weewx.conf. It will create voluminous logging, but > it will also give more detail about what's happening. > > > > On Mon, Jan 2, 2023 at 1:53 AM 'Rory Gillies' via weewx-user < > weewx...@googlegroups.com> wrote: > >> Hi, and Happy New Year. I am experiencing an issue with FTP upload to my >> servers, occasionally (say around once a week) WeeWX fails to upload and >> there is a single HTML file on the remote server with 0kb file size (it's >> not a specific file, however it is usually one of the year or month >> reports, and never been the index.html). Deleting the file restores the >> upload. I have two FTP skins as I am in the process of porting my site to a >> new server, but the 0kb file can happen on either server so it's not >> server-side specific. The syslog section is shown below. The files on the >> local server are all correct, it's during the FTP upload that something >> goes wrong. >> >> Has anyone experienced a similar issue? >> >> Jan 1 23:45:18 weather weewx[469313] INFO weewx.manager: Added record >> 2023-01-01 23:45:00 GMT (1672616700) to database 'weewx.sdb' >> Jan 1 23:45:18 weather weewx[469313] INFO weewx.manager: Added record >> 2023-01-01 23:45:00 GMT (1672616700) to daily summary in 'weewx.sdb' >> Jan 1 23:45:19 weather weewx[469313] INFO weewx.restx: Windy: Published >> record 2023-01-01 23:45:00 GMT (1672616700) >> Jan 1 23:45:19 weather weewx[469313] INFO weewx.restx: PWSWeather: >> Published record 2023-01-01 23:45:00 GMT (1672616700) >> Jan 1 23:45:19 weather weewx[469313] INFO weewx.restx: WOW: Published >> record 2023-01-01 23:45:00 GMT (1672616700) >> Jan 1 23:45:19 weather weewx[469313] INFO weewx.restx: AWEKAS: Published >> record 2023-01-01 23:45:00 GMT (1672616700) >> Jan 1 23:45:20 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 8 files for report SeasonsReport in 1.21 seconds >> Jan 1 23:45:21 weather weewx[469313] INFO weewx.imagegenerator: >> Generated 15 images for report SeasonsReport in 0.59 seconds >> Jan 1 23:45:21 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx/seasons >> Jan 1 23:45:21 weather weewx[469313] INFO user.historygenerator: >> historygenerator.py: Generated 8 tables in 0.08 seconds >> Jan 1 23:45:38 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 13 files for report StandardReport in 17.47 seconds >> Jan 1 23:45:38 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx >> Jan 1 23:45:41 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 2 files for report Emkubed in 2.99 seconds >> Jan 1 23:45:41 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx/emkubed >> Jan 1 23:45:49 weather weewx[469313] INFO weewx.reportengine: >> ftpgenerator: Ftp'd 33 files in 7.85 seconds >> Jan 1 23:45:57 weather weewx[469313] INFO weewx.reportengine: >> ftpgenerator: Ftp'd 33 files in 8.32 seconds >> Jan 1 23:50:17 weather weewx[469313] INFO weewx.manager: Added record >> 2023-01-01 23:50:00 GMT (1672617000) to database 'weewx.sdb' >> Jan 1 23:50:17 weather weewx[469313] INFO weewx.manager: Added record >> 2023-01-01 23:50:00 GMT (1672617000) to daily summary in 'weewx.sdb' >> Jan 1 23:50:17 weather weewx[469313] INFO weewx.restx: Windy: Published >> record 2023-01-01 23:50:00 GMT (1672617000) >> Jan 1 23:50:18 weather weewx[469313] INFO weewx.restx: PWSWeather: >> Published record 2023-01-01 23:50:00 GMT (1672617000) >> Jan 1 23:50:18 weather weewx[469313] INFO weewx.restx: WOW: Published >> record 2023-01-01 23:50:00 GMT (1672617000) >> Jan 1 23:50:18 weather weewx[469313] INFO weewx.restx: AWEKAS: Published >> record 2023-01-01 23:50:00 GMT (1672617000) >> Jan 1 23:50:19 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 8 files for report SeasonsReport in 1.13 seconds >> Jan 1 23:50:19 weather weewx[469313] INFO weewx.imagegenerator: >> Generated 15 images for report SeasonsReport in 0.58 seconds >> Jan 1 23:50:19 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx/seasons >> Jan 1 23:50:19 weather weewx[469313] INFO user.historygenerator: >> historygenerator.py: Generated 8 tables in 0.08 seconds >> Jan 1 23:50:37 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 13 files for report StandardReport in 17.37 seconds >> Jan 1 23:50:37 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx >> Jan 1 23:50:40 weather weewx[469313] INFO weewx.cheetahgenerator: >> Generated 2 files for report Emkubed in 3.00 seconds >> Jan 1 23:50:40 weather weewx[469313] INFO weewx.reportengine: Copied 0 >> files to /var/www/html/weewx/emkubed >> Jan 1 23:51:00 weather weewx[469313] ERROR weeutil.ftpupload: Failed >> uploading /var/www/html/weewx/month-2023-01.html to server >> www.360shetland.co.uk. Reason: 'timed out' >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> ftpgenerator: (0): caught exception '<class 'socket.timeout'>': timed out >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** Traceback (most recent call last): >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weewx/reportengine.py", line 436, in run >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** n = ftp_data.run() >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weeutil/ftpupload.py", line 210, in run >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** ftp_server.storbinary(stor_cmd, fd) >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 502, in storbinary >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** return self.voidresp() >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 257, in voidresp >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.getresp() >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 242, in getresp >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.getmultiline() >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 228, in getmultiline >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.getline() >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 210, in getline >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.file.readline(self.maxline + 1) >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/socket.py", line 704, in readinto >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** return self._sock.recv_into(b) >> Jan 1 23:51:00 weather weewx[469313] ERROR weewx.reportengine: >> **** socket.timeout: timed out >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> ftpgenerator: (1): caught exception '<class 'socket.timeout'>': timed out >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** Traceback (most recent call last): >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weewx/reportengine.py", line 436, in run >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** n = ftp_data.run() >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weeutil/ftpupload.py", line 210, in run >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** ftp_server.storbinary(stor_cmd, fd) >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 491, in storbinary >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** with self.transfercmd(cmd, rest) as conn: >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 386, in transfercmd >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** return self.ntransfercmd(cmd, rest)[0] >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 352, in ntransfercmd >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.sendcmd(cmd) >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 279, in sendcmd >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** return self.getresp() >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 242, in getresp >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.getmultiline() >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 228, in getmultiline >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.getline() >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 210, in getline >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.file.readline(self.maxline + 1) >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/socket.py", line 704, in readinto >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** return self._sock.recv_into(b) >> Jan 1 23:51:21 weather weewx[469313] ERROR weewx.reportengine: >> **** socket.timeout: timed out >> Jan 1 23:51:41 weather weewx[469313] ERROR weeutil.ftpupload: Failed >> uploading /var/www/html/weewx/month-2023-01.html to server >> www.360shetland.co.uk. Reason: 'timed out' >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> ftpgenerator: (2): caught exception '<class 'socket.timeout'>': timed out >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** Traceback (most recent call last): >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weewx/reportengine.py", line 436, in run >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** n = ftp_data.run() >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/share/weewx/weeutil/ftpupload.py", line 210, in run >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** ftp_server.storbinary(stor_cmd, fd) >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 491, in storbinary >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** with self.transfercmd(cmd, rest) as conn: >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 386, in transfercmd >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** return self.ntransfercmd(cmd, rest)[0] >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 352, in ntransfercmd >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.sendcmd(cmd) >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 279, in sendcmd >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** return self.getresp() >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 242, in getresp >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** resp = self.getmultiline() >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 228, in getmultiline >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.getline() >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/ftplib.py", line 210, in getline >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** line = self.file.readline(self.maxline + 1) >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** File "/usr/lib/python3.9/socket.py", line 704, in readinto >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** return self._sock.recv_into(b) >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> **** socket.timeout: timed out >> Jan 1 23:51:41 weather weewx[469313] ERROR weewx.reportengine: >> ftpgenerator: Upload failed >> Jan 1 23:51:50 weather weewx[469313] INFO weewx.reportengine: >> ftpgenerator: Ftp'd 37 files in 8.63 seconds >> >> -- >> You received this message because you are subscribed to the Google Groups >> "weewx-user" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to weewx-user+...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/weewx-user/40222478-2273-4f85-901b-11ef0d138194n%40googlegroups.com >> >> <https://groups.google.com/d/msgid/weewx-user/40222478-2273-4f85-901b-11ef0d138194n%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> > -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to weewx-user+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/70d8ad9e-7820-4773-9e28-d9593851ccaen%40googlegroups.com.