Status of log upload

9 posts / 0 new
Last post
ON6GMT
Status of log upload

The 'status of log upload' is stuck on the original deleting RX3DTN' to each new entry!
How to unlock?

I looked the forum, and I have followed this discution : http://www.cqrlog.com/node/1162


After deleting files, and reloading CQRLog, 
the problem is always there...

 

Best regard,

 

Geoffroy, ON6GMT

on5hb
on5hb's picture
Same problem.

Geoffroy,
A lot of us started about this problem, just look arround, you're not the only one.
It's a bug and I hope Peter fixes it soon.
 
 

Greetings, Bas. ON5HB

ok2cqr
ok2cqr's picture
Re: Status of log upload

Hi,
 
deleting any files from database directory is very BAD idea. You can break whole log. There is no need to delete anything.
 
Geoffroy, could you run cqrlog from console with --debug=1 parameter and paste here what happen when you want to upload QSO, please?
 
If you want to qick fix, go to QSO list window, click to menu Online logs, there is HamQTH, HRD Log, ClubLog. Choose the related item and click to Mark all as uploaded. Now export all QSO to ADIF and upload it again to website you are using.
 
As far as I know, I tried to fix the problem with the broken upload in previous version. That is why I'm asking from console output.
 
73 Petr, OK2CQR

ON6GMT
Status of log upload

Hi Petr,

 

After running CQRLog with terminal, i have this response :

<code>geoffroy@geoffroy-desktop:~$ cqrlog --debug=1

**** DEBUG LEVEL 1 ****

Loading libssl: /usr/lib/i386-linux-gnu/libssl.so
Loading libcrypto: /usr/lib/i386-linux-gnu/libcrypto.so
Loading libmysqlclient: /usr/lib/i386-linux-gnu/libmysqlclient.so.18
Loaded 73416 LoTW users
Loaded 83225 eQSL users
Loaded 43229 SCP calls
*
User home directory:    /home/geoffroy/
Program home directory: /home/geoffroy/.config/cqrlog/
Data directory:         /home/geoffroy/.config/cqrlog/database/
Memebers directory:     /usr/share/cqrlog/members/
ZIP code directory:     /usr/share/cqrlog/zipcodes/
Binary dir:             /usr/bin/
Share dir:              /usr/share/cqrlog/
TConnection to MySQL:   5.5
*
140705 22:42:58 [Note] Plugin 'FEDERATED' is disabled.
140705 22:42:58 InnoDB: The InnoDB memory heap is disabled
140705 22:42:58 InnoDB: Mutexes and rw_locks use GCC atomic builtins
140705 22:42:58 InnoDB: Compressed tables use zlib 1.2.3.4
140705 22:42:58 InnoDB: Initializing buffer pool, size = 128.0M
140705 22:42:58 InnoDB: Completed initialization of buffer pool
140705 22:42:58 InnoDB: highest supported file format is Barracuda.
140705 22:42:58  InnoDB: Waiting for the background threads to start
140705 22:42:59 InnoDB: 5.5.37 started; log sequence number 1595675
140705 22:42:59 [Note] Server hostname (bind-address): '0.0.0.0'; port: 64000
140705 22:42:59 [Note]   - '0.0.0.0' resolves to '0.0.0.0';
140705 22:42:59 [Note] Server socket created on IP: '0.0.0.0'.
140705 22:42:59 [Warning] Can't open and lock time zone table: Table 'mysql.time_zone_leap_second' doesn't exist trying to live without them
140705 22:42:59 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_current' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_history' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_history_long' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'setup_consumers' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'setup_instruments' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'setup_timers' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'performance_timers' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'threads' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_summary_by_thread_by_event_name' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_summary_by_instance' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'events_waits_summary_global_by_event_name' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'file_summary_by_event_name' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'file_summary_by_instance' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'mutex_instances' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'rwlock_instances' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'cond_instances' has the wrong structure
140705 22:42:59 [ERROR] Native table 'performance_schema'.'file_instances' has the wrong structure
140705 22:42:59 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.5.37-0ubuntu0.12.04.1'  socket: '/home/geoffroy/.config/cqrlog/database/sock'  port: 64000  (Ubuntu)
select * from tables where table_schema = 'cqrlog_common'

SELECT log_nr,log_name FROM cqrlog_common.log_list order by log_nr

use cqrlog001

use cqrlog001

use cqrlog001

SELECT * FROM cqrlog_config

select * from db_version

select * from cqrlog_common.db_version

SELECT * FROM cqrlog_common.dxcc_ref ORDER BY ADIF

SELECT * FROM cqrlog_common.dxcc_ref ORDER BY ADIF

Settings:
-----------------------------------------------------
RigCtldPath:/usr/bin/rigctld
RigCtldArgs:-m 210 -r /dev/ttyUSB0 -t 4532  -s 9600  --set-conf=data_bits=8,stop_bits=1
RunRigCtld: TRUE
RigDevice:  /dev/ttyUSB0
RigCtldPort:4532
RigCtldHost:localhost
RigPoll:    500
RigSendCWR: FALSE
RigId:      210

Starting RigCtld ...
/usr/bin/rigctld -m 210 -r /dev/ttyUSB0 -t 4532  -s 9600  --set-conf=data_bits=8,stop_bits=1
rigctld started!
Connected to localhost:4532

Settings:
-----------------------------------------------------
RotCtldPath:/usr/bin/rotctld
RotCtldArgs:
RunRotCtld: FALSE
RotDevice: 
RotCtldPort:4533
RotCtldHost:localhost
RotPoll:    500
RotId:      1

rotctld started!
Connected to localhost:4533
select * from view_cqrlog_main_by_qsodate LIMIT 500 OFFSET 0

LoadForm: frmMain
SELECT COUNT(*) FROM cqrlog_main

select count(*) from (select distinct adif from cqrlog_main where adif <> 0 and (adif not in (2,8,19,23,25,26,28,30,39,42,44,55,57,58,59,67,68,81,85,93,101,102,113,115,119,127,128,139,151,154,155,164,178,183,184,186,193,193,194,196,198,200,208,210,218,220,226,228,229,231,243,244,255,258,261,264,267,268,271,307,488,493))) as foo

select count(*) from (select distinct dxcc_id.dxcc_ref from dxcc_id left join cqrlog_main on dxcc_id.adif = cqrlog_main.adif WHERE cqrlog_main.adif<>0 and (dxcc_ref NOT LIKE '%*') AND (qsl_r = 'Q')) as foo

CW init
SELECT * FROM profiles WHERE visible > 0 ORDER BY nr

SELECT * FROM profiles WHERE nr = 1

SELECT * FROM profiles WHERE visible > 0 ORDER BY nr

SELECT * FROM profiles WHERE nr = 1

select locator from profiles where nr = 1

select locator from profiles where nr = 1

1-JO20GN;TS-430S;TS-430S;
select * from view_cqrlog_main_by_qsodate where qsodate >= '2014-06-20' order by qsodate,time_on

LoadForm: frmNewQSO
SELECT id_cqrlog_main FROM cqrlog_main WHERE adif=209 AND band='80M' AND qsl_r='Q' AND mode='SSB' LIMIT 1

select band,mode,qsl_r,lotw_qslr,eqsl_qsl_rcvd from cqrlog_main where adif=209 and (qsl_r = 'Q') group by band,mode,qsl_r,lotw_qslr,eqsl_qsl_rcvd

select band,mode from cqrlog_main where adif=209 group by band,mode

NEnalezeno - P29AS
SELECT * FROM view_cqrlog_main_by_qsodate WHERE idcall = 'ON5HQ' ORDER BY qsodate,time_on

LoadForm: frmNewQSO
SELECT id_cqrlog_main FROM cqrlog_main WHERE adif=209 AND band='80M' AND qsl_r='Q' AND mode='SSB' LIMIT 1

select id_cqrlog_main from cqrlog_main where adif = 209 and mode='SSB' and qsl_s<>''
 and callsign='ON5HQ'
 LIMIT 1

SELECT id_cqrlog_main FROM cqrlog_main WHERE adif=209 AND band='80M' AND qsl_r='Q' AND mode='SSB' LIMIT 1

select * from cqrlog_common.qslmgr where (callsign = 'ON5HQ') and (fromDate <= '2014-07-05') order by fromDate

GetIOTAForDXCC
SELECT iota_nr,pref FROM cqrlog_common.iota_list WHERE dxcc_ref = 'ON' ORDER BY iota_nr

<?xml version="1.0" encoding="iso8859-1" ?>
<QRZDatabase version="1.24" xmlns="http://xmldata.qrz.com">
<Session>
<Key>cb28b65078182af7cd221fd034d51fa2</Key>
<Count>2687</Count>
<SubExp>non-subscriber</SubExp>
<GMTime>Sat Jul  5 20:43:16 2014</GMTime>
<Remark>cpu: 0.021s</Remark>
</Session>
</QRZDatabase>

Tag: <fname>    Value: Jules
Tag: <fname>    Value: Jules
Tag: <name>    Value: Thibaut
c_qsl:
MvToRem:TRUE
Command line: firefox http://www.qrz.com/db/ON5HQ
Note:
insert into cqrlog_main (qsodate,time_on,time_off,callsign,freq,mode,rst_s,rst_r,name,qth,qsl_s,qsl_r,qsl_via,iota,pwr,itu,waz,loc,my_loc,county,award,remarks,adif,idcall,state,qso_dxcc,band,profile,cont,club_nr1,club_nr2,club_nr3,club_nr4,club_nr5) values('2014-07-05','20:43','20:43','ON5HQ',3.716,'SSB','59','59','Jules','Villers-la-Ville','','','FENETRE','','100 W',27,14,'JO20GN','JO20GN','Belgium','','',209,'ON5HQ','',0,'80M',1,'EU','','','','','')

SELECT * FROM profiles WHERE visible > 0 ORDER BY nr

select locator from profiles where nr = 1

select locator from profiles where nr = 1

1-JO20GN;TS-430S;TS-430S;
select * from view_cqrlog_main_by_qsodate where qsodate >= '2014-06-20' order by qsodate,time_on

LoadForm: frmNewQSO
select * from view_cqrlog_main_by_qsodate LIMIT 500 OFFSET 0

select * from view_cqrlog_main_by_qsodate LIMIT 500 OFFSET 0

LoadForm: frmMain
SELECT COUNT(*) FROM cqrlog_main

select count(*) from (select distinct adif from cqrlog_main where adif <> 0 and (adif not in (2,8,19,23,25,26,28,30,39,42,44,55,57,58,59,67,68,81,85,93,101,102,113,115,119,127,128,139,151,154,155,164,178,183,184,186,193,193,194,196,198,200,208,210,218,220,226,228,229,231,243,244,255,258,261,264,267,268,271,307,488,493))) as foo

select count(*) from (select distinct dxcc_id.dxcc_ref from dxcc_id left join cqrlog_main on dxcc_id.adif = cqrlog_main.adif WHERE cqrlog_main.adif<>0 and (dxcc_ref NOT LIKE '%*') AND (qsl_r = 'Q')) as foo

SELECT COUNT(*) FROM cqrlog_main

select count(*) from (select distinct adif from cqrlog_main where adif <> 0 and (adif not in (2,8,19,23,25,26,28,30,39,42,44,55,57,58,59,67,68,81,85,93,101,102,113,115,119,127,128,139,151,154,155,164,178,183,184,186,193,193,194,196,198,200,208,210,218,220,226,228,229,231,243,244,255,258,261,264,267,268,271,307,488,493))) as foo

select count(*) from (select distinct dxcc_id.dxcc_ref from dxcc_id left join cqrlog_main on dxcc_id.adif = cqrlog_main.adif WHERE cqrlog_main.adif<>0 and (dxcc_ref NOT LIKE '%*') AND (qsl_r = 'Q')) as foo

select * from upload_status where logname='HamQTH'

select * from log_changes where id > 104 order by id

SyncUpdate:
SyncMsg   :HamQTH: Deleting original RX3DTN
select * from log_changes where id = 105

data.Text:
u=on6gmt
p=****
prg=CQRLOG
adif=<OLD_QSO_DATE:8>20090428<OLD_TIME_ON:4>1410<OLD_CALL:6>RX3DTN<OLD_BAND:3>20M<OLD_MODE:5>PSK31
cmd=DELETE

Response  :QSO not found in the log!

ResultCode:400
SyncUpdate:
SyncMsg   :HamQTH: Could not delete original QSO data!
</code>

Tnx,

 

Geoffroy.

ok2cqr
ok2cqr's picture
Re: Status of log upload

Hi Geoffroy,
 
SyncUpdate: SyncMsg :HamQTH: Deleting original RX3DTN
select * from log_changes where id = 105 data.Text: u=on6gmt p=**** prg=CQRLOG adif=<OLD_QSO_DATE:8>20090428<OLD_TIME_ON:4>1410<OLD_CALL:6>RX3DTN<OLD_BAND:3>20M<OLD_MODE:5>PSK31 cmd=DELETE Response :QSO not found in the log! ResultCode:400 SyncUpdate: SyncMsg :HamQTH: Could not delete original QSO data!
 
It seems that QSO with RX3DTN doesn't exist in HamQTH database. Do you remember what happened before? The quick fix is: export all data to ADIF file, open QSO list window, click to OnlineLog -> HamQTH -> Mark all QSO as uploaded. Now the ADIF you've exported upload to HamQTH by hand.
 
73 Petr

on5hb
on5hb's picture
No quick fix.

I did try to mark everything as uploaded, it doesn't work.
The bug is in the uploaded-database and not in the main database.
What ever you do, the uploaded database keeps the deleted log and uploads it every single time after you enter a new QSO.
If you want I will mail/upload you my entire database and you can see for yourself, as long as you don't alter/upload my QSO's I have no problem you check and test it.

Greetings, Bas. ON5HB

ok2cqr
ok2cqr's picture
Re: No quick fix.

Bas,
 
if you choose Mark all QSO as uploaded, it will remove all records from the table, where all changes are stored. If you choose Mark all QSO as uploaded for specific online log, it will set last used ID to MAX(ID) and next time, it won't find any new changes and write "All qso already uploaded" message.
 
Please send me your database, I'll look at it. Maybe the problem is caused by deleting file from database directory.
 
73 Petr

on5hb
on5hb's picture
Not really a fix

Yep that works, but all QSO's in between the error and the marking are lost for upload as they are not uploaded.
I don't like to upload an adif every few months, as that works, but the error is in the upload-database that is not in synch with the actual QSO database.
BTW I did mail you my database with the error.

Greetings, Bas. ON5HB

on5hb
on5hb's picture
Peter mailed me.

Hi there,
Petere mailed me that he found the bug after examening my database.
It seems that it is possible to make a out-of-band entry or no entry at all.
This causes the upload to fail, however the que is stuck because the wrong entry stays in there until it has been processed.
Peter told me he will make it impossible to input out-of-band and besure the input is correct so the wrong upload (=rejected) is impossible.
However, his quickfix does work, but doesn't prevent this to happen again until it's fixed.
 
Thanks Peter.
 
 

Greetings, Bas. ON5HB