CQRlog imports only 1957 records

5 posts / 0 new
Last post
SP2L
SP2L's picture
CQRlog imports only 1957 records

Greetings.

System Debian 13.6 amd64.

CQRlog imports only 1957 records while in *.adi file there are 33942 records.
No errors reported.

Can not figure out what is going on.

Suggestions and help will be very much appreciated.

Best regards.
Tom - SP2L

oh1kh
CQRlog imports only 1957 records

Hi Tom!
There is probably a small error in one of the qso records.

It might be a UTF8 character in name or qth tag. As UTF8 characters like ÖÄ é etc. have two or more bytes per character the adif tag's length number does not correspond bytes in adif tag string.

Or maybe there is an external character outside of any tag. (it can be unvisible).

Another error might be wrong frequency (out of bands), but I think this should make just an import error, not halt the whole process.

I have cleared out same kind of files by first checking from log what was the last qso properly imported.
Then opened the adif file with text editor and using "find" located the line where the qso is (ends to <EOR>).
Looked at the NEXT qso record if there is something weird and fixed it , or if nothing visible have not been found removed whole qso record and tried again to import.

Usually those files have had several (less than 10) qso records that have halted the adif import.
You just have to manually dig the all error records out and either fix or remove those records.

--
Saku
OH1KH

SP2L
SP2L's picture
CQRlog imports only 1957 records

Hello Saku.

Thank you very much for prompt response.
Yeah, it is real pain in the arse.

People enter weird or national characters
and do not care about the consequences.

Very good example is log downloaded from QRZ.com
where there are many lines like none blank
I do have to remove such alines before importing do CRQlog database.

As it happens now, must something else
that is not very obvious but stopping import procedure.

I will search deeply in hope to find nasty culprit.

Best regards.
Tom - SP2L

Best regards.
Tom - SP2L
https://www.sp2l.eu

SP2L
SP2L's picture
CQRlog imports only 1957 records

Hello Saku.

From the other hand, could be cqrlog modified to accept national characters, please?
This is very often cause of import breaking.

Best regards.
Tom - SP2L
https://www.sp2l.eu

oh1kh
CQRlog imports only 1957 records

Hi Tom!
I am not sure does the official cqrlog have the adif import I once did. It is so long ago.

At least CqrlogImproved suppotrs UTF8 in some tags, but they must be 'intl' ones.
Like <NAME_INTL I know it is against adif standard as intl tags should be used only in adx (xml), not adi files.

How ever I think it is less bad than encourage people to use UTF8 in standard adif tags where only base (7bit) ascii charters should be used by adif.org
Unfortunately programmers do not care about that and pass exports out.

It might be that there is also import check routine that compares tag length agaist true byte count and if there are more bytes than count tries to manage with that as UTF-8
But this is also thing I am not sure about as import routines last touched so long ago.

There is also another reason: Cqrlog uses adif files to backup logs.
You can enter UTF-8 to some columns like name and it is stored ok into log database.
When doing backup from log using adif you have to break standard either using UTF8 in name tag or using name_intl tag that should be used only with adx.
I have choosed the last one.

--
Saku
OH1KH