QSO's missing from SotaMaps

I was looking back at my log from my activation of GM/ES-006 Ben Avon on 26th August 2022.

The database and sotl.as show 10 QSO’s on 2 m FM. sotamaps/activations also tells me I made 10 QSO’s but only 8 are shown in the table.

Is there a reason for this discrepancy, or is it user error?

2 Likes

Hi Fraser - when I look, I can see 9 entries in the table
image

What I find strange is that (without me doing any sorting of the columns) that last entry is out of sequence regarding time AND the missing entry for 2M0WTN took place at the same time as the “shifted to the bottom of the list” entry:

Was this log loaded in two parts?
If no one comes back with a better explanation, I’d be tempted to delete the log and re-upload or re-enter it.

73 Ed.

3 Likes

The order of data in the database is the order it was entered. If you enter manually you can enter activation QSOs in any order you like. CSV etc. requires ascending time order. When the data is fetched, the data normally comes back in the order it was entered. However, it is not guaranteed to come back in any order. What happens next is the DB web app displays data with specific ordering, i.e. sorted on ascending time so what you see displayed is not the same as the order it came from the DB. It would seem that Sotamaps is not applying any specific ordering other than how it gets it from the DB.

2 Likes

I was using vk port-a-log and it would have time stamped the QSO’s for me. I’ve since deleted the file from my phone.

Strange how there are 10, Ed can see 9 and I can only see 8!

2 Likes

I see 9
image

1 Like

Hi Fraser,
Before you delete your log take a look on Sotl.as but I think you deleted this log !
Always I check both and always Sotl.as win with exact match :wink:
73, Éric
F5JKK

1 Like

Hi Eric, I can still see my log in the database:
https://www.sotadata.org.uk/en/log/activator/show/682342

and on sotl.as

1 Like

Yes SMP for me is not sure

image

1 Like

Hi Fraser,

As noted by @DD5LP and @M0VAZ, I can see in SMP 9 QSOs as well:
Screenshot

Seems like for some reason the ones at 15:52 are either both missing (for you) or only one is returned (SQL DISTINCT?).

73 Stephan

2 Likes

Just seen this thread. OK, looking at the code, I see that, because the SQL code statements on the back-end (i.e. on the SOTA server) for non-S2S and for S2S are SO different (because they access different database tables), I split the query into two, and get each part separately, each properly sorted on datetime, and add them both into an array. At the end of that, I have NOT sorted the final array, leaving each half sorted independently from each other … which is NOT good (and should be fixed, see below) but not necessarily a deal-breaker because there is sorting implemented in the browser-based Javascript code to handle sorting.

However, and unfortunately, the Javascript code will only sort the data returned from the server if there are 10 or more records in the QSOs list data. And in this case, there are, as we can see, only 9 records returned. Why on earth a limit of 10 ?? !!! … well, it’s tied to the table-sorting algorithms and to a (mostly) fixed height of the table which kind of guarantees (but not fully, since we’re dealing with HTML here) that no blank rows would also end up being included in the table sorting. It’s weak, I know, but when one is dealing with tens of thousands of lines of code (at the moment, the SMP has around 90,000 lines of hand-written code, excluding ~20,000 lines of essential internal documentation) it’s sometimes easy to overlook something like this kind of special case.

This is of course, a bug, and not at all a satisfactory situation, but it can be resolved if Andrew @VK3ARR can see his way to adding a few lines to the back-end code to sort the final array of data just before it’s returned to the Javascript calling code. I’ll PM Andrew and, if he so wishes, help him to execute any required changes.

Sorry for this error, but there is a fix,
Rob

3 Likes

One week later, and I have to report that, to the best of my knowledge, this problem is not going to be fixed. I myself have no access to the code on the server, and we must rely on the goodwill of those responsible for maintaining the SMP code to attend to such issues as they arise.

I’ve had good relations with Andrew VK3ARR in the past, with the odd hiccup to enliven our discussions. On this occasion, however, I have to report that I’ve received no reply at all from Andrew, despite my having linked to him directly in my above post, and I’ve also not received a reply to a Reflector PM I wrote him a week ago - not even a “I’m busy, I’ll get back to you” .

I know, of course, that the SMP is soon to be replaced, so Andrew’s not replying can probably be read as “don’t waste my time with asking for a sinking ship to be patched.” Well, I did try…

Well this is a disappointing message to come back to.

For the record, my last three weeks have been either:

  • Handling a customer escalation at work, requiring about 16 hours a day, while still trying to keep on top of my day job. Highlight was a call where the customer was literally shouting at us for about 15 minutes. Fun. My leadership team below me have done a fantastic job at running this and taking load off me, but this was escalated high enough to need me to be visible regularly.
  • Eight days of leadership training for work in US timezone, but at short notice so unable to travel, resulting in having to work and somehow participate coherently from midnight to 5am local time, but having people call me at 10am even though they knew I was asleep because of either point 1 above, or because they ignored the email “vacation” responder, and basically forcing me to work most of the time outside of sleep and meals. Again, my team was fantastic at trying to take the load, but sometimes those outside my team don’t care - they have my number, and they’re going to dial it.
  • Having a weekend shift as duty manager, requiring two 12 hour days, to cover for one of my team whose mother died two weeks ago. Usually MOD shifts are a good time to catch up on things, but of course everyone is trying to get their systems ready to feed the capitalistic beast that is Black Friday, so most of that time was spent doing actual work.
  • Meanwhile, my wife’s great aunt is moving into care, and we’re having to purchase her unit very quickly in order for her to have sufficient funds to do so, so there’s been a lot of bank paperwork and conveyancing and whatnot to get through, and
  • My tennis club (of which, for my sins, I am the humble leader) is having to chase funding that requires a complete rewrite of our constitution in order to be eligible, which has required copious amounts of time at short notice getting that written and then voted in by members before the end of October.

In short, I’ve spent about 15 minutes thinking about SOTA in the past three or four weeks, most of which was “I must get back to that email/fix/update/whatever”. I acknowledge your PM. I will get to it, but it won’t be this week. My work calendar is saying I have 42.8 hours of meetings accepted this week already, but that excludes Friday which I’m off for a friend’s wedding, so you can do the maths - it’s not going to pretty this week either.

I will be discussing the need for additional management coverage underneath me with my boss this Wednesday, but in the meantime, if anyone can tell me what timezone my brain is currently in, it’ll be much appreciated.

5 Likes

Hi Andrew,

I guessed as much - since your having been promoted some while ago at work to [VP/Senior Manager/whatever] I have understood your time for SOTA to be extremely limited. No problems, take your time, and it’s understood that this particular glitch comes very far down the list of things to be attended to.

For my part, I’m relieved that nothing untoward has happened to you, and I’m sure I speak for everybody in this regard.

Thanks for getting back to this thread, it’s much appreciated.

Cheers, Rob

I pushed a fix just now based on code provided by @DM1CM . Testing welcome, but looks like it solves the problem to me.

6 Likes