Bugs in 2.3.1

Is Virtual Radar Server not behaving itself? If so then please report it here.
agw
Posts: 2241
Joined: Fri Feb 17, 2012 3:20 am

Re: Bugs in 2.3.1

Post by agw » Wed Jan 06, 2016 11:27 am

There's something about the aircraft picture for 91-0412 that it doesn't like, the exception is being thrown when it tries to read the picture's dimensions from the file.

I'll add something to catch and log exceptions when reading pictures for reports. In the meantime if you email me the picture you've got for that aircraft then I'll take a look and see what caused the exception.

trabin
Posts: 24
Joined: Sun Mar 31, 2013 2:08 pm

Re: Bugs in 2.3.1

Post by trabin » Wed Jan 06, 2016 12:29 pm

I change aircraft picture and now everything is ok ;) Thank you very much for help.

dsfh2992
Posts: 156
Joined: Tue Oct 06, 2015 9:57 pm

Re: Bugs in 2.3.1

Post by dsfh2992 » Thu Jan 07, 2016 4:17 pm

I am seeing a crash about once a day in 2.3.1 (also with 2.3.0). The error is as follows:

http://www.evernote.com/l/ALy0xgM8VFRPK ... fZ7hHYFpg/

--Dan

agw
Posts: 2241
Joined: Fri Feb 17, 2012 3:20 am

Re: Bugs in 2.3.1

Post by agw » Sat Jan 09, 2016 1:27 am

It's probably a queue growing out of control. At the moment the only queues that have any kind of size management on them are the rebroadcast server queues.

If you go to Help | Diagnostics | Queues then it'll show you a list of all of the queues. If one or more are growing and never seem to go down then take a screenshot of the screen, send it to me / post it here and I'll take a look.

TomMuc
Posts: 16
Joined: Sat Sep 26, 2015 8:45 am

Re: Bugs in 2.3.1

Post by TomMuc » Sun Jan 10, 2016 10:48 pm

bluescreen win 7, mlat sorting fails, receiver range fails, etc.

- System

- Provider

[ Name] Microsoft-Windows-WER-SystemErrorReporting
[ Guid] {ABCE23E7-DE45-4366-8631-84FA6C525952}
[ EventSourceName] BugCheck

- EventID 1001

[ Qualifiers] 16384

Version 0

Level 2

Task 0

Opcode 0

Keywords 0x80000000000000

- TimeCreated

[ SystemTime] 2016-01-10T22:17:54.000000000Z

EventRecordID 6612

Correlation

- Execution

[ ProcessID] 0
[ ThreadID] 0

Channel System

Computer WIN-4GMHE8MP3T3

Security


- EventData

param1 0x00000050 (0xfffff960001140b5, 0x0000000000000008, 0xfffff960001140b5, 0x0000000000000007)
param2 C:\Windows\MEMORY.DMP
param3 011016-9999-01




- System

- Provider

[ Name] EventLog

- EventID 6008

[ Qualifiers] 32768

Level 2

Task 0

Keywords 0x80000000000000

- TimeCreated

[ SystemTime] 2016-01-10T22:17:52.000000000Z

EventRecordID 6606

Channel System

Computer WIN-4GMHE8MP3T3

Security


- EventData

23:16:33
‎10.‎01.‎2016


733192


E007010000000A001700100021007100E007010000000A001600100021007100600900003C000000010000006009000000000000B00400000100000000000000


--------------------------------------------------------------------------------

Binäre Daten:


In Wörtern

0000: 000107E0 000A0000 00100017 00710021
0008: 000107E0 000A0000 00100016 00710021
0010: 00000960 0000003C 00000001 00000960
0018: 00000000 000004B0 00000001 00000000


In Bytes

0000: E0 07 01 00 00 00 0A 00 à.......
0008: 17 00 10 00 21 00 71 00 ....!.q.
0010: E0 07 01 00 00 00 0A 00 à.......
0018: 16 00 10 00 21 00 71 00 ....!.q.
0020: 60 09 00 00 3C 00 00 00 `...<...
0028: 01 00 00 00 60 09 00 00 ....`...
0030: 00 00 00 00 B0 04 00 00 ....°...
0038: 01 00 00 00 00 00 00 00 ........

dsfh2992
Posts: 156
Joined: Tue Oct 06, 2015 9:57 pm

Re: Bugs in 2.3.1

Post by dsfh2992 » Wed Jan 13, 2016 5:43 pm

I am continuing to get crashes, but I am trying to get the queue information for you. Most of the time it is some kind of "out of memory" error, but once the error comes up, I am unable to open the queues screen before VRS crashes completely. I am tracking around 3500 aircraft at a time, typically.

Also, I am noticing that when VRS crashes and I need to restart it, it might take up to 30 minutes for the make/model of all the aircraft to repopulate on the radar screen. Any thoughts as to the cause of that?

My basestation.sqb is 4.5 gig, and I have pre-populated all the US registrations from the FAA DB, but in the "Database Writer Options" I have both "Save online lookups in database" and "Overwrite details on existing aircraft" unchecked. Would checking "save online lookups in database" help? Would it not overwrite my manually imported FAA Stuff?

I realize that this is running VRS at a larger scale than you originally anticipated, but it would be really cool if it could work at this scale.

Thanks,
Dan
adsbexchange.com

dsfh2992
Posts: 156
Joined: Tue Oct 06, 2015 9:57 pm

Re: Bugs in 2.3.1

Post by dsfh2992 » Wed Jan 13, 2016 9:52 pm

Here is the log:

http://www.evernote.com/l/ALwFZT3hLiBNX ... fQbKtENAI/

(I could not attach it in the forum, as apparently the forum does not accept .txt files).

You can see an OutofMemory Event, followed by restarting VRS

Even while the server is running, it frequently logs:

[2016-01-13 21:36:50.623 UTC] [t26] Caught an exception on a slow tick heartbeat event: System.Data.SQLite.SQLiteException: SQL logic error or missing database
too many SQL variables
at System.Data.SQLite.SQLite3.Prepare(SQLiteConnection cnn, String strSql, SQLiteStatement previous, UInt32 timeoutMS, String& strRemain)
at System.Data.SQLite.SQLiteCommand.BuildNextCommand()
at System.Data.SQLite.SQLiteCommand.GetStatement(Int32 index)
at System.Data.SQLite.SQLiteDataReader.NextResult()
at System.Data.SQLite.SQLiteDataReader..ctor(SQLiteCommand cmd, CommandBehavior behave)
at System.Data.SQLite.SQLiteCommand.ExecuteReader(CommandBehavior behavior)
at System.Data.SQLite.SQLiteCommand.ExecuteDbDataReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.<QueryImpl>d__c`1.MoveNext()
at System.Collections.Generic.List`1..ctor(IEnumerable`1 collection)
at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
at VirtualRadar.Database.AircraftOnlineLookupCache.StandaloneAircraftOnlineLookupCache.LoadMany(IEnumerable`1 icaos, IDictionary`2 baseStationAircraft)
at VirtualRadar.Library.AircraftOnlineLookupManager.FetchManyAircraftDetailsFromCache(IEnumerable`1 icaos, IDictionary`2 baseStationAircraft)
at VirtualRadar.Library.AircraftOnlineLookupManager.LookupMany(IEnumerable`1 icaos, IDictionary`2 baseStationAircraft)
at VirtualRadar.Library.AircraftDetailFetcher.DoFetchManyAircraft(IEnumerable`1 fetchedDetails)
at VirtualRadar.Interface.AircraftFetcher`2.FetchAllAircraft(IEnumerable`1 fetchedDetails)
at VirtualRadar.Interface.AircraftFetcher`2.RecheckAll(Boolean forceRefetch)
at VirtualRadar.Interface.AircraftFetcher`2.Heartbeat_SlowTimerTicked(Object sender, EventArgs args)
at lambda_method(ExecutionScope , Object , Object , EventArgs )
at VirtualRadar.Interface.EventHelper.Raise[TEventArgs](Delegate eventHandler, Object sender, Func`1 buildArgsCallback, Action`1 exceptionCallback, Boolean throwEventHelperException)

What does that mean? Anything to worry about?

Thanks,
Dan

agw
Posts: 2241
Joined: Fri Feb 17, 2012 3:20 am

Re: Bugs in 2.3.1

Post by agw » Sat Jan 16, 2016 3:08 pm

TomMuc wrote:bluescreen win 7, mlat sorting fails, receiver range fails, etc.
Windows applications cannot directly cause BSODs, it's typically a driver or faulty hardware that causes them. Assuming that the bugcheck code is 0x00000050 it looks like a driver is trying to read from a location that doesn't exist.

TomMuc
Posts: 16
Joined: Sat Sep 26, 2015 8:45 am

Re: Bugs in 2.3.1

Post by TomMuc » Sat Jan 16, 2016 3:15 pm

agw wrote:
TomMuc wrote:bluescreen win 7, mlat sorting fails, receiver range fails, etc.
Windows applications cannot directly cause BSODs, it's typically a driver or faulty hardware that causes them. Assuming that the bugcheck code is 0x00000050 it looks like a driver is trying to read from a location that doesn't exist.
hmmmm- but this never happened before - and the only change i did was installing vrs 2.3.1. and after that i again downgraded to 2.2.0 and since then anything was fine again. secondly this is a complete clean/fresh win7 install running in vmware - the one and only installed software is vrs ...

agw
Posts: 2241
Joined: Fri Feb 17, 2012 3:20 am

Re: Bugs in 2.3.1

Post by agw » Sat Jan 16, 2016 3:22 pm

dsfh2992 wrote:Even while the server is running, it frequently logs:

[2016-01-13 21:36:50.623 UTC] [t26] Caught an exception on a slow tick heartbeat event: System.Data.SQLite.SQLiteException: SQL logic error or missing database
too many SQL variables
The program tries to read aircraft details in batches, but there is no cap on the size of the batch. It looks like your instance of VRS has so many aircraft to lookup in one go that it's exceeding some limit imposed by SQLite. I should be able to reproduce that and get it fixed in a preview.

I don't think that would cause the OOM exception though. I suspect what may be happening is that messages are coming in faster than VRS can process them. You'll be able to tell if this is the case by opening the queues window and watching for message queues that seem to keep on growing. That was the problem with OOM exceptions in 2.3.0, I had done something to slow message processing down and large feeds were putting messages into the queue faster than VRS could take them out. Version 2.3.1 addressed the slow message processing problem but did not address the problem of messages coming in faster than they can be processed. I'll have a think about that one, but I suspect the only thing that VRS can do in that situation is to start dropping messages at the head of the queue.
I have both "Save online lookups in database" and "Overwrite details on existing aircraft" unchecked. Would checking "save online lookups in database" help? Would it not overwrite my manually imported FAA Stuff?
Yes, it would overwrite your FAA stuff, don't tick those options in the database writer. If you have online lookups enabled and those options disabled then it just means that the online lookups will be stored in a standalone SQLite cache file rather than in your BaseStation.sqb. It will still use the lookups for aircraft that don't have details in BaseStation.sqb.

Locked