Jump to content


[ItemDB] Outlier Detection Being Improved


  • Please log in to reply
7 replies to this topic

#1 ShadowLink64

ShadowLink64

Posted 22 December 2009 - 11:42 PM

Hey all,

As you know, we're continually striving to improve the accuracy of our items database. An issue that has come up recently is some random spikes in the price of an item. Good examples of items that jumped around enough to cause problems were:

Boiled Egg
Visor
and other Tiki Tack items...

Their price would basically multiply many fold due to a couple bad outlier prices being submitted to our database.

With our past outlier detection system, if more than one outlier entered our system, we could easily identify and remove it. However, during additional tests using two outliers in a data set, our outlier detection failed to notice that outliers even appeared in the data. We have now created a secondary system to deal with this.

On another note, the other day, we hit a record of 94 users concurrently submitting data to the database in a one hour period. Good job, automation rocks!

We'll continue to monitor the integrity of our prices and improve the system further if we need to. Thanks everyone for supporting the database thus far. :p
Spoiler

Advertisement

    #2 Icey Defeat

    Icey Defeat
    • Trader Score:9

    Posted 23 December 2009 - 01:00 AM

    So this is what you guys were going on about in irc. That is kind of a funny problem. Glad to see your on top of things :)
    Posted Image
    Thanks Jillian <3

    #3 vendetta.inc

    vendetta.inc
    • Trader Score:3

    Posted 23 December 2009 - 01:12 PM

    First the APer fix, now this. Great work :)

    #4 Andy

    Andy

    Posted 28 January 2010 - 01:12 AM

    TNT broken the outlier detection :(
    By retiring a stamp


    #5 Waser Lave

    Waser Lave

    Posted 28 January 2010 - 04:38 AM

    View PostAndy, on 28 January 2010 - 01:12 AM, said:

    TNT broken the outlier detection :(
    By retiring a stamp

    Don't worry, the price will catch up over the next day or so when it has enough information. :p

    Posted Image


    #6 ShadowLink64

    ShadowLink64

    Posted 07 February 2010 - 12:04 AM

    View PostWaser Lave, on 28 January 2010 - 04:38 AM, said:

    Don't worry, the price will catch up over the next day or so when it has enough information. :p
    Boy did that price shoot the hell up. :p

    Total prices submitted to our database: 15,186,847 and climbing.
    Live data size: 27.6 MiB
    Historical data size: 203.9 MiB
    Good job guys... we have such a great DB and it will only get better this summer. :p
    Spoiler

    #7 Waser Lave

    Waser Lave

    Posted 07 February 2010 - 04:38 AM

    View PostShadowLink64, on 07 February 2010 - 12:04 AM, said:

    Boy did that price shoot the hell up. :p

    Total prices submitted to our database: 15,186,847 and climbing.
    Live data size: 27.6 MiB
    Historical data size: 203.9 MiB
    Good job guys... we have such a great DB and it will only get better this summer. :p

    Not too shabby. :p

    We still do need to fix that bug where buyable prices just won't go unbuyable, they tend to get to around 98-99k and just rot there even if they are actually unbuyable :/ That can be fixed one of two different ways though so we can look at that when you're back from your larking about at uni. :p

    Posted Image


    #8 papersnake

    papersnake

    Posted 12 February 2010 - 05:03 PM

    nice to see hardworkers! :D


    1 user(s) are reading this topic

    0 members, 1 guests, 0 anonymous users