Pages: [1] 2  All   Go Down

Author Topic: [Today] Tremstats Version 0.5  (Read 42878 times)

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« on: November 24, 2006, 10:24:00 am »
Heyas,

I know, my plans were different, but there were many little nasty bugs in the parser, which couldn't wait 3 more weeks. So this evening (say, 21 UTC), you will get the newest version of Tremstats.

Here's a list of all improvements:

  • Fixed bug #1
     
  • Fixed bug #2
     
  • Fixed bug #3
     
  • Player search moved to top of the page
  • All columns in the output are sortable now
  • Integrated game-time factor for total efficiency


I think with this you'll get really nice stats now, which are also all right. The update from 0.4.* requires an entire re-parsing of the logfiles. Also, the database structure has changed a little, so you have to rebuild it.

If you find any bugs in it, please don't make the mistake to post them in the comments. Better use the Bugtracker for this, you can find it on http://bugzilla.dasprids.de. There you may also state feature request.

The demo of Tremstats 0.5 can be seen on http://tremstats.dasprids.de/

Download it here:
http://dev.dasprids.de/programs/tremstats/download/
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

Lava Croft

  • Guest
[Today] Tremstats Version 0.5
« Reply #1 on: November 24, 2006, 12:32:07 pm »
*Lava Croft huggles DASPRID
Logged

cp blast

  • Posts: 156
  • Turrets: +0/-0
[Today] Tremstats Version 0.5
« Reply #2 on: November 24, 2006, 01:34:40 pm »
Nice work! Nice Nice! lol


But you should exclude all "UnnamedPlayer"s...
Quote
Most Active Player     UnnamedPlayer (Games: 252)


...

But like i said, NICE! :)
Logged
I'm a Mexican who likes eating tacos and nachos. Are you?

rasz_pl

  • Guest
[Today] Tremstats Version 0.5
« Reply #3 on: November 24, 2006, 03:46:27 pm »
thank you, I can farm my stats again! at last it counts everything :)
the only thing to make my a super happy panda now is tremstats on Aliens Wrath :)
Logged

Arch_Enemy

  • Posts: 30
  • Turrets: +0/-0
[Today] Tremstats Version 0.5
« Reply #4 on: November 24, 2006, 03:55:45 pm »
would be cool if u could make the trem stats world- wide for all servers? lol
Logged

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #5 on: November 24, 2006, 04:32:00 pm »
Quote from: "Arch_Enemy"
would be cool if u could make the trem stats world- wide for all servers? lol


I can't.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #6 on: November 24, 2006, 06:02:36 pm »
It's done, get it while it's hot!
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

David

  • Spam Killer
  • *
  • Posts: 3543
  • Turrets: +249/-273
[Today] Tremstats Version 0.5
« Reply #7 on: November 24, 2006, 06:07:11 pm »
Quote from: "DASPRiD"
Quote from: "Arch_Enemy"
would be cool if u could make the trem stats world- wide for all servers? lol


I can't.


but someone else could start a thing, If all the server admins gave them access to the logs....
Logged
Any maps not in the MG repo?  Email me or come to irc.freenode.net/#mg.
--
My words are mine and mine alone.  I can't speak for anyone else, and there is no one who can speak for me.  If I ever make a post that gives the opinions or positions of other users or groups, then they will be clearly labeled as such.
I'm disappointed that people's past actions have forced me to state what should be obvious.
I am not a dev.  Nothing I say counts for anything.

stalefries

  • Posts: 169
  • Turrets: +2/-0
    • http://stalefries.googlepages.com
[Today] Tremstats Version 0.5
« Reply #8 on: November 24, 2006, 06:12:56 pm »
Wow, TremStats got a nice visual overhaul since I last looked at it. Very nice!
Logged
color=green]:[/color]nac:stalefries
My boring website that you hate | GRAAAAGHH!

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #9 on: November 24, 2006, 06:22:11 pm »
Quote from: "David"
Quote from: "DASPRiD"
Quote from: "Arch_Enemy"
would be cool if u could make the trem stats world- wide for all servers? lol


I can't.


but someone else could start a thing, If all the server admins gave them access to the logs....


What admins would never do ;>
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

David

  • Spam Killer
  • *
  • Posts: 3543
  • Turrets: +249/-273
[Today] Tremstats Version 0.5
« Reply #10 on: November 24, 2006, 06:30:14 pm »
Quote from: "DASPRiD"
Quote from: "David"
Quote from: "DASPRiD"
Quote from: "Arch_Enemy"
would be cool if u could make the trem stats world- wide for all servers? lol


I can't.


but someone else could start a thing, If all the server admins gave them access to the logs....


What admins would never do ;>


why? what is there in a log that is so secretive?
all it would need is a daily cron job to upload the script to some server somewhere.
Logged
Any maps not in the MG repo?  Email me or come to irc.freenode.net/#mg.
--
My words are mine and mine alone.  I can't speak for anyone else, and there is no one who can speak for me.  If I ever make a post that gives the opinions or positions of other users or groups, then they will be clearly labeled as such.
I'm disappointed that people's past actions have forced me to state what should be obvious.
I am not a dev.  Nothing I say counts for anything.

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #11 on: November 26, 2006, 11:32:51 pm »
Important note for all server admins:

To get propper results, you have to turn of unbuffered logging. So add the following line to your server.cfg:

Code: [Select]

set g_logsync 0
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #12 on: November 26, 2006, 11:56:57 pm »
Uhm, just found another bad bug with the parser and copying the logfiles. I will write a patched version tomorrow.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #13 on: November 27, 2006, 10:34:14 pm »
Tremstats 0.5.1 out.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

rasz_pl

  • Guest
[Today] Tremstats Version 0.5
« Reply #14 on: November 27, 2006, 10:38:42 pm »
still http://tremstats.dasprids.de/player_details.php?player_id=77 shows peak kill count in the 40s, and Im sure you remember yesterdays game where I had 80 kills
Logged

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #15 on: November 28, 2006, 07:56:08 am »
Sure, but the logs of that are corrupted thanks to the bug. So I can't count them anymore, sorry.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

Greudin

  • Posts: 131
  • Turrets: +1/-1
    • http://tremulous.bricosoft.com
[Today] Tremstats Version 0.5
« Reply #16 on: December 01, 2006, 09:15:15 pm »
Quote from: "David"
Quote from: "DASPRiD"
Quote from: "David"
Quote from: "DASPRiD"
Quote from: "Arch_Enemy"
would be cool if u could make the trem stats world- wide for all servers? lol


I can't.


but someone else could start a thing, If all the server admins gave them access to the logs....


What admins would never do ;>


why? what is there in a log that is so secretive?
all it would need is a daily cron job to upload the script to some server somewhere.


For that big server logs parser, I can provide about 150 MB of logs, filled with insults, tking but nice things also :8)
Logged
url=http://tremulous.bricosoft.com][/url]

rasz_pl

  • Guest
[Today] Tremstats Version 0.5
« Reply #17 on: December 03, 2006, 02:01:59 am »
am I stupid or do you have a nice field called `building_icon`containing file name in buildings table, and then in maps table you retarted'ly (:P) store a FOKIN PNG image inside a database????? btw my mysql just  throws out on that part and refuses to import.
Logged

Greudin

  • Posts: 131
  • Turrets: +1/-1
    • http://tremulous.bricosoft.com
[Today] Tremstats Version 0.5
« Reply #18 on: December 03, 2006, 11:49:00 am »
Quote from: "rasz_pl"
... btw my mysql just  throws out on that part and refuses to import.


Got the same pb, remove INSERT into maps lines to import data.sql without errors.

Perform a ./tremstats.py --pk3only to refill the maps table.

Ty DASPRiD for this new version and for help to upgrade it :)

http://tremx.bricosoft.com
Logged
url=http://tremulous.bricosoft.com][/url]

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #19 on: December 03, 2006, 01:52:52 pm »
Quote from: "rasz_pl"
am I stupid or do you have a nice field called `building_icon`containing file name in buildings table, and then in maps table you retarted'ly (:P) store a FOKIN PNG image inside a database????? btw my mysql just  throws out on that part and refuses to import.


Thats because the levelshots have to be getable without having parser and webserver on the same server.

Btw, the SQL-bug is fixed in SVN version.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #20 on: December 04, 2006, 02:38:32 pm »
Any one have stats on this parser - How long does it take to parse a large log file (>100Mb)?

Just curious if it's worth using at this point.
Logged
--df

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #21 on: December 04, 2006, 04:12:56 pm »
This depends on your machine. Parsing a 300 MB logfiles takes my server 5 minutes.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #22 on: December 04, 2006, 05:09:31 pm »
Running into some errors testing the tool. I haven't looked at your code, but I assume you are trying to move the original file instead of just copying it? To my knowledge, this won't work on Windows unless the server is shutdown.

Quote
Renaming original logfile ...
Traceback (most recent call last):
  File "D:\temp\trem\logger\tremstats.py", line 142, in <module>
    app.Main()
  File "D:\temp\trem\logger\tremstats.py", line 63, in Main
    parser.Main(self.dbc, self.Check_map_in_database, self.games_log, self.stati
c_log)
  File "D:\temp\trem\logger\internals\log_parse.py", line 49, in Main
    self.Log_read()
  File "D:\temp\trem\logger\internals\log_parse.py", line 106, in Log_read
    os.rename(self.games_log, source)
WindowsError: [Error 13] The process cannot access the file because it is being
used by another process
Logged
--df

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #23 on: December 04, 2006, 05:23:21 pm »
True, I'm renaming it, because the pointer of the application should move with to a temporary position. But who is really running a dedicated server with windows os?
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #24 on: December 04, 2006, 05:24:38 pm »
Just found your static variable. Might be worth putting that in your config file with a bit of instruction.

//nevermind. this still doesn't fix the issue.
Logged
--df

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #25 on: December 04, 2006, 05:25:28 pm »
Quote
But who is really running a dedicated server with windows os?


To my knowledge, quite a few of us!
Logged
--df

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #26 on: December 04, 2006, 08:29:57 pm »
Made a quick mod to your code to get things working. Instead of moving/copying the log all over the place, I just set things to copy the log to an archive directory. The code then sifts through the "last version" and compares it with the current copy. This ensures that we don't process the same data twice. Once done, it turns the current copy into the "last version".

This is the only solution I can think of for a Windows setup - without shutting down the Trem server to release the log that is.

This is how my current stats solution works, and I figured it'd work here while I'm testing your stats tool.
Logged
--df

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #27 on: December 04, 2006, 08:45:38 pm »
Well, and how do you ensure, that the parser gets only logfiles beginning with an "init" and ending with a "shutdown"? Or how do you ensure, that you don't copy the file while Tremulous is writing to it?
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]

squishy

  • Posts: 91
  • Turrets: +1/-0
[Today] Tremstats Version 0.5
« Reply #28 on: December 04, 2006, 08:57:42 pm »
I'm not sure I see your solution for such issues. Unless I'm overlooking it.
Logged
--df

DASPRiD

  • Administrator
  • Posts: 549
  • Turrets: +21/-2
    • http://www.dasprids.de
[Today] Tremstats Version 0.5
« Reply #29 on: December 04, 2006, 09:15:14 pm »
The renaming is the solution ;). Because on Linux the file-pointer is moved. Read the 3rd news on dev.dasprids.de for explanition.
Logged
url=https://www.paypal.com/cgi-bin/webscr?cmd=_xclick&business=mail%40dasprids%2ede&item_name=DASPRiD%27s&no_shipping=0&no_note=1&tax=0&currency_code=EUR&lc=DE&bn=PP%2dDonationsBF&charset=UTF%2d8][/url]
Pages: [1] 2  All   Go Up