Tremstats reloaded

[codernem]

Hi all! 

I want to show you a new tremstats engine output. I wrote it because our italian community site has little DB space, and Dasprid's tremstats use it extensively. So I developed this parser/stats calculator (written in Java). The processing time of a 380 Mb log file is rather quick (about 5 minutes...), and it exports all data in plain HTML format, without the need of DB space. It needs about 200 Mb of memory to store data during parsing, while the output (for about 410 players) is 11 Mb large (without map images and icons).

At the moment I'm rewriting some pieces of code, and refactoring, and after that I'll release it as GPL and put a google-code repository.
I want to really thanks Dasprid for let me use his icons for weapons and buildings.

Main features:

- no DB required
- advanced stats (expected value and variance)
- GUID aggregator by config
- quick processing time

What I'm planning:

- xml export of processed data
- charts generator
- more statistics
- map image auto-extractions (given a map repository dir)

You can see it here:

http://www.capponcino.it/tremulous/statsprolinux/index.html

Feel free to send me suggestions  and critics 

PS: there is a bug on the index page, if opened by IE. I've already address this issue 

[doomagent13]

I suggest that you have it run once a day and SAVE the results.  Then you could just show the results upon request rather than needing to recalculate them EVERY time someone wants to look at them.

[NiTRoX]

Seems cool.

I like the website layout and stuff.

[codernem]

I suggest that you have it run once a day and SAVE the results.  Then you could just show the results upon request rather than needing to recalculate them EVERY time someone wants to look at them.

It's what I do

[Lakitu7]

Cool to see someone adding to the dormant stats code.

I know the european folks don't use it much, but I've added a lot of additional things to games.log in my qvm and it'd be pretty cool to see someone use them to tabulate new stats / improve existing ones. Particularly, I'd like to see stats on the number of games that end before/during SD, and also stats on vote pass/fail rates + most kicked user etc. Just a thought. If I were you I probably wouldn't do it either though. Someday, perhaps.

[Hellrider]

Good job codernem 

[Lava Croft]

Good work Codernem! <3

[codernem]

Cool to see someone adding to the dormant stats code.

I know the european folks don't use it much, but I've added a lot of additional things to games.log in my qvm and it'd be pretty cool to see someone use them to tabulate new stats / improve existing ones. Particularly, I'd like to see stats on the number of games that end before/during SD, and also stats on vote pass/fail rates + most kicked user etc. Just a thought. If I were you I probably wouldn't do it either though. Someday, perhaps.

If you print right log informations, it's a matter of minutes extends the system to generate events from new log entries. I'm putting efforts on writing easily extendible and clean code.

I guarantee nothing, but I'll look at your log messages, after the refactor process I'm doing.

Thanks a lot for this suggestion!

[wannabe]

wd (well done)
source?

[Oblivion]

codernem have you released it yet? If not are you going to?

[Lava Croft]

wd (well done)
source?

Who cares about the source.

[ghostisback]

Good Work Mate !!! xD

[wannabe]

wd (well done)
source?

Who cares about the source.

lava.. do you have fans? I dont think so.. they just dont want to argue with you...

[Bajsefar]

Wannabe, he has. And I have argued with him more than once.. Still a fan.

[Paradox]

Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.

Also, its slower than my old blog.

[khalsa]

Looks very promising, can't wait to see a release.


Khalsa

[codernem]

source?

As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!

Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.

Sure, Dasprid design is superb. I need to talk to him about this


@ all: thanks for appreciation and suggestions

[NiTRoX]

source?

As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!

Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.

Sure, Dasprid design is superb. I need to talk to him about this


@ all: thanks for appreciation and suggestions

His was written in Python.

[codernem]

source?

As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!

Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.

Sure, Dasprid design is superb. I need to talk to him about this


@ all: thanks for appreciation and suggestions

His was written in Python.

I know but, over all, Dasprid's stats need a DB, while my exporter doesn't. This is the main difference between the two. Maybe what Paradox would say is to use the same layout and style for the web part.

[Paradox]

Yes, thats what i mean. Same front end, but the backend would be totally different.

[doomagent13]

And please make it not need to re-parse/compile/whatever the log every time someone tries to check it.

[codernem]

And please make it not need to re-parse/compile/whatever the log every time someone tries to check it.

As I said before (two times) my engine DOES NOT PARSE log files every time a user see the website. Parsing is made ONCE, and after that, the engine output STATIC html pages, with all infos.

Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox

Again, the system DOES NOT REPARSE log files at every access

[doomagent13]

Okay.  Just had to make sure...

BTW, it looks quite good.

[David]

Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox

1.3MB of javascript...
Have you thought about ajax?  Would drop the downloaded amount a fair chunk.

[codernem]

Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox

1.3MB of javascript...
Have you thought about ajax?  Would drop the downloaded amount a fair chunk.

Sure, but I dont know ajax technology atm. In future reworking (after the release of source code), why not?

[Colkadome]

How many people are currently not on the list? I didn't see my name 

[codernem]

How many people are currently not on the list? I didn't see my name 

You can configure the engine to export only players with a minimal presence (in Prolinux case, at least 20 games). Maybe this is why you can't see your name on the list.

[slux_ITA]

good job brother! 

[codernem]

I've done a style cleanup, using some css from Dasprid's stats.

http://www.capponcino.it/tremulous/statsprolinux/index.html

Cheers

[NiTRoX]

Just my opinion.

Why don't you make the navigation bar buttons of equal length/height and try to space them centrally over the black boxy thing?