Tremulous Forum
General => General Discussion => Topic started by: codernem on May 23, 2008, 08:18:31 am
-
Hi all! :)
I want to show you a new tremstats engine output. I wrote it because our italian community site has little DB space, and Dasprid's tremstats use it extensively. So I developed this parser/stats calculator (written in Java). The processing time of a 380 Mb log file is rather quick (about 5 minutes...), and it exports all data in plain HTML format, without the need of DB space. It needs about 200 Mb of memory to store data during parsing, while the output (for about 410 players) is 11 Mb large (without map images and icons).
At the moment I'm rewriting some pieces of code, and refactoring, and after that I'll release it as GPL and put a google-code repository.
I want to really thanks Dasprid for let me use his icons for weapons and buildings.
Main features:
- no DB required
- advanced stats (expected value and variance)
- GUID aggregator by config
- quick processing time
What I'm planning:
- xml export of processed data
- charts generator
- more statistics
- map image auto-extractions (given a map repository dir)
You can see it here:
http://www.capponcino.it/tremulous/statsprolinux/index.html
Feel free to send me suggestions :-* and critics >:(
PS: there is a bug on the index page, if opened by IE. I've already address this issue :angel:
-
I suggest that you have it run once a day and SAVE the results. Then you could just show the results upon request rather than needing to recalculate them EVERY time someone wants to look at them.
-
Seems cool.
I like the website layout and stuff.
-
I suggest that you have it run once a day and SAVE the results. Then you could just show the results upon request rather than needing to recalculate them EVERY time someone wants to look at them.
It's what I do :P
-
Cool to see someone adding to the dormant stats code.
I know the european folks don't use it much, but I've added a lot of additional things to games.log in my qvm and it'd be pretty cool to see someone use them to tabulate new stats / improve existing ones. Particularly, I'd like to see stats on the number of games that end before/during SD, and also stats on vote pass/fail rates + most kicked user etc. Just a thought. If I were you I probably wouldn't do it either though. Someday, perhaps. :)
-
Good job codernem ;) ;D
-
Good work Codernem! <3
-
Cool to see someone adding to the dormant stats code.
I know the european folks don't use it much, but I've added a lot of additional things to games.log in my qvm and it'd be pretty cool to see someone use them to tabulate new stats / improve existing ones. Particularly, I'd like to see stats on the number of games that end before/during SD, and also stats on vote pass/fail rates + most kicked user etc. Just a thought. If I were you I probably wouldn't do it either though. Someday, perhaps. :)
If you print right log informations, it's a matter of minutes extends the system to generate events from new log entries. I'm putting efforts on writing easily extendible and clean code.
I guarantee nothing, but I'll look at your log messages, after the refactor process I'm doing.
Thanks a lot for this suggestion!
-
wd (well done)
source?
-
codernem have you released it yet? If not are you going to?
-
wd (well done)
source?
Who cares about the source.
-
Good Work Mate !!! xD
-
wd (well done)
source?
Who cares about the source.
lava.. do you have fans? I dont think so.. they just dont want to argue with you... :)
-
Wannabe, he has. And I have argued with him more than once.. Still a fan. :)
-
Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.
Also, its slower than my old blog.
-
Looks very promising, can't wait to see a release.
Khalsa
-
source?
As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!
Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.
Sure, Dasprid design is superb. I need to talk to him about this :)
@ all: thanks for appreciation and suggestions :-*
-
source?
As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!
Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.
Sure, Dasprid design is superb. I need to talk to him about this :)
@ all: thanks for appreciation and suggestions :-*
His was written in Python.
-
source?
As I said before, I'm going to release source code after cleaning it up. I don't want to release hard-to-understand code. But, yes, sources will be released for sure!
Looks promising, but the original design is very clean. Perhaps you could use it along with this new system.
Sure, Dasprid design is superb. I need to talk to him about this :)
@ all: thanks for appreciation and suggestions :-*
His was written in Python.
I know but, over all, Dasprid's stats need a DB, while my exporter doesn't. This is the main difference between the two. Maybe what Paradox would say is to use the same layout and style for the web part.
-
Yes, thats what i mean. Same front end, but the backend would be totally different.
-
And please make it not need to re-parse/compile/whatever the log every time someone tries to check it.
-
And please make it not need to re-parse/compile/whatever the log every time someone tries to check it.
As I said before (two times) my engine DOES NOT PARSE log files every time a user see the website. Parsing is made ONCE, and after that, the engine output STATIC html pages, with all infos.
Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox ;)
Again, the system DOES NOT REPARSE log files at every access :P
-
Okay. Just had to make sure...
BTW, it looks quite good.
-
Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox ;)
1.3MB of javascript... :o
Have you thought about ajax? Would drop the downloaded amount a fair chunk.
-
Maybe many of you think that because of the progress bar that loops and loops on the first page. It's only a graphical effect (buggy on IE, but already solved in development), introduced because of players indexing is done with a JS file (that is quite big... about 1 Mb). If that gif creates so much problems, I can simply delete it. You can skip it by pressing Player Index on top menu. Try to see the main page with firefox ;)
1.3MB of javascript... :o
Have you thought about ajax? Would drop the downloaded amount a fair chunk.
Sure, but I dont know ajax technology atm. In future reworking (after the release of source code), why not? :P
-
How many people are currently not on the list? I didn't see my name :(
-
How many people are currently not on the list? I didn't see my name :(
You can configure the engine to export only players with a minimal presence (in Prolinux case, at least 20 games). Maybe this is why you can't see your name on the list.
-
good job brother! ;D
-
I've done a style cleanup, using some css from Dasprid's stats.
http://www.capponcino.it/tremulous/statsprolinux/index.html
Cheers :)
-
Just my opinion.
Why don't you make the navigation bar buttons of equal length/height and try to space them centrally over the black boxy thing?
-
Hi all!
Here http://code.google.com/p/jtremstats/ you can find source code - ready to use jar - config files - resources.
Documentation is really poor at the moment, but I'll try to add comments to code and document a bit the overall system architecture.
If someone hacks the code and want to share his modification or wants to join the project and contribute, just look for me on Freenode, #tremulous.ita.
Cheers,
-
Hello,
Wow, nice work Codernem ! It look likes very nice. :)
Only two things :
- We need a short description of the different "awards".
- The feature of Slux, the one who show all the aka was nice, what about reusing it ?
Thanks in advance !
-
Hi Colynn!
The feature of Slux, the one who show all the aka was nice, what about reusing it ?
The system already collects those informations: in fact, I keep track of the last nick used, all nicks used, and how many times (games) each nick has been used by each player. In console exporter, the system exports also this kind of information. In HTML exporter, this information is used to index all players name in the Search page.
We need a short description of the different "awards".
I disagree :D I think you need a short description of everything, not only awards :D But time is so few....:(
-
good job friend! ;)