Sign In To Proceed 435v5c

Don't have an ? 473g1v

osu! to create your own !
forum

osu!Bancho stats and logs! 6n6f1u

posted
Total Posts
129
show more
Btw; last log from #polish for ex. is from #polish_20130604.log ... is everything working fine?
Topic Starter
Zertap pointed it out to me that the rsync had stopped working.

Just realized I forgot to uncomment the rsync cronjob >.>

All should be good now
can you do an update on all the channels? some are gone and there are new ones aswell
Topic Starter

silmarilen wrote: 3y5n4j

can you do an update on all the channels? some are gone and there are new ones aswell
Will do.


The log viewer will be out by the end of today/in a few hours.

Just talking to the guy about it now.
Topic Starter
All done! It looks ugly for now but
http://osu.corin.me/logs/
It works :D

Just swapping out the rsync script to add it to specific folderz
umm can you give "automated" avatar ? (well, you can't automate it for "underscore" and "space" based name... D:)
http://s.ppy.sh/a/ID
(or something)
which ID can be obtained from the profile page itself
  while(!(EOF)) {
%line = %fo->$readLine
if ($str.match("^var Id = *",%line,r)) {
%uid = $int($str.chop($str.mid(%line,13,$length(%line)),2))
// this is not php or what code, picked from KVIrc
break;
}
}


(if cant, can you "re-" me?)
Topic Starter

Rei Hakurei wrote: 4f2a6p

umm can you give "automated" avatar ? (well, you can't automate it for "underscore" and "space" based name... D:)
http://s.ppy.sh/a/ID
(or something)
which ID can be obtained from the profile page itself
  while(!(EOF)) {
%line = %fo->$readLine
if ($str.match("^var Id = *",%line,r)) {
%uid = $int($str.chop($str.mid(%line,13,$length(%line)),2))
// this is not php or what code, picked from KVIrc
break;
}
}


(if cant, can you "re-" me?)
....... and this is actually what I needed.

I'll get this shoved in today.
Topic Starter
Aaand completely forgot about the scripts, should be fine now.
Can you make stats for other channels? That would be really nice of you.
Topic Starter

Nanika133 wrote: f2u52

Can you make stats for other channels? That would be really nice of you.
Am I missing any? It should be generating stats for all channels... Have a look at http://osu.corin.me/stats

Let me know if I'm not logging a channel or two.
Turkish ;_;
#arabic is not there, #bulgarian #cantonese #chinese are missing too...
Topic Starter

UnderminE wrote: 1z4r1y

Turkish ;_;

Nanika133 wrote: f2u52

#arabic is not there, #bulgarian #cantonese #chinese are missing too...
Done and done, they are currently generating so it will take a little while to go through all 250 odd days.

Also added #english too.

EDIT: All done.
#romanian is also missing.

Corin wrote: 3wt1n

UnderminE wrote: 1z4r1y

Turkish ;_;

Nanika133 wrote: f2u52

#arabic is not there, #bulgarian #cantonese #chinese are missing too...
Done and done, they are currently generating so it will take a little while to go through all 250 odd days.

Also added #english too.

EDIT: All done.
Thankies <3
Topic Starter

Mirailine wrote: 413g34

#romanian is also missing.
Done: http://osu.corin.me/stats/romanian.html
Yeah, thanks alot :3
i dont know which channel this shows http://osu.corin.me/stats/english.html but its not #english
Topic Starter

silmarilen wrote: 3y5n4j

i dont know which channel this shows http://osu.corin.me/stats/english.html but its not #english
Logfile = "/logops/osu/#ctb_*.log"

whoops, should be fixed.
You know what, we should link these stat pages in channels as an auto/start message. Like when you open a channel, there will be an auto-message with an explanation and the stats page-link. It would bring some activity within IMO. Activity is not a problem for crowded channels (#osu, #modhelp etc) but less-crowded ones.
Topic Starter
I could make a bot for that but it's down to peppy if he'd let me make it.

If he built it into Bancho as it does with the messages when a s a channel it'd be far more easier however I can make a bot that does all kinds of shit IE can PM you the link to the stats/logs of the channel you're in just by doing .stats or . a channel.

But I think peppy said no to the last one.
Well last one is the same as coming and finding the link here, I suggested it for new players (mostly foreign) who don't browse forums at all.

Maybe we can ask peppy about the first one.
I think the website is down :/
Topic Starter
Nope? Working fine here.

Corin wrote: 3wt1n

Nope? Working fine here.
i think he meant that the stats arent updating
Topic Starter
all fixed, I moved a lot of shit around and reorganized stuff so there was a permdenied issue.
Patched and working once more~
bigbadwolf666_old
avater don't work (at least for #italian stats)
the logs dont seem to work anymore, im just getting this when i try to select a channel
Topic Starter
php broke, I was pissing about with php execution in certain dirs and forgot about that one >.>

Should work fine now.


this don't work :c
any idea why the logs in skandinavian doesn't work?
Seems like all logs/quotes are completely freezed and not updated since Wednesday. (there are no logs from Thursday and today)
Did something bad happened? :I

EDIT: okay nvm
Topic Starter
It's temporarily not generating stats, the logs are fine juts not being sync'd to the log folders, I need to work on a few things on it because at the moment it's pushing full load on my servers U and I have an inkling that the HDD is on its last legs due to constant IO.

Anyways once I finish my build-scripts I'll finish the stats stuff, but I'll re-enable log syncing for now.

Saten wrote: 5e2b6d

any idea why the logs in skandinavian doesn't work?
It doesn't? o.O

EDIT: Oh re-read
Topic Starter
Herro!

So what I did to counter this issue is put more load on it to ease off the big burden!

So there's a few new things; one is that that stats are now split into 2 sections.
Yearly and combined.

Combined will be filed in the same place as normal however they will be generated once a day only. Not every hour, this will generally ease off the load

Yearly will be filed in http://osu.corin.me/stats/yearly/ so you can view the past stats of 2013 and this years current stats.
Before you moan that /np counts as an action, I'm aware I just can't tell what changed.

2014's yearly stats will now be generated every 10 mins once again but is more likely to be changed to 20 in the near future.

Logs have started syncing once again as normal aaand I think that's all! Enjoy :D
And all the avatars are back !
Grats \:D/
Topic Starter

Didou wrote: 6za3k

And all the avatars are back !
Grats \:D/
Yeup, automatically adding themselves and updating, there's a few glitches here and there but the majority of it works!
Topic Starter
Did a quick but fairly decent modification
Thanks to peppy pointing out to me that the osu!API can get uid's; avatars no longer are cached locally on the server but use your current osu! one directly so it'll never be out of date!

This will lower load and generation times greatly meaning I can re-enable #osu's combined stats generation!

#osu's 2014 statistics will be generated hourly
#osu's combined statistics will now be generated daily rather than whenever it feels like it.

Have fun!

Also if anyone wants it a copy of the UID cache can be found here: http://corin.me/uid_cache It's always up to date.
Format is name:UID
seasonS

Vext wrote: 36395j

Pretty nifty. If only I ever spoke in #osu or anywhere.
True
Topic Starter
So I did a few changes which is why this was down for a few days.

1: I moved everything to a new dedi so now instead of #osu taking 3 hours and 10 mins to generate on combine stats and dragging a load of other shit down because of; it takes 10 mins and drags nothing down with it. 2x E5's are nice.
So now I once more re-enabled #osu combined stats.

2: I redid the way I have logs laid out. While moving everything I somewhat was confused and had to ask myself what the fuck I was doing.
Every night it would rsync the logfiles over to another directory. So it used to copy them and overwrite, for some reason rsync didn't like checking if the files were the exact same in both destinations so what it did was overwrote them ALL so that's every channel, copying 500 files ($chancount * 500) every night which I'm sure the HDD did not like.
It's a very dumb thing to do, especially seeing as the old dedi itself was not very powerful and low on HDD space (45GB total in logs * 2 due to them being in 2 locations).

So now I replaced that shit with something much more simplistic. I created a symlink to the actual files and every night at 12.01AM it'll create a symlink for that day bringing the overall HDD load to 0 and bringing down space requirements.

This also gave another boon; the logs are now updated in realtime so you don't have to wait an hour for that stuff to update anymore.
Looking back I knew how to do all this back then and I'm wondering why I didn't do it. Oh well.

Anyways, enjoy. \o\ Everything should be overall faster

TL;DR
Chan stats generate zoom zoom now
Chan stats are back up
#osu combined now works
Logs are updated in realtime
I was wondering about the eternal maintenance ....
Welp, I pretty much didn't expect a complete update lol, gg, keep going \:D/
Topic Starter

marcostudios wrote: g181c

http://osu-ppy-sh.jeuxcrack.net/u/-MasterCraft- is banned

http://osu-ppy-sh.jeuxcrack.net/u/Mastercraft2012 was the name before the namechange
There's a lot that can go wrong there. Because peppy removed the "previous name" on the profile it's hard to see if they're banned or they changed their nickname or whatever.
Tempted to have a submission feature for this as it needs to be done manually (can be automated however later on).
At the same time I can't prove all this stuff.

plus the cache needs to be regenerated for it to take effect too. so yeah.


:c
Topic Starter
Caused by networking outage and corin panicing, unfortuantly there's no backlog, but it's fixed.
This is glorious. A new stalking tool for me! :>

Is it possible to search for specific s?
Topic Starter

Granger wrote: 4d605j

This is glorious. A new stalking tool for me! :>

Is it possible to search for specific s?
Not really, other than CTRL + F and just what channels you chat in most :P
The logs don't work anymore.
It says 'File not found' >.<
Topic Starter
Fixed, I think I just hit another Y2K type bug. Huh.
Either way it fucked over my whole webserver for no reason. All fixed :D
[-Sophie-]_old
Some directories are broken with a file not found
also, why isn't my avatar showing up?
Looks like that bug is back!
Can't view the whole site. "File not found."
Topic Starter
aaaaaaaaaaaaaaaaaa

Yeah I'm fixing it now, it's caused by my rewrite including the indexes as php for no reason, most other things work.... sorta.

You can still go directly to the pages though.

Corin wrote: 3wt1n

You can still go directly to the pages though.
nope
Topic Starter

Howl wrote: 17g5

Corin wrote: 3wt1n

You can still go directly to the pages though.
nope
You're going directly to the index, that's technically not a page. If you want stats,
http://osu.corin.me/stats/channelnamehere
For 2014 stats
http://osu.corin.me/stats/yearly/2014/channelnamehere
IE
http://osu.corin.me/stats/yearly/2014/ctb


EDIT: nmlol fixed.
Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;

CanadianPaws wrote: f551l

Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;
i think corin use pisg
Topic Starter

marcostudios wrote: g181c

CanadianPaws wrote: f551l

Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;
i think corin use pisg
A heavily modified version of pisg yes. The only real hard part is the magnitude resources it uses.
muh 2015
Please update it <3 very useful for a lot of players, thanks for your work!
2015 make it happen

xxdeathx wrote: 5i2247

http://osu.corin.me/stats/yearly/2014/modhelp.html

LOL

it's something \:v/
The log seems to have stopped on 5th Jan.
Topic Starter
My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:

Corin wrote: 3wt1n

My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:
2014 #osu has transformed into 2015. There isn't an actual 2015 #osu when you look up but its replacing 2014.
Topic Starter

Nutella wrote: z3547

Corin wrote: 3wt1n

My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:
2014 #osu has transformed into 2015. There isn't an actual 2015 #osu when you look up but its replacing 2014.
fug :^DDD
Fixed. I did kinda wonder where #osu was on 2015
How I did not know about this?!
A little bug, changing your name will result in your old name to remain inactive. You basically have to regain all your stats
Example, I changed my name to Pawsu, and now my old name, CanadianPaws, is inactive
http://rainy.s-ul.eu/O4QvyzYC
i changed my name so...when you have some time...c-can you update it? :Db
"File doesn't exist" since 3 days
Topic Starter

Deimos wrote: 2i1j4s

"File doesn't exist" since 3 days
That's not very helpful... What file doesn't exist? Which URL are you trying to go to?
http://osu.corin.me/logs/#

logs, all channels
Topic Starter

Deimos wrote: 2i1j4s

http://osu.corin.me/logs/#

logs, all channels
Oh whoops. PHP update broke it. I'll fix it today at some point.
hmm yeah I think it's down again
Now it's totally gone, 404... :( Corin save us pls!
now i cant see my spam ratio
rip
down again ;w;
Baka Corin
just kidding! :lol:
Rirouni
rip corin ;_;
corin we need you to fix this :c
Since Corin is nowhere to be found I set up logs, originally for #polish channel but I'm willing to do other channels as well. Stats are being prepared, just don't except anything too advanced, my resources are limited for the time being. Script was made by WujekGrzyb (perviously I used my own but it wasn't too good), I've added my workarounds and it works quite well now. There's no arguing that Corin's service was superior but it's here. Think of it as backup.
If you want me to log your language channel (not going to log #osu, I don't have space for it) just send me a message in-game or on forum. Just please don't flood this topic with channel requests, as it wasn't my intention.
To use it, just click channel and then date that you are interested in.

http://reyie.cf/logs/

Other things, like specification and with me is to be found at main page.

http://reyie.cf/

Please enjoy. :)

EDIT:
Stats for the channels are back. Please make suggestions what more do you want to see in them.

http://reyie.cf/stats/
Rey, I love you ٩(๑❛ᴗ❛๑)۶

Rashiro wrote: 5cc2n

Rey, I love you ٩(๑❛ᴗ❛๑)۶

Rashiro wrote: 5cc2n

Rey, I love you ٩(๑❛ᴗ❛๑)۶
YatsuKaori
rip corin stats
404
Lost 7 hours of logs between December 24 15:13:02 CET and December 24 21:54:07 CET.
Fault was all on my side, misconfiguration - the server I connected to wasn't load balancer but only single node (Marcin told me that but I ignored it).
I'm sorry for the inconvenience.
what I said in my previous post and tell me if your channel is not on the list. :idea:
And Merry Christmas to all. :lol:

Rey wrote: 5b5u1r

Lost 7 hours of logs between December 24 15:13:02 CET and December 24 21:54:07 CET.
Fault was all on my side, misconfiguration - the server I connected to wasn't load balancer but only single node (Marcin told me that but I ignored it).
I'm sorry for the inconvenience.
what I said in my previous post and tell me if your channel is not on the list. :idea:
And Merry Christmas to all. :lol:
*lol*
I really thank you for this, butI don't see the #vietnamese channel chat log and stats, I osu.corin.me have all stats and logs from all channel, and the background color is a bit hard to see the text, I think it should change back to white color
I hope you can improve it in the future *rolling*
sorry for my bad English
Ummmmmmm...

kirito-123 wrote: 126i1n

*lol*
I really thank you for this, butI don't see the #vietnamese channel chat log and stats, I osu.corin.me have all stats and logs from all channel, and the background color is a bit hard to see the text, I think it should change back to white color
I hope you can improve it in the future *rolling*
sorry for my bad English
I wanted this to be in similar style that osu in-game chat is, so no. I'm considering making two themes, one light and one dark, that way everybody would be happy. But for now I fiddled with font color so it won't be tiring to your eyes.
#vietnamese channel added but next time please comply to p/4724665
I'm slowly adding rest of the channels.
bump.
Redesigned front page and made most used pages mobile-friendly. More about details here: http://reyie.cf/blog
:DDD
There's no log from Wed onwards.
Almost 1 year since I started being Corin's replacement, huh.

Don't worry, I did not forget about the project. It's still running and it's doing quite well.
Two months ago, generation engine was rewritten, now it operates on python but uses template engine. So making changes isn't so crudesome as it was before (hardcoded site into the script, yuck!).
Recently I started making *some* changes into overall aesthetics of the site.
I apologize for not regenerating stats, had some issue with crontab but it's resolved now.

If you ever need to poke me, whether the logs aren't logging, stats aren't regenerating or simply to make a suggestion, please use my Discord at https://discord.gg/ncb2h7V

Let's make it function another year. :)
And we're here! One year!
For this occasion I've bought somewhat more friendly domain, we don't have to rely on free .cf! We're making a leap to http://reyie.com and please think of it as a new main domain.
It's no longer blocked on Steam for one thing, which was serious downside for many people using my link shortener.
in #spanish have problem 2x3 in the 365 day 1 is silencie in the channel XD
Rest in piece
Hi guys,

As you all know, this project has been running for quite some time now - 5 years to be exact. Unfortunately it's time to let reyie.com die - I don't have time to maintain the site, the generation engine would require a lot of improvement - currently it's very, very wasteful resources-wise, the lack of disk space is finally getting to me (and I have no spare budget to higher volume) - these are just few of the reasons I've decided to end reyie.com.

Archives can be found here:
  1. Logs
  2. Stats (some in JSON form, some in HTMLs)
  3. Site
reyie.com will be available for a few more days but after that, it will be gone, only static page describing what this project was will remain.

Thank you to all of the people that has ed the project till now.
Topic Starter
Ayyyy lmao guess who's back

So recently I got a new job that's big in statistics and metrics.
And then flan reminded me in s-ul's discord about osu.corin.me

https://corin.s-ul.eu/Lqy7vIvmrO.png

So now I'm doing this again, writing an app to do it properly instead of the horrible shit I did before.

I've also restored http://osu.corin.me/ kinda, it's not perfect but yno, better than nothing.
stats are interesting

there will be a data gap tho, won't there?
Topic Starter
By a few days yeah, plan is to rip the logs from the above archive.org stuff when the time comes as it started shortly after my version stopped
show more
Please sign in to reply.

New reply 1b384i