How to collect statistics inside a web application?

Nodge2012-10-21 18:33:11

PHP

Nodge, 2012-10-21 18:33:11

There was a need inside the web application to collect statistics on events for each user. In the future, of course, statistics need to be analyzed, so tools are needed to work with such logs.

It is clear that you can write a bicycle: write everything to the database, then write an interface for analysis, or manually make queries to the database.

Nevertheless, maybe there are some ready-made solutions, good practices?
Maybe there are projects like Sentry (error aggregation server), but for statistics?
How do you solve such problems for yourself?

Thanks for answers.

Answer the question

In order to leave comments, you need to log in

9 answer(s)

Leonid, 2012-10-21
@leonid-lapidus

We decided head-on and dragged it from project to project: actions table, where it is written, user_id, time stamp, action code, result or error code, comment, service info. We do not observe any problems on >40 projects.
Why they biked - because they could not find anything that meets the requirements for analytics. Here we are the kings ourselves - what we want: we write what we want - we analyze, moreover, according to the sections we want. There was an idea to make a universal tool out of this, but ... somehow the hands did not reach.

shagguboy, 2012-10-21
@shagguboy

pinba?

dbmaster, 2012-10-22
@dbmaster

Plant options
papertrailapp.com/
loggly.com
Alternative
piwik.org/
Through piwik you can find similar questions habrahabr.ru/search/?q=piwik&target_type=qa

LeoCcoder, 2012-10-21
@LeoCcoder

try google analytics. We often use it, and not only on websites, but also in mobile applications to analyze user behavior.

Vladimir Chernyshev, 2012-10-21
@VolCh

I tried to do it on RDBMS (MySQL), but I didn’t like it - or for each event you need to fence a sign or emulate scheme free. It's easier to take a real scheme free DBMS, I settled on CouchDB. Not for the end user, but almost any front-end developer can write a quick view in JavaScript, after a little specifics training, of course

Evgeny Seleznev, 2012-10-21
@alkali

I use mixpanel.com, I recommend

mongohtotech, 2012-10-21
@mongohtotech

We have developed an OLAP system specifically for such tasks. The system analyzes user behavior in the cloud service.
Briefly described, it looks like this:
- We periodically load information from the service logs into a data warehouse containing tables with information about user operations (login, page view, file download, etc.)
- Based on the storage, OLAP cubes are built
- Access to OLAP is possible from Excel, or directly through MDX queries, for example, to publish analytics in your application
- Everything was implemented using MS SQL Server
- Data volumes - millions of operations per day

kuzemchik, 2012-10-22
@kuzemchik

We thought about pinba, but ended up using New Relic.

Eternalko, 2013-02-23
@Eternalko

habrahabr.ru/qa/26351/mixpanel
_