We've got 13 years worth of data stored in mysql (5 million visitor/year). It's a pain to query there so we keep a copy in clickhouse as well (which is a joy to query).
I only track visits to a product detail page so far.
Basically,
some basic metadata about the user (logged in only),
some metadata about the product,
and basic "auditing" columns -- created by, created date, modified by, modified date
(although why I have modified by and modified date makes no sense to me, I don't anticipate to ever edit these, they're only there for "standardization". I don't like it but I can only fight so many battles at a time).
I am approaching 1.5 million rows in under two months.
Thankfully, my DBA is kind, generous, and infinitely patient.
Clickhouse looks like a good approach.
I'll have to look into that.
> select count(*) from trackproductview;
> 1498745
> select top 1 createddate from TrackProductView order by createddate asc;
> 2023-08-18 11:31:04.000
what is the maximum number of rows in clickhouse table?
Is there such a limit?
