I know my previous post of pageviews may be part of the answer.. But what im
looking for is checking usage of our website.. I'd like to know if we are
doing more traffic on a month to month basis and am wondering how can I find
them out ? Anything in the Web logs ? If not, anything else I can put in
place to capture this info ..
You can use the logs....if you save them. I have logs saved from 2005 and
can see how the traffic has changed.
I have an article using log parser how to get this information. It uses
unique visitors, but you can of course change it to page views if you want
to.
"Log Parser: Find out how many unique visitors your website has"
http://www.gafvert.info/notes/log_parser_unique_visitors.htm
Any decent log analyzer can tell your this information as well, using the
log files.
--
Regards,
Kristofer Gafvert
http://www.gafvert.info/iis/ - IIS Related Info
"Hassan"
news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
>I know my previous post of pageviews may be part of the answer.. But what
>im looking for is checking usage of our website.. I'd like to know if we
>are doing more traffic on a month to month basis and am wondering how can I
>find them out ? Anything in the Web logs ? If not, anything else I can put
>in place to capture this info ..
>
>
My C-ip is all from a single source ? I think its our load balancer. In
that case, I cant find out unique visitors..
What column gives me page views ? I have log parser and want to know what is
the query to use ?
Thanks
"Kristofer Gafvert"
news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
> You can use the logs....if you save them. I have logs saved from 2005 and
> can see how the traffic has changed.
>
> I have an article using log parser how to get this information. It uses
> unique visitors, but you can of course change it to page views if you want
> to.
>
> "Log Parser: Find out how many unique visitors your website has"
> http://www.gafvert.info/notes/log_parser_unique_visitors.htm
>
> Any decent log analyzer can tell your this information as well, using the
> log files.
>
> --
> Regards,
> Kristofer Gafvert
> http://www.gafvert.info/iis/ - IIS Related Info
>
>
> "Hassan"
> news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
>>I know my previous post of pageviews may be part of the answer.. But what
>>im looking for is checking usage of our website.. I'd like to know if we
>>are doing more traffic on a month to month basis and am wondering how can
>>I find them out ? Anything in the Web logs ? If not, anything else I can
>>put in place to capture this info ..
>>
>>
>
You need to use the cs-uri-stem and extract the extension. You also need to
figure out what is a page, and what is not a page. Below, i have considered
htm, html, asp, aspx and php to be pages. You may have another extension
that is a page (for example cfm for Cold Fusion pages)
The following example should get you started (it may wrap):
C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,
COUNT(*) A
S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE
EXTRACT_EXTENSION(TO_LOWERCASE(c
s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER BY
date"
Example output:
2004-12-14 633
2004-12-15 502
2004-12-16 487
2004-12-17 536
2004-12-18 255
I wrote this in hurry so it may have mistakes.
I don't think this will catch default documents. I think they are logged as
a folder name (for example /iis/) and without extension. So you may need to
modify the query to catch this as well (hint: change the WHERE clause to
read NOT IN and exclude the extensions you know are not pages, such as
images, pdf, zip-files etc.)
--
Regards,
Kristofer Gafvert
http://www.gafvert.info/iis/ - IIS Related Info
"Hassan"
news:ej2eCJ6RIHA.4880@TK2MSFTNGP03.phx.gbl...
> My C-ip is all from a single source ? I think its our load balancer. In
> that case, I cant find out unique visitors..
>
> What column gives me page views ? I have log parser and want to know what
> is the query to use ?
>
> Thanks
>
> "Kristofer Gafvert"
> news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
>> You can use the logs....if you save them. I have logs saved from 2005 and
>> can see how the traffic has changed.
>>
>> I have an article using log parser how to get this information. It uses
>> unique visitors, but you can of course change it to page views if you
>> want to.
>>
>> "Log Parser: Find out how many unique visitors your website has"
>> http://www.gafvert.info/notes/log_parser_unique_visitors.htm
>>
>> Any decent log analyzer can tell your this information as well, using the
>> log files.
>>
>> --
>> Regards,
>> Kristofer Gafvert
>> http://www.gafvert.info/iis/ - IIS Related Info
>>
>>
>> "Hassan"
>> news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
>>>I know my previous post of pageviews may be part of the answer.. But what
>>>im looking for is checking usage of our website.. I'd like to know if we
>>>are doing more traffic on a month to month basis and am wondering how can
>>>I find them out ? Anything in the Web logs ? If not, anything else I can
>>>put in place to capture this info ..
>>>
>>>
>>
>
Thanks Kristofer.
On a side note, to your earlier message on capturing unique visitors.. so in
our case our C-IP is our load balancer.. In that case, how does one figure
out unique visitors ? Do you think the load balancers store this info or do
we need to scrape some logs from our edge routers or so ?
Just curious so I can reach out to the right team to get me that info.
Btw, when you get the C-IP, is the IP usually from the ISP that hits your
site or can you get the actual IP for the home computer of the client ? If
its the ISP, do you think that if there are a 1000 users that go through the
same ISP, then you will just see it as one unique visitor for those 1000 end
users ?
Thanks
"Kristofer Gafvert"
news:emu6bB7RIHA.3916@TK2MSFTNGP02.phx.gbl...
> You need to use the cs-uri-stem and extract the extension. You also need
> to figure out what is a page, and what is not a page. Below, i have
> considered htm, html, asp, aspx and php to be pages. You may have another
> extension that is a page (for example cfm for Cold Fusion pages)
>
> The following example should get you started (it may wrap):
> C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,
> COUNT(*) A
> S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE
> EXTRACT_EXTENSION(TO_LOWERCASE(c
> s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER BY
> date"
>
> Example output:
> 2004-12-14 633
> 2004-12-15 502
> 2004-12-16 487
> 2004-12-17 536
> 2004-12-18 255
>
> I wrote this in hurry so it may have mistakes.
>
> I don't think this will catch default documents. I think they are logged
> as a folder name (for example /iis/) and without extension. So you may
> need to modify the query to catch this as well (hint: change the WHERE
> clause to read NOT IN and exclude the extensions you know are not pages,
> such as images, pdf, zip-files etc.)
>
>
> --
> Regards,
> Kristofer Gafvert
> http://www.gafvert.info/iis/ - IIS Related Info
>
>
> "Hassan"
> news:ej2eCJ6RIHA.4880@TK2MSFTNGP03.phx.gbl...
>> My C-ip is all from a single source ? I think its our load balancer. In
>> that case, I cant find out unique visitors..
>>
>> What column gives me page views ? I have log parser and want to know what
>> is the query to use ?
>>
>> Thanks
>>
>> "Kristofer Gafvert"
>> news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
>>> You can use the logs....if you save them. I have logs saved from 2005
>>> and can see how the traffic has changed.
>>>
>>> I have an article using log parser how to get this information. It uses
>>> unique visitors, but you can of course change it to page views if you
>>> want to.
>>>
>>> "Log Parser: Find out how many unique visitors your website has"
>>> http://www.gafvert.info/notes/log_parser_unique_visitors.htm
>>>
>>> Any decent log analyzer can tell your this information as well, using
>>> the log files.
>>>
>>> --
>>> Regards,
>>> Kristofer Gafvert
>>> http://www.gafvert.info/iis/ - IIS Related Info
>>>
>>>
>>> "Hassan"
>>> news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
>>>>I know my previous post of pageviews may be part of the answer.. But
>>>>what im looking for is checking usage of our website.. I'd like to know
>>>>if we are doing more traffic on a month to month basis and am wondering
>>>>how can I find them out ? Anything in the Web logs ? If not, anything
>>>>else I can put in place to capture this info ..
>>>>
>>>>
>>>
>>
>
I have no idea what your load balancer can offer.
For your other question, it depends. One user may have one IP address or
multiple IP addresses (AOL users for example). One IP address may be one
user, or multiple users (corporate proxys for example).
Furthermore, a user may not even get the page from your server, but instead
from a cache somewhere on the Internet. In that case, you have a "visitor"
without nothing logged, which you obviously cannot track from the log file.
An IP address logged may not even be a user at all, but instead a web spider
crawling your website.
So basically, one IP address logged can mean:
- Zero user
- 1 user
- Multiple users
One user can be logged as:
- Nothing in the log at all
- One IP address
- Multiple IP addresses
See the problem? There is no good way to determine a physical user. Some log
analysers claim they can accurately do this, but i doubt. There are however
different methods to try to identify actual users, by not only using the IP
address and excluding web spiders.
This is an interesting publication:
"Measuring Web Site Usage: Log File Analysis"
http://epe.lac-bac.gc.ca/100/202/301/netnotes/netnotes-h/not es57.htm
--
Regards,
Kristofer Gafvert
http://www.gafvert.info/iis/ - IIS Related Info
"Hassan"
news:%238h8A5%23RIHA.5208@TK2MSFTNGP04.phx.gbl...
> Thanks Kristofer.
>
> On a side note, to your earlier message on capturing unique visitors.. so
> in our case our C-IP is our load balancer.. In that case, how does one
> figure out unique visitors ? Do you think the load balancers store this
> info or do we need to scrape some logs from our edge routers or so ?
> Just curious so I can reach out to the right team to get me that info.
>
> Btw, when you get the C-IP, is the IP usually from the ISP that hits your
> site or can you get the actual IP for the home computer of the client ? If
> its the ISP, do you think that if there are a 1000 users that go through
> the same ISP, then you will just see it as one unique visitor for those
> 1000 end users ?
>
> Thanks
>
> "Kristofer Gafvert"
> news:emu6bB7RIHA.3916@TK2MSFTNGP02.phx.gbl...
>> You need to use the cs-uri-stem and extract the extension. You also need
>> to figure out what is a page, and what is not a page. Below, i have
>> considered htm, html, asp, aspx and php to be pages. You may have another
>> extension that is a page (for example cfm for Cold Fusion pages)
>>
>> The following example should get you started (it may wrap):
>> C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,
>> COUNT(*) A
>> S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE
>> EXTRACT_EXTENSION(TO_LOWERCASE(c
>> s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER BY
>> date"
>>
>> Example output:
>> 2004-12-14 633
>> 2004-12-15 502
>> 2004-12-16 487
>> 2004-12-17 536
>> 2004-12-18 255
>>
>> I wrote this in hurry so it may have mistakes.
>>
>> I don't think this will catch default documents. I think they are logged
>> as a folder name (for example /iis/) and without extension. So you may
>> need to modify the query to catch this as well (hint: change the WHERE
>> clause to read NOT IN and exclude the extensions you know are not pages,
>> such as images, pdf, zip-files etc.)
>>
>>
>> --
>> Regards,
>> Kristofer Gafvert
>> http://www.gafvert.info/iis/ - IIS Related Info
>>
>>
>> "Hassan"
>> news:ej2eCJ6RIHA.4880@TK2MSFTNGP03.phx.gbl...
>>> My C-ip is all from a single source ? I think its our load balancer. In
>>> that case, I cant find out unique visitors..
>>>
>>> What column gives me page views ? I have log parser and want to know
>>> what is the query to use ?
>>>
>>> Thanks
>>>
>>> "Kristofer Gafvert"
>>> news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
>>>> You can use the logs....if you save them. I have logs saved from 2005
>>>> and can see how the traffic has changed.
>>>>
>>>> I have an article using log parser how to get this information. It uses
>>>> unique visitors, but you can of course change it to page views if you
>>>> want to.
>>>>
>>>> "Log Parser: Find out how many unique visitors your website has"
>>>> http://www.gafvert.info/notes/log_parser_unique_visitors.htm
>>>>
>>>> Any decent log analyzer can tell your this information as well, using
>>>> the log files.
>>>>
>>>> --
>>>> Regards,
>>>> Kristofer Gafvert
>>>> http://www.gafvert.info/iis/ - IIS Related Info
>>>>
>>>>
>>>> "Hassan"
>>>> news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
>>>>>I know my previous post of pageviews may be part of the answer.. But
>>>>>what im looking for is checking usage of our website.. I'd like to know
>>>>>if we are doing more traffic on a month to month basis and am wondering
>>>>>how can I find them out ? Anything in the Web logs ? If not, anything
>>>>>else I can put in place to capture this info ..
>>>>>
>>>>>
>>>>
>>>
>>
>
On Dec 26, 11:15=A0am, "Kristofer Gafvert"
wrote:
> I have no idea what your load balancer can offer.
>
> For your other question, it depends. One user may have one IP address or
> multiple IP addresses (AOL users for example). One IP address may be one
> user, or multiple users (corporate proxys for example).
>
> Furthermore, a user may not even get the page from your server, but instea=
d
> from a cache somewhere on the Internet. In that case, you have a "visitor"=
> without nothing logged, which you obviously cannot track from the log file=
..
>
> An IP address logged may not even be a user at all, but instead a web spid=
er
> crawling your website.
>
> So basically, one IP address logged can mean:
> - Zero user
> - 1 user
> - Multiple users
>
> One user can be logged as:
> - Nothing in the log at all
> - One IP address
> - Multiple IP addresses
>
> See the problem? There is no good way to determine a physical user. Some l=
og
> analysers claim they can accurately do this, but i doubt. There are howeve=
r
> different methods to try to identify actual users, by not only using the I=
P
> address and excluding web spiders.
>
> This is an interesting publication:
> "Measuring Web Site Usage: Log File Analysis"http://epe.lac-bac.gc.ca/100/=
202/301/netnotes/netnotes-h/notes57.htm
>
> --
> Regards,
> Kristofer Gafverthttp://www.gafvert.info/iis/- IIS Related Info
>
> "Hassan"
2MSFTNGP04.phx.gbl...
>
>
>
> > Thanks Kristofer.
>
> > On a side note, to your earlier message on capturing unique visitors.. s=
o
> > in our case our C-IP is our load balancer.. In that case, how does one
> > figure out unique visitors ? Do you think the load balancers store this
> > info or do we need to scrape some logs from our edge routers or so ?
> > Just curious so I can reach out to the right team to get me that info.
>
> > Btw, when you get the C-IP, is the IP usually from the ISP that hits you=
r
> > site or can you get the actual IP for the home computer of the client ? =
If
> > its the ISP, do you think that if there are a 1000 users that go through=
> > the same ISP, then you will just see it as one unique visitor for those
> > 1000 end users ?
>
> > Thanks
>
> > "Kristofer Gafvert"
> >news:emu6bB7RIHA.3916@TK2MSFTNGP02.phx.gbl...
> >> You need to use the cs-uri-stem and extract the extension. You also nee=
d
> >> to figure out what is a page, and what is not a page. Below, i have
> >> considered htm, html, asp, aspx and php to be pages. You may have anoth=
er
> >> extension that is a page (for example cfm for Cold Fusion pages)
>
> >> The following example should get you started (it may wrap):
> >> C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,
> >> COUNT(*) A
> >> S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE
> >> EXTRACT_EXTENSION(TO_LOWERCASE(c
> >> s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER B=
Y
> >> date"
>
> >> Example output:
> >> 2004-12-14 633
> >> 2004-12-15 502
> >> 2004-12-16 487
> >> 2004-12-17 536
> >> 2004-12-18 255
>
> >> I wrote this in hurry so it may have mistakes.
>
> >> I don't think this will catch default documents. I think they are logge=
d
> >> as a folder name (for example /iis/) and without extension. So you may
> >> need to modify the query to catch this as well (hint: change the WHERE
> >> clause to read NOT IN and exclude the extensions you know are not pages=
,
> >> such as images, pdf, zip-files etc.)
>
> >> --
> >> Regards,
> >> Kristofer Gafvert
> >>http://www.gafvert.info/iis/- IIS Related Info
>
> >> "Hassan"
> >>news:ej2eCJ6RIHA.4880@TK2MSFTNGP03.phx.gbl...
> >>> My C-ip is all from a single source ? I think its our load balancer. =
=A0In
> >>> that case, I cant find out unique visitors..
>
> >>> What column gives me page views ? I have log parser and want to know
> >>> what is the query to use ?
>
> >>> Thanks
>
> >>> "Kristofer Gafvert"
> >>>news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
> >>>> You can use the logs....if you save them. I have logs saved from 2005=
> >>>> and can see how the traffic has changed.
>
> >>>> I have an article using log parser how to get this information. It us=
es
> >>>> unique visitors, but you can of course change it to page views if you=
> >>>> want to.
>
> >>>> "Log Parser: Find out how many unique visitors your website has"
> >>>>http://www.gafvert.info/notes/log_parser_unique_visitors .htm
>
> >>>> Any decent log analyzer can tell your this information as well, using=
> >>>> the log files.
>
> >>>> --
> >>>> Regards,
> >>>> Kristofer Gafvert
> >>>>http://www.gafvert.info/iis/- IIS Related Info
>
> >>>> "Hassan"
> >>>>news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
> >>>>>I know my previous post of pageviews may be part of the answer.. But
> >>>>>what im looking for is checking usage of our website.. I'd like to kn=
ow
> >>>>>if we are doing more traffic on a month to month basis and am wonderi=
ng
> >>>>>how can I find them out ? Anything in the Web logs ? If not, anything=
> >>>>>else I can put in place to capture this info ..- Hide quoted text -
>
> - Show quoted text -
You have to first define "unique visitors". Or find yourself a web
traffic analysis package and use its definition.
As you are noting, using client IP is not exactly reliable since many
network elements between client and server can proxy the request and
mask the true IP. And you may not have control of all the responsible
network elements.
//David
http://w3-4u.blogspot.com
http://blogs.msdn.com/David.Wang
//
On Dec 26, 10:36=A0am, "Hassan"
> Thanks Kristofer.
>
> On a side note, to your earlier message on capturing unique visitors.. so =
in
> our case our C-IP is our load balancer.. In that case, how does one figure=
> out unique visitors ? Do you think the load balancers store this info or d=
o
> we need to scrape some logs from our edge routers or so ?
> Just curious so I can reach out to the right team to get me that info.
>
> Btw, when you get the C-IP, is the IP usually from the ISP that hits your
> site or can you get the actual IP for the home computer of the client ? If=
> its the ISP, do you think that if there are a 1000 users that go through t=
he
> same ISP, then you will just see it as one unique visitor for those 1000 e=
nd
> users ?
>
> Thanks
>
> "Kristofer Gafvert"
>
> news:emu6bB7RIHA.3916@TK2MSFTNGP02.phx.gbl...
>
>
>
> > You need to use the cs-uri-stem and extract the extension. You also need=
> > to figure out what is a page, and what is not a page. Below, i have
> > considered htm, html, asp, aspx and php to be pages. You may have anothe=
r
> > extension that is a page (for example cfm for Cold Fusion pages)
>
> > The following example should get you started (it may wrap):
> > C:\Program Files\IIS Resources\Log Parser 2.2>logparser "SELECT date,
> > COUNT(*) A
> > S Hits FROM 'c:\data\LogFiles\ilopia\ex*' WHERE
> > EXTRACT_EXTENSION(TO_LOWERCASE(c
> > s-uri-stem)) IN ('htm';'html';'asp';'aspx';'php') GROUP BY date ORDER BY=
> > date"
>
> > Example output:
> > 2004-12-14 633
> > 2004-12-15 502
> > 2004-12-16 487
> > 2004-12-17 536
> > 2004-12-18 255
>
> > I wrote this in hurry so it may have mistakes.
>
> > I don't think this will catch default documents. I think they are logged=
> > as a folder name (for example /iis/) and without extension. So you may
> > need to modify the query to catch this as well (hint: change the WHERE
> > clause to read NOT IN and exclude the extensions you know are not pages,=
> > such as images, pdf, zip-files etc.)
>
> > --
> > Regards,
> > Kristofer Gafvert
> >http://www.gafvert.info/iis/- IIS Related Info
>
> > "Hassan"
> >news:ej2eCJ6RIHA.4880@TK2MSFTNGP03.phx.gbl...
> >> My C-ip is all from a single source ? I think its our load balancer. =
=A0In
> >> that case, I cant find out unique visitors..
>
> >> What column gives me page views ? I have log parser and want to know wh=
at
> >> is the query to use ?
>
> >> Thanks
>
> >> "Kristofer Gafvert"
> >>news:eWLpWD6RIHA.4888@TK2MSFTNGP02.phx.gbl...
> >>> You can use the logs....if you save them. I have logs saved from 2005
> >>> and can see how the traffic has changed.
>
> >>> I have an article using log parser how to get this information. It use=
s
> >>> unique visitors, but you can of course change it to page views if you
> >>> want to.
>
> >>> "Log Parser: Find out how many unique visitors your website has"
> >>>http://www.gafvert.info/notes/log_parser_unique_visitors. htm
>
> >>> Any decent log analyzer can tell your this information as well, using
> >>> the log files.
>
> >>> --
> >>> Regards,
> >>> Kristofer Gafvert
> >>>http://www.gafvert.info/iis/- IIS Related Info
>
> >>> "Hassan"
> >>>news:OAX34F5RIHA.1208@TK2MSFTNGP03.phx.gbl...
> >>>>I know my previous post of pageviews may be part of the answer.. But
> >>>>what im looking for is checking usage of our website.. I'd like to kno=
w
> >>>>if we are doing more traffic on a month to month basis and am wonderin=
g
> >>>>how can I find them out ? Anything in the Web logs ? If not, anything
> >>>>else I can put in place to capture this info ..- Hide quoted text -
>
> - Show quoted text -