<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Statistics on Noetic Nought</title>
    <link>https://punchagan.muse-amuse.in/tags/statistics/</link>
    <description>Recent content in Statistics on Noetic Nought</description>
    <generator>Hugo</generator>
    <language>en-US</language>
    <copyright>© 2006-2026 CC-BY-SA-4.0</copyright>
    <lastBuildDate>Tue, 06 Nov 2018 21:47:00 +0530</lastBuildDate>
    <atom:link href="https://punchagan.muse-amuse.in/tags/statistics/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Goodbye Google Analytics</title>
      <link>https://punchagan.muse-amuse.in/blog/goodbye-google-analytics/</link>
      <pubDate>Tue, 06 Nov 2018 21:47:00 +0530</pubDate>
      <guid>https://punchagan.muse-amuse.in/blog/goodbye-google-analytics/</guid>
      <description>&lt;p&gt;TL; DR: My blog no longer has Google Analytics. And I&amp;rsquo;m happy about it.&lt;/p&gt;&#xA;&lt;h2 id=&#34;why-i-had-it&#34;&gt;Why I had it?&lt;/h2&gt;&#xA;&lt;p&gt;I&amp;rsquo;ve been using Google Analytics for many years now - ever since I moved to a&#xA;static blog, from WordPress. WordPress had &lt;a href=&#34;https://en.support.wordpress.com/stats/&#34;&gt;built-in analytics&lt;/a&gt;, and it seemed&#xA;natural to me to have analytics on the static site too, after using WP for a&#xA;couple of years or so.&lt;/p&gt;&#xA;&lt;p&gt;I checked the analytics only once in a while, But, I did find it encouraging and&#xA;sometimes amusing to see where and how people ended up on my blog. Especially&#xA;so, when a post became popular.&lt;/p&gt;&#xA;&lt;h2 id=&#34;why-i-removed-it&#34;&gt;Why I removed it?&lt;/h2&gt;&#xA;&lt;p&gt;A few months ago, around the time when we were all &lt;a href=&#34;https://en.wikipedia.org/wiki/General%5FData%5FProtection%5FRegulation#Timeline&#34;&gt;bombarded by GDPR related&#xA;policy change announcements&lt;/a&gt; from random services we signed up to and forgot&#xA;about, I decided to remove Google Analytics on my blog.&lt;/p&gt;&#xA;&lt;p&gt;I also received an email from Google Analytics, listing a bunch of changes I&amp;rsquo;d&#xA;need to make to how I use anlaytics, to be GDPR compliant. That made me&#xA;reconsider if it was worth having analytics on my site.&lt;/p&gt;&#xA;&lt;p&gt;I use &lt;a href=&#34;https://www.ghostery.com/&#34;&gt;Ghostery&lt;/a&gt; and other such tools to minimize how much people are able to&#xA;track me. It feels better to not have the same kind of analytics that I&amp;rsquo;m averse&#xA;to, on my blog.&lt;/p&gt;&#xA;&lt;p&gt;Also, about half the people who read my blog likely don&amp;rsquo;t like analytics, and&#xA;are &lt;a href=&#34;http://blog.wesleyac.com/posts/google-analytics&#34;&gt;probably blocking&lt;/a&gt; it. Considering how little I used the analytics, I just&#xA;didn&amp;rsquo;t see a point in keeping it running.&lt;/p&gt;&#xA;&lt;h2 id=&#34;but-what-about-the-useful-stats&#34;&gt;But what about the useful stats?&lt;/h2&gt;&#xA;&lt;p&gt;My blog doesn&amp;rsquo;t get too many visits &amp;ndash; only a few dozen people every week &amp;ndash;&#xA;mostly my friends or acquaintances. There&amp;rsquo;s not as much going on, to find&#xA;anything super interesting in the stats.&lt;/p&gt;&#xA;&lt;p&gt;Nevertheless, it is sometimes interesting to see where people end-up coming to&#xA;my blog from. And &lt;a href=&#34;https://punchagan.muse-amuse.in/blog/a-smarter-404-page/&#34;&gt;on one occasion&lt;/a&gt;, I found a broken link to a blog post of mine&#xA;which was sending a significant number of people to my blog. I fixed that, and&#xA;also added a 404 page with helpful suggestions.&lt;/p&gt;&#xA;&lt;p&gt;I have the proxy of interactions on twitter or texts/emails from friends, to&#xA;gauge how interesting a post was. But, it&amp;rsquo;s useful to have some kind of&#xA;analytics to gauge the interest and reading patterns of older posts.&lt;/p&gt;&#xA;&lt;p&gt;Given this, and the fact that I&amp;rsquo;ve recently been intrigued by &lt;a href=&#34;https://www.rust-lang.org/en-US/&#34;&gt;Rust&lt;/a&gt; and want to&#xA;learn it, I&amp;rsquo;ve started writing a &lt;a href=&#34;https://github.com/punchagan/weblogviz&#34;&gt;small Apache log analyzer in Rust&lt;/a&gt;. It&amp;rsquo;s just a&#xA;toy, as of now. &lt;a href=&#34;https://goaccess.io/&#34;&gt;goaccess&lt;/a&gt; is a nice &amp;ldquo;real-time&amp;rdquo; log analyzer that gives some&#xA;useful stats.&lt;/p&gt;&#xA;&lt;hr&gt;&#xA;&lt;p&gt;Thanks &lt;a href=&#34;http://baali.muse-amuse.in/&#34;&gt;Shantanu Choudhary&lt;/a&gt; for prompting me to&#xA;write this post, reading a draft of this, and giving helpful suggestions to make&#xA;it better.&lt;/p&gt;&#xA;</description>
    </item>
    <item>
      <title>Google Trends, Clickbaits, and PV Sindhu</title>
      <link>https://punchagan.muse-amuse.in/blog/google-trends-clickbaits-and-pv-sindhu/</link>
      <pubDate>Sat, 20 Aug 2016 22:59:13 +0530</pubDate>
      <guid>https://punchagan.muse-amuse.in/blog/google-trends-clickbaits-and-pv-sindhu/</guid>
      <description>&lt;p&gt;TL;DR&lt;/p&gt;&#xA;&lt;ol&gt;&#xA;&lt;li&gt;&#xA;&lt;p&gt;Am I saying India doesn&amp;rsquo;t have a caste problem?&lt;/p&gt;&#xA;&lt;p&gt;No, it&amp;rsquo;s definitely a HUGE problem!&lt;/p&gt;&#xA;&lt;/li&gt;&#xA;&lt;li&gt;&#xA;&lt;p&gt;Are these articles on Google Trends and Sindhu&amp;rsquo;s caste useful at all?&lt;/p&gt;&#xA;&lt;p&gt;Just more click-baits and no useful contribution to the discussion on caste.&lt;/p&gt;&#xA;&lt;/li&gt;&#xA;&lt;/ol&gt;&#xA;&lt;hr&gt;&#xA;&lt;p&gt;First of all, congratulations to PV Sindhu on making it to the finals and&#xA;giving the world number one a hard fight!&lt;/p&gt;&#xA;&lt;p&gt;This post, though, is not a celebratory one.  I read &lt;a href=&#34;http://www.thenewsminute.com/article/while-pv-sindhu-fought-hard-medal-many-indians-googled-her-caste-48545&#34;&gt;this article&lt;/a&gt; &amp;ndash; While PV&#xA;Sindhu fought hard for a medal, many Indians googled her caste &amp;ndash; by the News&#xA;Minute thanks to a &lt;a href=&#34;https://twitter.com/tmkrishna/status/766844023810117632&#34;&gt;re-tweet by TM Krishna&lt;/a&gt;.  I probably wouldn&amp;rsquo;t have paid much&#xA;attention to it, if not for the retweet by TMK.&lt;/p&gt;&#xA;&lt;p&gt;Caste is a huge problem for the country, and if you still like to pretend it&#xA;isn&amp;rsquo;t &amp;ndash; read &lt;a href=&#34;http://www.firstpost.com/india/from-gujarat-to-gurugram-atrocities-on-dalits-rise-even-as-their-protests-continue-2960548.html&#34;&gt;this&lt;/a&gt; for a start.  I&amp;rsquo;m not surprised that &lt;strong&gt;some&lt;/strong&gt; people searched&#xA;for Sindhu&amp;rsquo;s caste while she was battling it out at Rio.  But, &lt;strong&gt;some&lt;/strong&gt; people&#xA;also searched for Badminton rules, and others for Sania Mirza!  What surprises&#xA;me is that the article doesn&amp;rsquo;t try to put the data in a context at all.  Nor do&#xA;I understand the contribution this article makes to the discussion on caste.&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c5.staticflickr.com/9/8541/28818616900%5Fd8e2b33cb0%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;I played around a little more with these search terms and Google Trends, and&#xA;here are a few things that I thought were worth sharing.&lt;/p&gt;&#xA;&lt;h2 id=&#34;indian-trends&#34;&gt;Indian trends&lt;/h2&gt;&#xA;&lt;p&gt;First of all, the article says &amp;ldquo;Many Indians&amp;rdquo;, and gives off cumulative&#xA;month-wise numbers (&lt;strong&gt;UPDATE &lt;span class=&#34;timestamp-wrapper&#34;&gt;&lt;span class=&#34;timestamp&#34;&gt;[2016-08-21 Sun 12:15]&lt;/span&gt;&lt;/span&gt;&lt;/strong&gt;: which are so wrong! See&#xA;Sankrant Sanu&amp;rsquo;s &lt;a href=&#34;http://indiafacts.org/lie-graphs-newsminute/&#34;&gt;excellent article&lt;/a&gt; on India Facts).  But, what does it really&#xA;mean?&lt;/p&gt;&#xA;&lt;p&gt;I don&amp;rsquo;t know if anybody actually wrote about how many people actually followed&#xA;the match, but Sindhu actually managed to get a whole lot of people interested!&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c2.staticflickr.com/9/8014/29105184025%5F777ac4e5d0%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;More people searched for PV Sindhu than the daily average number of searches&#xA;(not hits) for Facebook and very close to the daily number of searches for Porn&#xA;&amp;ndash; two of the biggest things Internet is allegedly used for.  Can you see the&#xA;red line at the bottom?  That is the number of people who actually searched for&#xA;Sindhu&amp;rsquo;s caste &amp;ndash; a tiny blip.&lt;/p&gt;&#xA;&lt;p&gt;Let&amp;rsquo;s take a closer look.  Here&amp;rsquo;s a plot of some of the other auto suggest&#xA;terms + badminton rules &amp;amp; courts compared to Sindhu&amp;rsquo;s name.&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c7.staticflickr.com/9/8507/28818617070%5F9c9fdfeb12%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;Nothing other than badminton rules (which is at about 1% of max. searches) is&#xA;even visible, clearly.&lt;/p&gt;&#xA;&lt;p&gt;So, these other terms (wiki &amp;amp; caste being auto-suggested ones) are nowhere near&#xA;the actual number of searches being made for PV Sindhu&amp;rsquo;s name alone.&lt;/p&gt;&#xA;&lt;p&gt;Let&amp;rsquo;s get rid of the name graph to get a closer look at the other terms.&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c6.staticflickr.com/9/8191/29105184165%5F133734e300%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;&#xA;&lt;p&gt;The maximum number of people searching for Sindhu&amp;rsquo;s caste is at about a fifth&#xA;of the maximum number of people searching for badminton rules.  Interpreting&#xA;it is upto you.  But, I&amp;rsquo;m not surprised knowing how significant caste has&#xA;been in our society.  Also, notice that searches for wiki and caste fall off&#xA;more gradually than the searches for the rules which peak while the game is&#xA;being played and watched.&lt;/p&gt;&#xA;&lt;/li&gt;&#xA;&lt;li&gt;&#xA;&lt;p&gt;Unsurprisingly, a bulk of the searches appear to be coming from Andhra and&#xA;Telangana. Notice that the other states are searching more for the rules or&#xA;her wiki page.&lt;/p&gt;&#xA;&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c8.staticflickr.com/9/8169/29105184295%5Ff3e1448d10%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;Do you notice that the red (caste), blue (wiki) and violet (images) lines&#xA;following a similar trend, until the last few hours?  What do you think is&#xA;happening there? It&amp;rsquo;s the shitty click baits working!  Look at the trends from&#xA;~8:30AM to ~12:30AM below &amp;ndash; the red has spread to other states as well!&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c6.staticflickr.com/9/8049/29105184245%5F6e691d318d%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;ul&gt;&#xA;&lt;li&gt;And this is how it looks by the evening (17:00-21:00).  Well done, folks!&#xA;The click bait articles totally succeeded!&lt;/li&gt;&#xA;&lt;/ul&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c4.staticflickr.com/9/8144/29032147971%5Fc9c3c13fdc%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;If you are wondering how much effect the auto suggestions are having in&#xA;suggesting people to try searching for caste, I don&amp;rsquo;t think that is much&#xA;because wiki and images are the other auto-suggest terms, with no such surges&#xA;in the number of searches.&lt;/p&gt;&#xA;&lt;h2 id=&#34;trends-from-the-telugu-states&#34;&gt;Trends from the Telugu states&lt;/h2&gt;&#xA;&lt;p&gt;We could see that the two Telugu states were more worried about the caste, than&#xA;the rest of the country.  Let&amp;rsquo;s see how abnormal they are.&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c8.staticflickr.com/9/8293/29105183935%5F5bc55c03b4%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c3.staticflickr.com/9/8395/28483785994%5F89f1c999e4%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;You can definitely see the red line more prominently.  In case of Andhra the&#xA;peak searches for caste are at about 5% of the name searches.  A statistically&#xA;significant difference from the rest of the country.&lt;/p&gt;&#xA;&lt;p&gt;Let&amp;rsquo;s zoom in at the auto-suggest terms alone.&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c7.staticflickr.com/9/8317/28818617430%5Fbca8ed9d1a%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c4.staticflickr.com/9/8265/29105184115%5Fa0a8e34f4b%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;Woah, Andhra is definitely quite an aberration from the rest of the country.&#xA;From about 1/5th of the maximum number of searches for rules, the maximum&#xA;number of caste searches jumps to about twice.  Telangana also is different,&#xA;but much less so.&lt;/p&gt;&#xA;&lt;p&gt;Tamil Nadu&amp;rsquo;s trends below for comparison.  You can&amp;rsquo;t help noticing the last few&#xA;hours, can you?&lt;/p&gt;&#xA;&lt;figure&gt;&lt;img src=&#34;https://c3.staticflickr.com/9/8426/28818617290%5Feb4b3a2535%5Fb.jpg&#34;&gt;&#xA;&lt;/figure&gt;&#xA;&#xA;&lt;p&gt;&lt;strong&gt;NOTE&lt;/strong&gt;: The trends and screen-shots for the states are slightly more recent&#xA;than the others.&lt;/p&gt;&#xA;&lt;h2 id=&#34;conclusion&#34;&gt;Conclusion&lt;/h2&gt;&#xA;&lt;p&gt;Without a context, I don&amp;rsquo;t really see the point of these &amp;ldquo;news&amp;rdquo; articles.  It&#xA;seems more click-bait-y than useful to me.&lt;/p&gt;&#xA;&lt;p&gt;If you still feel &lt;strong&gt;many&lt;/strong&gt; Indians were searching for Sindhu&amp;rsquo;s caste, while she&#xA;was fighting it out, go ahead and play with Google trends &lt;a href=&#34;https://www.google.com/trends/explore?date=now%25207-d&amp;amp;geo=IN&amp;amp;q=pv%2520sindhu,pv%2520sindhu%2520caste,porn,movies&#34;&gt;here&lt;/a&gt;.  Add/remove&#xA;terms, change the time and location filters.  Some terms that could be&#xA;interesting to add to the comparison are: Kashmir, Independence day, Facebook.&lt;/p&gt;&#xA;&lt;p&gt;Later, I looked at the search results and then found that this article wasn&amp;rsquo;t&#xA;the only one like it.  I didn&amp;rsquo;t bother to read the others, but I really hope at&#xA;least some of them are talking sense.  Is any of them really trying to&#xA;contribute to the discussion on caste, meaningfully?&lt;/p&gt;&#xA;&lt;p&gt;Also, the actual search results don&amp;rsquo;t seem to give useful answers to the folks&#xA;so curious about Sindhu&amp;rsquo;s caste.  I hope none of these articles are trying to&#xA;help them out.&lt;/p&gt;&#xA;&lt;p&gt;Finally, if you are using Google Trends to write an article, &lt;a href=&#34;https://medium.com/@dannypage/stop-using-google-trends-a5014dd32588#.js332qw0h&#34;&gt;Danny Page has&#xA;some really good advice&lt;/a&gt;.&lt;/p&gt;&#xA;&lt;hr&gt;&#xA;&lt;p&gt;Thanks to &lt;a href=&#34;https://twitter.com/kamalx&#34;&gt;Kamal&lt;/a&gt;, &lt;a href=&#34;https://twitter.com/baali%5F&#34;&gt;baali&lt;/a&gt; and &lt;a href=&#34;https://twitter.com/cloud9trt&#34;&gt;9&lt;/a&gt; for reading and reviewing drafts of this.  Errors&#xA;mine, obviously.&lt;/p&gt;&#xA;</description>
    </item>
  </channel>
</rss>
