Disturbing Secrets Found On Exxon Mobil's Official Website—You Won't Believe This!

Contents

Have you ever wondered what really goes on behind the scenes of a massive corporate website? The kind of digital footprints, visitor patterns, and hidden data streams that tell a story far beyond the polished public face? While we can't access Exxon Mobil's private analytics, the tools to uncover these "disturbing secrets" on your own website are freely available and surprisingly powerful. The key lies in mastering a robust, open-source analytics engine that sifts through raw server logs to reveal everything from suspicious bot traffic to genuine user engagement. This guide will walk you through installing and configuring one of the most potent tools in the server admin's toolkit: AWStats.

What Exactly is AWStats? The Powerhouse Behind the Numbers

AWStats (Advanced Web Statistics) is a powerful, open-source web analytics reporting tool that generates advanced web, streaming media, mail, and FTP server statistics, graphically. Unlike client-side analytics (like Google Analytics), AWStats analyzes the raw log files your server produces for every single request. This means it tracks everything—every visit, every file downloaded, every email sent through your server, and every FTP transfer—with 100% accuracy, as it's based on immutable server data.

It’s a free and open-source software solution that parses log files in various formats and presents the data in a comprehensive, easy-to-read set of HTML reports. Because it runs on your server and processes logs directly, it’s incredibly detailed, privacy-focused (no third-party data sharing), and is the go-to choice for many web hosting providers who need to offer statistical reports to their customers. It provides insights into visitor countries, browsers, operating systems, search engine keywords, most downloaded files, and even attack patterns.

Why Web Hosting Providers Swear By AWStats

For companies that host thousands of websites, providing detailed analytics to each customer is a massive challenge. AWStats solves this elegantly. Its design allows a single installation to generate separate, secure reports for each domain hosted on a server by simply pointing it to the correct log file. It’s resource-efficient, highly customizable, and generates static HTML reports that can be cached and served quickly without taxing the database. This makes it a cost-effective, scalable, and reliable solution for the hosting industry, giving their clients deep insights without the recurring costs or privacy concerns of SaaS analytics platforms.

Installing AWStats on Ubuntu 18.04 with Apache: A Complete Tutorial

Now, let’s get our hands dirty. In this tutorial, we will learn how to install AWStats on an Ubuntu 18.04 server with a web server Apache. This is a common and practical setup for VPS and dedicated servers.

Prerequisites and Initial Setup

Before you begin, ensure you have:

  1. An Ubuntu 18.04 server with a non-root sudo user.
  2. Apache2 web server installed and running (sudo systemctl status apache2).
  3. Access to your Apache access and error logs. By default, these are typically located at /var/log/apache2/access.log and /var/log/apache2/error.log.

First, update your package list and install AWStats from Ubuntu's repositories:

sudo apt update sudo apt install awstats 

This installs the core AWStats scripts and configuration files. The main configuration directory is /etc/awstats/.

Configuring AWStats for Your Website

The critical step is creating a configuration file for your specific site. AWStats uses a naming convention: awstats.[yourdomain].conf.

  1. Copy the sample configuration:

    sudo cp /etc/awstats/awstats.conf.local /etc/awstats/awstats.yourdomain.com.conf 

    Replace yourdomain.com with your actual domain name.

  2. Edit the configuration file:

    sudo nano /etc/awstats/awstats.yourdomain.com.conf 

    You must adjust several key directives:

    • LogFile: Set this to the path of your Apache access log. For a default Ubuntu Apache setup, it's usually /var/log/apache2/access.log. If you have multiple virtual hosts, you might need to point to a specific virtual host's log file.
    • LogFormat: For standard Apache combined logs, this should be 1. (We'll cover FTP later).
    • SiteDomain: Set this to your domain name (e.g., "yourdomain.com").
    • HostAliases: Add any aliases like www.yourdomain.com or the server's IP address.
    • AllowToUpdateStatsFromBrowser: This is a crucial security/functionality setting. It should be set to AllowToUpdateStatsFromBrowser=1 if you want to be able to update the stats via the web interface button. For production security, it's often better to set this to 0 and update stats only via cron.
  3. Set proper permissions: The web server user (www-data on Ubuntu) needs read access to the log file and write access to the directory where the AWStats data files will be stored (usually /var/lib/awstats/).

    sudo chown www-data:www-data /var/lib/awstats/ sudo chmod 755 /var/lib/awstats/ 

Integrating AWStats with Apache

To access your stats at http://yourdomain.com/awstats/, you need an Apache configuration.

  1. Enable the AWStats Apache configuration (it's installed with the package):

    sudo a2enconf awstats sudo systemctl reload apache2 

    This creates an alias at /awstats/ that points to the AWStats CGI scripts.

  2. For enhanced security, it's better to protect the AWStats interface with HTTP authentication. The package provides a helper script:

    sudo /usr/share/doc/awstats/examples/awstats_configure.pl 

    This interactive script can help set up password protection. Alternatively, you can manually create a .htpasswd file and configure Apache's awstats.conf to require authentication.

Building Your First Statistics Report

After configuration, you must build the initial report from your existing log file. Run the AWStats build script for your config:

sudo /usr/lib/cgi-bin/awstats.pl -config=yourdomain.com -update 

You should see output indicating it's processing the log file. Once complete, you can view your report by navigating to http://yourdomain.com/cgi-bin/awstats.pl?config=yourdomain.com (or the protected /awstats/ path if you set up auth).

To keep your stats current, you must set up a cron job to run this update command regularly (e.g., daily). This is the standard, recommended method over using the browser update button.

How to Read AWStats Reports: Decoding Your Website's Story

Welcome to the world of owning a website! One of the things that both newbie and even ‘old time’ website owners get overwhelmed by is their analytics data. AWStats reports are dense with information. Here’s how to navigate them:

  • Summary (Month): The first page is your dashboard. Focus on:
    • Unique visitors: Approximate number of distinct people.
    • Visits: Total number of sessions (a visitor can have multiple visits).
    • Pages: Total pages viewed.
    • Hits: Total file requests (images, CSS, JS all count as hits). This number is always the largest.
    • Bandwidth: Data transferred. Crucial for understanding server load.
  • General Stats: Look at Countries to see your audience geography. The OSs and Browsers sections tell you what devices people use.
  • Hourly/Daily/Monthly Graphs: Identify traffic patterns. Do you get a spike at 9 AM? A weekend lull?
  • Pages-URL: See your most popular content. This is gold for content strategy.
  • Keywords: The search engine queries that brought people to your site. This reveals what content ranks and what users are seeking.
  • Errors: This is a critical section. 404 errors show broken links. 403 errors might indicate access problems or malicious scanning. A high number of errors for specific files can point to a misconfiguration or an attack.

Start with the Summary, then drill down into the sections that answer your current business questions (e.g., "Is my new blog post popular?" check Pages-URL; "Where is my traffic from?" check Countries).

Essential Configuration Tweaks and Advanced Setup

The Critical AllowToUpdateStatsFromBrowser Setting

As mentioned in your configuration file, the directive AllowToUpdateStatsFromBrowser controls whether a user can click the "Update" button in the web interface. If it's not set correctly, the button will be greyed out or non-functional. If not, edit the file and save it, then rebuild your stats from the command line. For security on a public-facing site, always set this to 0 and rely solely on cron jobs for updates. Leaving it as 1 could allow unauthorized users to trigger resource-intensive updates.

Configuring AWStats for FTP and Other Services

Installation is just the same for web statistics except for AWStats configuration where LogType is F (stand for FTP) and LogFormat based on your FTP log format. This is a powerful feature.

  1. To analyze FTP logs, create a new config file, e.g., awstats.ftp.yourdomain.com.conf.
  2. Set LogType=F.
  3. The LogFormat depends on your FTP server's log format. For vsftpd (a common FTP server), the default format is often 3. For ProFTPD, it might be 2. You must check your FTP server's documentation to match the log format string. An incorrect LogFormat will result in garbled or empty statistics.
  4. Point LogFile to your FTP server's log (e.g., /var/log/vsftpd.log or /var/log/proftpd/proftpd.log).
  5. Build the stats with the -config=ftp.yourdomain.com flag.

You can repeat this process for mail server logs (LogType=M) or streaming media logs, making AWStats a unified reporting dashboard for all your server services.

Troubleshooting Common Issues

  • "Not enough data" or empty reports: Your LogFile path is wrong, or the log file doesn't exist/has wrong permissions. Verify the path and that the www-data user can read it.
  • Missing or "Unknown" browser/OS data: Your LogFormat setting is incorrect for your Apache log format. The default 1 is for the "combined" log format. If you use a custom format, you must define it in the config.
  • Stats not updating: Check your cron job. Is it running? Does it have the correct path (/usr/lib/cgi-bin/awstats.pl)? Check the cron logs (/var/log/syslog).
  • High server load during update: Your log file is enormous. Consider using the -LogFile= parameter with a specific date range or, better yet, configure AWStats to process logs incrementally (it does this by default with its database files). Ensure you are not running the update too frequently via cron.

Conclusion: Your Server's Diary is Waiting

AWStats is not a flashy, real-time dashboard. It is a meticulous archaeologist of your server's activity. By installing and configuring it on your Ubuntu 18.04 Apache server, you gain unfiltered, 100% accurate access to the raw story of your website's traffic, your FTP server's usage, and your mail server's activity. The "disturbing secrets" might be a sudden surge of malicious bots, a broken link causing hundreds of 404s, or the discovery that a single piece of content is your undisputed traffic magnet.

The power is in the details. Take the time to set it up correctly—paying special attention to log paths, formats, and the AllowToUpdateStatsFromBrowser security setting. Schedule those cron jobs. Then, dive into the reports. The insights you uncover will inform your security hardening, your content strategy, your server resource planning, and your overall understanding of your digital presence in a way that no sampled, client-side tool ever can. Your server's diary is open. Start reading.

disturbing_secrets
Exxon Mobil Logo - LogoDix
Most Disturbing Government Secrets Ever Revealed | Others
Sticky Ad Space