SSW v6.3.0

Notes

• See SSW v6.2.0 and SSW v6.2.1 releases for additional notes.

Changes:

• [AB-116]: Added MinVisitTimeout for human visits

SSW v6.2.1

Notes

• See SSW v6.2.0 release for additional notes.

Changes:

• [BUG] JSON output is erroneously encoded as JavaScript
• [BUG] JSON output for monthly usage has an erroneous comma (github.com/YasuhiroABE)
• [BUG] Percentages for some transfer amounts are computed incorrectly as zeros (github.com/YasuhiroABE)

SSW v6.2.0

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• The predefined user agent argument filters have been removed in this release. Those filters were used if there were no user-provided user agent supplied with ExcludeAgentArgs. If this affects your configuration, you can add the same filters manually into your configuration. See this source file for a list of predefined filters for each mangle agent level (search for add_def_ua_filters).

  https://github.com/StoneStepsInc/StoneStepsWebalizer/blob/v6-1-0/src/config.cpp

• The predefined list of search engine strings has been removed in this release. Those strings were used if there were no user-provided search arguments supplied via SearchEngine. If this affects your configuration, you can add the same filters manually into your configuration. See this source file for a list of predefined filters for each mangle agent level (search for add_def_srch_list).

  https://github.com/StoneStepsInc/StoneStepsWebalizer/blob/v6-1-0/src/config.cpp

  Note that most search engines today drop their arguments from referrers, so most of the time there will be no search strings report in the first place.

• Due to the changes described above and slightly changed logic behind MangleAgents, avoid deploying this release in the middle of the monthly log processing cycle, so user agents are not grouped arbitrarily.

• Stone Steps Webalizer v4, v5 and v6 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. using --prepare-report and without reprocessing all log files for that month).

• Visual Studio 2019 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://aka.ms/vs/16/release/VC_redist.x64.exe
  https://aka.ms/vs/16/release/VC_redist.x86.exe

Changes:

• [AB-103] Added an Nginx log parser and NginxLogFormat configuration variable
• [AB-105] User agent URL tokens are filtered out at the highest MangleAgents level
• [AB-106] Removed all default user agent argument filters
• [AB-107] Removed all default search engine arguments
• [BUG][AB-104] First character in user agents is dropped when all filters are empty
• Increased font sizes in reports by 2-3 points in a few places
• [BUG][AB-70] Fixed stale city/ASN counts, country pages between months
• [BUG] Fixed malformed language files (Danish, Dutch, Estonian, Hungarian, Indonesian, Turkish)

SSW v6.1.1

Notes

• See SSW v6.1.0 release for additional notes.

Changes

• [BUG][AB-70] Fixed stale city/ASN counts, country pages between months
• [BUG] Fixed malformed language files (Danish, Dutch, Estonian, Hungarian, Indonesian, Turkish)

SSW v6.1.0

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• If you are running SSW using only a GeoIP database (i.e. without a DNS cache database), you can ignore this note. City names stored in existing DNS cache databases will not appear in the city report because they are missing GeoName entries in addition to city names. For a full city report you need to delete any DNS cache database produced by a SSW prior to v5.0.1.

• Since v4.2.0 transfer amounts will be rendered in human-readable format by default. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4, v5 and v6 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. using --prepare-report and without reprocessing all log files for that month).

• Visual Studio 2019 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://aka.ms/vs/16/release/VC_redist.x64.exe
  https://aka.ms/vs/16/release/VC_redist.x86.exe

• Download new GeoIP city, country and ASN databases at either of these locations:

  http://dev.maxmind.com/geoip/geoip2/geolite2/

  Note that since December 2019 MaxMind requires users to create an account in order to download these databases. See this page for more details:

  https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing-and-using-geolite2-databases/

Changes:

• [AB-62] Implemented JSON output for Mongo DB imports
• [AB-46] Added install/uninstall targets to Makefile
• [BUG][AB-61] Fixed "Nodes must be linserted in the ascending time stamp order" error

SSW v6.0.1

Notes

• See SSW v6.0.0 release for additional notes.

Changes

• [BUG][AB-61] Fixed "Nodes must be linserted in the ascending time stamp order" error

SSW v6.0.0

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• If you are running SSW using only a GeoIP database (i.e. without a DNS cache database), you can ignore this note. City names stored in existing DNS cache databases will not appear in the city report because they are missing GeoName entries in addition to city names. For a full city report you need to delete any DNS cache database produced by a SSW prior to v5.0.1.

• Since v4.2.0 transfer amounts will be rendered in human-readable format by default. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4, v5 and v6 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. using --prepare-report and without reprocessing all log files for that month).

• Visual Studio 2019 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://aka.ms/vs/16/release/VC_redist.x64.exe
  https://aka.ms/vs/16/release/VC_redist.x86.exe

• Download new GeoIP city, country and ASN databases at either of these locations:

  http://dev.maxmind.com/geoip/geoip2/geolite2/

  Note that since December 2019 MaxMind requires users to create an account in order to download these databases. See this page for more details:

  https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing-and-using-geolite2-databases/

Changes

• Implemented PageTitle configuration variable for associating URL patterns with page titles
• [BB-20] Added Autonomous System columns to relevant reports and added a top AS organizations report
• BUG: [BB-22]: Fixed unknown cities and countries not appearing in the city report

SSW v5.0.1

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• If you are running SSW using only a GeoIP database (i.e. without a DNS cache database), you can ignore this note. City names stored in existing DNS cache databases will not appear in the city report because they are missing GeoName entries in addition to city names. For a full city report you need to delete any DNS cache database produced by a SSW prior to v5.0.1.

• Since v4.2.0 the default transfer amounts will be rendered in human-readable format by default. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4 and v5 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. using --prepare-report and without reprocessing all log files for that month).

• Visual Studio 2015-2019 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://aka.ms/vs/16/release/VC_redist.x64.exe
  https://aka.ms/vs/16/release/VC_redist.x86.exe

• Download new GeoIP city and country databases at either of these locations:

  http://www.maxmind.com/app/geoip_country
  http://dev.maxmind.com/geoip/geoip2/geolite2/

Changes

• BUG: [BB-21] Fixed a bug causing DNS cache hit ratio always being zero

SSW v5.0.0

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• If you are running SSW using only a GeoIP database (i.e. without a DNS cache database), you can ignore this note. City names stored in existing DNS cache databases will not appear in the city report because they are missing GeoName entries in addition to city names. For a full city report you need to delete any DNS cache database produced by a SSW prior to v5.0.1.

• Since v4.2.0 the default transfer amounts will be rendered in human-readable format by default. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4 and v5 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. using --prepare-report and without reprocessing all log files for that month).

• Visual Studio 2015-2019 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://aka.ms/vs/16/release/VC_redist.x64.exe
  https://aka.ms/vs/16/release/VC_redist.x86.exe

• Download new GeoIP city and country databases at either of these locations:

  http://www.maxmind.com/app/geoip_country
  http://dev.maxmind.com/geoip/geoip2/geolite2/

Changes

Bugs

• BUG: [BB-8] Command line options now take precedence over default configuration file options
• BUG: [BB-8] Only one set of log file names from a single source is accepted for processing
• BUG: [BB-19]: Worked around a bug in Highcharts that misinterprets axis min setting
• BUG: [BB-6] UseHTTPS is ignored when processing CLF logs other log types without a port number
• BUG: [BB-5] Adjust log record time stamp only if its time zone setting doesn't match that in the configuration
• BUG: [BB-4] Fixed a bug causing history being wiped out if there is no state database
• BUG: [BB-10] Fixed a lock-up within Berkeley DB in the DNS resolver
• BUG: Fixed a crash caused by a failure to restore from a state database
• BUG: Fixed a crash caused by --end-month used without a current state database
• BUG: Fixed a bug causing Ctrl-C to be ignored
• BUG: Fixed a bug causing city names lost for some hosts restored from the database for previous runs
• BUG: Country Code appears instead of Country in some report headings
• BUG: Fixed erroneous message "DNS resolver is not initialized" shown when maintenance commands were being processed
• BUG: Fixed a bug preventing malformed URLs containing Latin1 characters from being converted to lower case
• BUG: Fixed a bug that was binding Country Code instead of Country to the country heading
• BUG: Added missing ``HTMLJsPath to README
• [JS Charts][BUG]: When mouse hovered over Transfer columns, transfer amount was not shown or was not in the human-readable format

Changes

• [BB-9] Unrecoverable run time errors and reported to the standard error stream, cannot be suppressed and exit process with an error
• [BB-7]: Changed the exit code from failure (1) to success (0) when no valid records were found
• Removed MemoryMode and related settings and changed the application to balance between the state database and memory
• Changed exit code for --version --warranty and --help to return 0 (zero) instead of 1 (one) to facilitate scripting
• Prevented custom BODY and DOCTYPE tags to ensure JavaScript report initialization is performed
• Changed how HTMLPre, HTMLBody, HTMLPost, HTMLEnd are processed (e.g. some are moved in the report); see README
• Changed the country tab-delimited file name prefix from ctry_* to country_*

New Features

• [BB-15]: Implemented HideGroupedItems for selective item grouping/hiding
• [BB-11] Added a top N cities report and a tab-delimited list of cities
• Added new HTTP status codes
• Added a tab-delimited country report
• Added a log file number to the error message reporting a bad record
• Reduced memory consumption caused by late ending of visits when running in the database mode
• [Windows] Changed Visual Studio projects to use Nuget packages for 3rd-party libraries
• [Windows] Updated MaxMind DB, ZLib and berkeley DB to their latest versions
• [JS Charts] Updated the Highcharts version from 4.2 to 7.0

SSW v4.3.6

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

See Working with JavaScript Charts for more information about JavaScript charts.

Notes

• Since v4.2.0 the default transfer amounts will be rendered in human-readable format by default. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. without reprocessing all log files for that month).

• Visual Studio 2017 redistributable package may need to be installed prior to running Windows binaries. Run webalizer -v to check if the application can be launched and if you see any errors, download x86 or x64 package at this location:

  https://support.microsoft.com/en-ca/help/2977003/the-latest-supported-visual-c-downloads

• Download new GeoIP city and country databases at either of these locations:

  http://www.maxmind.com/app/geoip_country
  http://dev.maxmind.com/geoip/geoip2/geolite2/

Changes

4.3.6

• BUG: Fixed a bug in the database mode configuration that caused very poor performance
• BUG: Fixed a bug causing Ctrl-C to be ignored

4.3.5

• BUG: Fixed a bug stopping log processing with a "Bad character buffer" message

4.3.4

• [Linux] Fixed an issue in Makefile that caused build errors on Ubuntu

4.3.3

• BUG: [BB-10] Fixed a bug causing random lock-ups in Berkeley DB in the DNS resolver

v4.3.2

• BUG: [BB-6]: UseHTTPS is ignored when processing CLF and Apache logs without a port number

v4.3.1

• BUG: [BB-5] Adjust log record time stamp only if its time zone setting doesn't match that in the configuration
• BUG: [BB-4] Fixed a bug causing history being wiped out if there is no state database

v4.3.0

• Changed the configuration file reader to ignore the UTF-8 BOM sequence
• BUG: URLs that were equal to ignore/hide pattern were not matched (e.g. /abc/ didn't match */abc/, but /xyz/abc/ did)
• BUG: Fixed a bug that caused GD transparency value included in the JavaScript chart custom background color
• BUG: Fixed a bug that caused a few log records with the same time stamp following the first one being ignored
• Added ExternalMapURL to open a separate browser window and show a map centered on IP address coordinates
• Reworked the URL ignore filter to accept query string names
• BUG: Fixed a bug in the URL query parser that misinterpreted fragment identifiers (text after #)
• BUG: Fixed a bug causing bad query string sorting if a nameless query string was present
• JS Charts: Implemented a country chart rendered as a world map using Highmaps (JavaScriptChartsMap)
• JS Charts: Removed unnecessary Highcharts framework script link in reports
• Added latitude and longitude to IP addresses in the hosts report
• Fixed a couple column names in reports (e.g. Hostname changed to Host or IP Address or Host Name)
• Tweaked language selection for GeoIP to work with partial matches (e.g. pt vs. pt-br)
• Added a country code attribute to the country, host and download reports
• Removed non-country top level domain name suffixes from the country list (e.g. .com, .net, .edu, etc)
• HTML-encoded all text output in reports that may contain special characters (use CSS instead)
• BUG: Fixed URL encoding to encode spaces and control characters to form proper URLs

SSW 4.2

Highcharts Usage

Please note that Highcharts is not an Open Source package and may be used without buying a license only for non-commercial purposes. Read Highcharts' page for additional information about their licensing before enabling Highcharts in the reports:

https://shop.highsoft.com/faq#Non-Commercial-0

Notes

• Transfer amounts will be rendered in human-readable format by default in this release. If you would like to continue using traditional KBytes columns, use ClassicKBytes and change the heading Transfer to KBytes in your language file. See README for additional information.

• Stone Steps Webalizer v4 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. without reprocessing all log files for that month).

• Visual Studio 2015 redistributable package must be installed prior to running Windows binaries. Download x86 or x64 package at this location:

  https://www.microsoft.com/en-ca/download/details.aspx?id=48145

• Download new GeoIP city and country databases at either of these locations:

  http://www.maxmind.com/app/geoip_country
  http://dev.maxmind.com/geoip/geoip2/geolite2/

• See Working with JavaScript Charts for more information about JavaScript charts.

Changes

v4.2.2

• BUG: [BB-5] Adjust log record time stamp only if its time zone setting doesn't match that in the configuration
• BUG: [BB-4] Fixed a bug causing history being wiped out if there is no state database

v4.2.1

• Added DNSLookups configuration variable to use the DNS database as a generic host database (e.g. track spammers)

• Added SiteName as a more descriptive synonym for HostName

• Added SiteAlias to track white-listed site names

• Added spammer detection when a spam URL is disguised as a search string

• Disabled spammer and robot checks for Squid logs

• Changed case-insensitive comparisons and conversions to ignore non-ASCII characters

• Reworked DNS resolver to maintain historical spammer data and to reduce the footprint

• Introduced URL normalization that recognizes the same URL encoded differently

• Enforced UTF-8 encoding in all URL-encoded input text values

• Changed reports to render URLs containing control characters unclickable

• Switched Highcharts to Highstock to take advantage of stacked axes

• Multiple Highcharts improvements

• BUG: Fixed a bug that mangled non-ASCII characters in search strings

• BUG: Fixed a concurrency bug in the DNS resolver that could report incorrect host names

• BUG: Fixed a bug preventing Ctrl-C from being able to abort log processing

v4.2.0

• Improved report readability by replacing KBytes amounts with human-readable values using suffixes, such as KB, MB, etc. See this issue for additional details about this feature:

  https://stonestepswebalizer.codeplex.com/workitem/8

• Added experimental IPv6 support

• Added ClassicKBytes to allow to revert KBytes amounts as original numbers

• Added DecimalKBytes, off by default, to interpret KB as 1000 bytes, not 1024 bytes

• Updated libmaxminddb to v1.2.0

• Removed XSL reports and Flash charts

• BUG: Only one record out of the group with the same time stamp was counted (since 4.1.0.5)

SSW 4.0

Notes

• Stone Steps Webalizer v4 cannot read databases created by any other release prior to v4. You need to retain the latest previous version of Stone Steps Webalizer if you would like to generate reports directly from pre-v4 databases (i.e. without reprocessing all log files for that month).

• Download a new-format GeoIP city and country database at either of these locations:

  http://www.maxmind.com/app/geoip_country
  http://dev.maxmind.com/geoip/geoip2/geolite2/

Changes

v4.0.6

• Updated VS project files to VS2015
• BUG: Squid log file type is misidentified by the -F f option and -F s is ignored

Please note that due to hardware constraints, v4.0.6 was built using Visual C++ 2015 and while it should work the same or better than v4.0.5, if you are not affected by the bug fixed in 4.0.6, you may want to stay with v4.0.5. If you do install v4.0.6, download the Visual C++ 2015 x86 or x64 redistributable package at this location:

https://www.microsoft.com/en-ca/download/details.aspx?id=51682

v4.0.5

• BUG: LogFile entry in the configuration file was ignored
• BUG: When standard input (stdin) was used an error was reported that the file could not be opened

Visual C++ 2013 redistributable package must be installed prior to running Windows v4.0.5. Download the x86 or x64 package at this location:

http://www.microsoft.com/en-ca/download/details.aspx?id=40784

v4.0.4

• BUG: Host counts for the last day before a month change were zeroed out

v4.0.3

• BUG: Reduced the size of the copyright comment in HTML and XML reports to
  eliminate a warning in FireFox

v4.0.2

• BUG: Fixed a bug causing ApacheLogFormat ignored if DNS resolution was disabled

v4.0.1

• BUG: Fixed a bug causing SSW to crash after processing a log file with user names

v4.0.0

• Ported the source to run on x64 natively
• Upgraded GeoIP library (requires new GeoIP database - see GeoIPDBPath in README)
• Added a city column to the hosts reports
• Updated the default search engine list
• Removed support for wu-ftpd logs
• Removed FoldSeqErr and -f options; out of sequence records will be ignored
• Made local UTC offset used by default when reporting time
• Added NoLocalUTCOffset to ignore local UTC offset
• Created a repository on CodePlex - http://sto...