bug report: modlogan fails when given logfiles with very long urls

Hi

Modlogan consistently fails on the logfiles for one of our customers,
when it reaches a certain logfile, in which the first line looks like
this (as I can't reveal the customers domain name, I've replaced the
domain name in the referer with x's, but the error is exactly the same):

83.108.160.88 - - [16/May/2005:13:02:16 +0200]
"GET /New/html/kurd2kurd/ad%20link,ad%20network,adsales,Additional%
20income,ads,%20advertising,%20advertising%20consulting,%20advertising%
20management,%20Advertising%20Material,%20advertising%20networks,%
20affiliate,%20Affiliate%20,%20dvertiser,%20Affiliate%20Advertiser%
20Program,%20Affiliate%20Advertiser%20Programme,%20Affiliate%20Associate
%20,%20rogram,%20Affiliate%20Associate%20Programme,%20Affiliate%
20Automated,%20Affiliate%20Business,%20Affiliate%20,%20ommission,%
20Affiliate%20Internet%20Marketing%20Program,%20Affiliate%20Internet%
20Marketing%20Programme,%20affiliate%20marketing,%20Affiliate%
20Marketing%20Company,%20Affiliate%20Marketing%20Network%20Program,%
20Affiliate%20Marketing%20Network%20Programme,%20Affiliate%20Marketing%
20Opportunity,%20Affiliate%20,%20arketing%20Program,%20Affiliate%
20Marketing%20Programme,%20Affiliate%20Marketing%20Services,%20Affiliate
%20,%20arketing%20Web%20Site,%20affiliate%20network,%20affiliate%
20networks,%20Affiliate%20Opportunity,%20Affiliate%20,%20artner,%
20Affiliate%20PPC%20Program,%20Affiliate%20PPC%20Programme,%20Affiliate%
20Profits,%20Affiliate%20Program,%20Affiliate%20Program%20Business%
20Opportunity,%20Affiliate%20Program%20Directory,%20Affiliate%20Program%
20For%20,%20ebmasters,%20Affiliate%20Program%20Manager,%20Affiliate%
20Program%20Provider,%20Affiliate%20Program%20To%20Affiliate%20Program%
20To%20Make%20Money%20Online,%20Affiliate%20Programme,%20Affiliate%
20Programme%20,%20usiness%20Opportunity,%20Affiliate%20Programme%
20Directory,%20Affiliate%20Programme%20For%20Webmasters,%20Affiliate%
20Programme%20Manager,%20Affiliate%20Programme%20Provider,%20Affiliate%
20Programme%20To%20Make%20,%20oney,%20Affiliate%20Programme%20To%20Make%
20Money%20Online,%20Affiliate%20Programmes,%20Affiliate%20,%20rograms,%
20Affiliate%20Programs%20Directory,%20Affiliate%20Scheme,%20Affiliate%
20Selling,%20Affiliate%20Site,%20Affiliate%20Software,%20affiliates,%
20affiliates,%20Affiliates%20Program,%20afiliate,%20Agency,%20Associate%
20,%20rogrammes,%20Associate%20Programs,%20Associate%20Programs%
20Directory,%20Associates,%20B2B%20Tracking,%20Become%20An%20Affiliate,%
20Best%20Affiliate%20Program,%20Best%20Affiliate%20Programme,%20brand,%
20brand%20,%20uilding,%20branding,%20business,%20Business%20to%
20Business%20Tracking,%20clicks,%20commission,%20Connector,%
20Consulting,%20Conversion%20Rate,%20Cooperation,%20Cost%20Per%
20Acquisition,%20Cost%20Per%20Action,%20Cost%20Per%20Lead,%20Cost%20,%
20er%20Order,%20Cost%20Per%20Sale,%20CPA,%20CPA,%20CPC,%20CPM,%20CPO,%
20Creating%20Partners,%20Direct%20Marketing,20Distribution%20Network,%
20earn,%20earn%20money,%20earn%20money%20,%20ith%20links,%20earning%
20money%20internet,%20earning%20money%20using%20internet,%20E-Business,%
20Eccommerce%20Merchant,%20e-commerce,%20Ecommerce%20Merchant%20Program,
%20Ecommerce%20Merchant%20Programme,%20european%20affiliate%20network,%
20european%20affiliate%20networks,%20European%20Merchant,%20European%
20Merchants,%20extra%20money,%20Finance%20Affiliate,%20Good%20Affiliate%
20Program,%20Good%20Affiliate%20Programme,%20Highest%20Paying%
20Affiliate%20Program,%20Highest%20Paying%20Affiliate%20Programme,%
20Homework,%20Hosting%20With%20Affiliate%20Program,%20Hosting%20With%
20Affiliate%20Programme,%20Integrated%20Affiliate%20Marketing,%
20international%20commerce,%20international%20e-commerce,%
20international%20internet%20e-commerce,%20internet%20advertising,%
20Internet%20Affiliate%20Marketing,%20Internet%20Affiliate%20Program,%
20Internet%20,%20ffiliate%20Programme,%20Internet%20Affiliate%
20Shopping,%20internet%20earning%20money,%20Internet%20E-Commerce,%
20Internet%20marketing,%20Internet%20Marketing%20For%20Online%20,%
20usiness,%20Internet%20Marketing%20Online,%20internet%20marketing%
20strategy%20,%20Internet%20Money,%20Internet%20Shopping,%20Join%
20Affiliate%20Program,20Join%20Affiliate%20,%20rogramme,%20local%
20advertising,%20Make%20Money,%20Make%20Money%20From%20Your%20Web%
20Site,%20Marketing,%20Marketing%20Online,%20Marketing%20Online%
20Project,%20Media,%20Merchant,%20Merchant%20Advertiser,%20Merchant%
20Advertising,%20Merchant%20Affilliate,%20Merchant%20Commission,%
20Merchant%20Program,%20Merchant%20Programme,%20Merchant%20Revenue,%
20Merchant%20Service,%20Merchants,%20Most%20Profitable%20Affiliate%
20Program,%20Most%20Profitable%20Affiliate%20Programme,%20multichannel%
20commerce,%20multichannel%20e-commerce,%20Multichannel%20Sales,%
20network,%20New%20Affiliate%20Program,%20New%20Affiliate%20Programme,%
20New%20Customer,%20New%20,%20ustomers,%20New%20Media,%20Online,%
20Online%20Advertising,%20Online%20Affiliate%20Program,%20Online%
20Affiliate%20Programme,%20Online%20Cooperation,%20Online%
20Distribution20,%20etwork,%20Online%20E%20Marketing,%20Online%
20Marketing,%20Online%20Marketing%20Campaign,%20Online%20Marketing%
20Company,%20Online%20Marketing%20Plan,%20Online%20,%20arketing%
20System,%20Online%20Product%20Placement,%20online%20reporting,%
20Online20Revenues,%20Online%20Sales%20Network,%20Online%20Shopping,%
20online%20statistics,%20Online%20,%20zanox,%20ZANOX.de,%20ZANOX.de%20AG
HTTP/1.1" 403 4330
"http://www.xxxxxxxxxxxx.com/New/html/kurd2kurd/index.html" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1) Opera 7.54  [nb]"

(that's supposed to be *one* line with 5254 characters - but my mail
program doesn't like that)

with this output:

% modlogan -c config/modlogan.conf < prestat/httpd/access-2005051613.log
modlogan 0.8.13
main.c.738 (main): NOTICE: startup - finished
[]
 writing month 05 - 2005
 --> Setup       : Wall       0,11s, User       0,10s, System      0,00s
<--
 --> Parse       : Wall       0,00s, User       0,00s, System      0,00s
<--
 --> Process     : Wall       0,00s, User       0,00s, System      0,00s
<--
 --> Post-Process: Wall       0,17s, User       0,17s, System      0,00s
<--
Throughput: inf rec/s (5 records, 0 corrupt records, 5 skipped records,
0 ignored records)

If I delete that line from the logfile, everything works, and the output
is:
% modlogan -c config/modlogan.conf < prestat/httpd/access-2005051613.log
modlogan 0.8.13
main.c.738 (main): NOTICE: startup - finished
[]
 writing month 05 - 2005
 --> Setup       : Wall       0,11s, User       0,10s, System      0,00s
<--
 --> Parse       : Wall       0,00s, User       0,01s, System      0,00s
<--
 --> Process     : Wall       0,00s, User       0,00s, System      0,00s
<--
 --> Post-Process: Wall       0,19s, User       0,17s, System      0,01s
<--
Throughput: 47875,00 rec/s (383 records, 0 corrupt records, 383 skipped
records, 0 ignored records)

.Henrik

-- 
Henrik Christian Grove <[email protected]>
B-one