SARG (призадумался...)

[dustcore]

Решил я тут SARG попробовать.. Фишка в том, что небольшие логи он делает нормально, а вот дал я ему 800кб лог, и думает он уже час наверное, проца отъедает 80-98%..
Подскажите, может кто пользовался? он всегда так долго ворочает большие логи, или он так некрасиво вешается?
Спасибо

з.ю. P III 700Mhz, RAM 256...

[Crion]

Незнаю что ты ему подсунул, но у меня больше 2-3 мин ни когда не работал и логи squid по 25 метров

[Kotjara]

Похоже тут всё зависит от конфигурации вашего компьютера. Что хоть за комп то небось 486-ой какой нибудь.

[orlik]

Решил я тут SARG попробовать.. Фишка в том, что небольшие логи он делает нормально, а вот дал я ему 800кб лог, и думает он уже час наверное, проца отъедает 80-98%..
Подскажите, может кто пользовался? он всегда так долго ворочает большие логи, или он так некрасиво вешается?
Спасибо

з.ю. P III 700Mhz, RAM 256...

↑

ну не знаю , как у вас , у меня на РII 350 лог на 20М обрабатывается около 10-15 минут , это притом что комп обычно и так загружет , и винт там очееень медленный

[dustcore]

да просто небольшой лог сквида за сутки ему даю...
вот такой..

192.168.0.29 - - [02/Aug/2004:13:03:11 +0000] "GET http://win.mail.ru/cgi-bin/s
tart HTTP/1.1" 200 33011 TCP_MISS:DIRECT
192.168.0.29 - - [02/Aug/2004:13:03:11 +0000] "GET http://top.list.ru/counter?
HTTP/1.1" 200 314 TCP_MISS:DIRECT
192.168.0.29 - - [02/Aug/2004:13:03:11 +0000] "GET http://counter.rambler.ru/to
p100.cnt? HTTP/1.1" 200 959 TCP_MISS:DIRECT
192.168.0.29 - - [02/Aug/2004:13:03:11 +0000] "GET http://top.list.ru/counter?
HTTP/1.1" 200 314 TCP_MISS:DIRECT
192.168.0.29 - - [02/Aug/2004:13:03:11 +0000] "GET http://r.mail.ru/b264572.swf
HTTP/1.1" 200 5820 TCP_MISS:DIRECT

ну и так далее..

вот мой конфайл

# sarg.conf
#
# TAG: language
# Available languages:
# Bulgarian_windows1251
# Catalan
# Czech
# Dutch
# English
# French
# German
# Hungarian
# Indonesian
# Italian
# Japanese
# Latvian
# Polish
# Portuguese
# Romanian
# Russian_koi8
# Russian_windows1251
# Serbian
# Spanish
# Turkish
#
language Russian_koi8

# TAG: access_log file
# Where is the access.log file
# sarg -l file
#
access_log /home/sys6/access.log

хтмл теги вырезал

# TAG: password
# User password file used by authentication
# If used here, reports will be generated only for that users.
#
#password none

# TAG: temporary_dir
# Temporary directory name for work files
# sarg -w dir
#
#temporary_dir /tmp

# TAG: output_dir
# The reports will be saved in that directory
# sarg -o dir
#
output_dir /var/www/htdocs/sarg

# TAG: output_email
# Email address to send the reports. If you use this tag, no html reports will be
# generated.
# sarg -e email
#
#output_email none

# TAG: resolve_ip yes/no
# Convert ip address to dns name
# sarg -n
#resolve_ip no

# TAG: user_ip yes/no
# Use Ip Address instead userid in reports.
# sarg -p
#user_ip no

# TAG: topuser_sort_field field normal/reverse
# Sort field for the Topuser Report.
# Allowed fields: USER CONNECT BYTES TIME
#
#topuser_sort_field BYTES reverse

# TAG: user_sort_field field normal/reverse
# Sort field for the User Report.
# Allowed fields: SITE CONNECT BYTES TIME
#
#user_sort_field BYTES reverse

# TAG: exclude_users file
# users within the file will be excluded from reports.
# you can use indexonly to have only index.html file.
#
#exclude_users none

# TAG: exclude_hosts file
# Hosts, domains or subnets will be excluded from reports.
#
# Eg.: 192.168.10.10 - exclude ip address only
# 192.168.10.0 - exclude full C class
# s1.acme.foo - exclude hostname only
# acme.foo - exclude full domain name
#
#exclude_hosts none

# TAG: useragent_log file
# Put here where is useragent.log to nable useragent report.
#
#useragent_log none

# TAG: date_format
# Date format in reports: e (Europe=dd/mm/yy), u (USA=mm/dd/yy), w (Weekly=yy.ww)
#date_format u

# TAG: per_user_limit file MB
# Save userid on file if download exceed n MB.
#
# This option can be used to disable user access if user exceed a download limit.
#per_user_limit none

# TAG: lastlog n
# How many reports files must be keept in reports directory.
# The oldest report file will be automatically removed.
# 0 - no limit.
#
#lastlog 0

# TAG: remove_temp_files yes
# Remove temporary files: geral, usuarios, top, periodo from root report directory.
#
#remove_temp_files yes

# TAG: index yes|no|only
# Generate the main index.html.
# only - generate only the main index.html
#
#index yes

# TAG: overwrite_report yes|no
# yes - if report date already exist then will be overwrited.
# no - if report date already exist then will be renamed to filename.n, filename.n+1
#
#overwrite_report no

# TAG: records_without_userid ignore|ip|everybody
# What can I do with records without user id (no authentication) in access.log file ?
#
# ignore - This record will be ignored.
# ip - Use ip address instead. (default)
# everybody - Use "everybody" instead.
#
#records_without_userid ip

# TAG: use_comma no|yes
# Use comma instead point in reports.
# Eg.: use_comma yes => 23,450,110
# use_comma no => 23.450.110
#
#use_comma no

# TAG: mail_utility mail|mailx
# Mail command to use to send reports via SMTP
#
#mail_utility mailx

# TAG: topsites_num n
# How many sites in topsites report.
#
#topsites_num 100

# TAG: topsites_sort_order CONNECT|BYTES A|D
# Sort for topsites report, where A=Ascendent, D=Descendent
#
#topsites_sort_order CONNECT D

# TAG: index_sort_order A/D
# Sort for index.html, where A=Ascendent, D=Descendent
#
#index_sort_order D

# TAG: exclude_codes file
# Ignore records with these codes. Eg.: NONE/400
#
#exclude_codes /usr/local/sarg/exclude_codes

# TAG: replace_index string
# Replace "index.html" in the main index file with this string
# If null "index.html" is used
#
#replace_index <?php echo str_replace(".", "_", $REMOTE_ADDR); echo ".html"; ?>

# TAG: max_elapsed milliseconds
# If elapsed time is recorded in log is greater than max_elapsed use 0 for elapsed time.
# Use 0 for no checking
#
#max_elapsed 0
# 8 Hours
max_elapsed 28800000

# TAG: report_type type
# What kind of reports to generate.
# topsites - shows the site, connect and bytes
# sites_users - shows which users were accessing a site
# users_sites - shows sites accessed by the user
# date_time - shows the amount of bytes used by day and hour
# denied - shows all denied sites with full URL
# auth_failures - shows autentication failures
# site_user_time_date - shows sites, dates, times and bytes
#
# Eg.: report_type topsites denied
#
#report_type topsites sites_users users_sites date_time denied auth_failures site_user_time_date

# TAG: usertab filename
# You can change the "userid" or the "ip address" to be a real user name on the rpeorts.
# Table syntax:
# userid name or ip address name
# Eg:
# SirIsaac Isaac Newton
# vinci Leonardo da Vinci
# 192.168.10.1 Karol Wojtyla
#
# Each line must be terminated with '\n'
#
#usertab none

# TAG: long_url yes|no
# If yes, the full url is showed in report.
# If no, only the site will be showed
#
# YES option generate very big sort files and reports.
#
#long_url no

# TAG: date_time_by bytes|elap
# Date/Time reports will use bytes or elapsed time?
#
#date_time_by bytes

# TAG: charset name
# ISO 8859 is a full series of 10 standardized multilingual single-byte coded (8bit)
# graphic character sets for writing in alphabetic languages
# You can use the following charsets:
# Latin1 - West European
# Latin2 - East European
# Latin3 - South European
# Latin4 - North European
# Cyrillic
# Arabic
# Greek
# Hebrew
# Latin5 - Turkish
# Latin6
# Windows-1251
# Koi8-r
#
#charset Latin1

# TAG: user_invalid_char "&/"
# Records that contain invalid characters in userid will be ignored by Sarg.
#
#user_invalid_char "&/"

# TAG: privacy yes|no
# privacy_string "***.***.***.***"
# privacy_string_color blue
# In some countries the sysadm cannot see the visited sites by a restrictive law.
# Using privacy yes the visited url will be changes by privacy_string and the link
# will be removed from reports.
#
#privacy no
#privacy_string "***.***.***.***"
#privacy_string_color blue

# TAG: include_users "user1:user2:...:usern"
# Reports will be generated only for listed users.
#
#include_users none

# TAG: exclude_string "string1:string2:...:stringn"
# Records from access.log file that contain one of listed strings will be ignored.
#
#exclude_string none

# TAG: show_successful_message yes|no
# Shows "Successful report generated on dir" at end of process.
#
#show_successful_message yes

# TAG: show_read_statistics yes|no
# Shows some reading statistics.
#
#show_read_statistics no

# TAG: topuser_fields
# Which fields must be in Topuser report.
#
#topuser_fields NUM DATE_TIME USERID CONNECT BYTES %BYTES IN-CACHE-OUT USED_TIME MILISEC %TIME TOTAL AVERAGE

# TAG: user_report_fields
# Which fields must be in User report.
#
#user_report_fields CONNECT BYTES %BYTES IN-CACHE-OUT USED_TIME MILISEC %TIME TOTAL AVERAGE

# TAG: topuser_num n
# How many users in topsites report. 0 = no limit
#
#topuser_num 0

# TAG: site_user_time_date_type list|table
# generate reports for site_user_time_date in list or table format
#
#site_user_time_date_type table

# TAG: datafile file
# Save the report results in a file to populate some database
#
#datafile none

# TAG: datafile_delimiter ";"
# ascii character to use as a field separator in datafile
#
#datafile_delimiter ";"

# TAG: datafile_fields all
# Which data fields must be in datafile
# user;date;time;url;connect;bytes;in_cache;out_cache;elapsed
#
#datafile_fields user;date;time;url;connect;bytes;in_cache;out_cache;elapsed

# TAG: weekdays
# The weekdays to take account ( Sunday->0, Saturday->6 )
# Example:
#weekdays 1-3,5
# Default:
#weekdays 0-6

# TAG: hours
# The hours to take account
# Example:
#hours 7-12,14,16,18-20
# Default:
#hours 0-23

# TAG: squidguard_log_path file
# Generate reports from SquidGuard logs.
#
#squidguard_log_path none

# TAG: show_sarg_info yes|no
# shows sarg information and site patch on each report bottom
#
#show_sarg_info yes

# TAG: parsed_output_log directory
# Saves the processed log in a sarg format after parsing the squid log file.
# This is a way to dump all of the data structures out, after parsing from
# the logs (presumably this data will be much smaller than the log files themselves),
# and pull them back in for later processing and merging with data from previous logs.
#
#parsed_output_log none

# TAG parsed_output_log_compress /bin/gzip|/usr/bin/bzip2|nocompress
# sarg logs compress util
#
#parsed_output_log_compress /bin/gzip

# TAG displayed_values bytes|abbreviation
# how the values will be displayed in reports.
# eg. bytes - 209.526
# abbreviation - 210K
#
#displayed_values bytes



а вот что показывает sarg -z


SARG: ConfigFile.........= /usr/local/sarg/sarg.conf
SARG: AccessLog..........= /home/sys6/access.log
SARG: BgColor............= white
SARG: TxColor............= black
SARG: TxBgColor..........= beige
SARG: TiColor............= green
SARG: LogoImage..........=
SARG: LogoText...........=
SARG: LogoTextColor......= black
SARG: Width..............= 80
SARG: Height.............= 45
SARG: Title..............= Squid User Access Report
SARG: BgImage............=
SARG: FontFace...........=
SARG: HeaderColor........= darkblue
SARG: HeaderBgColor......= blanchedalmond
SARG: FontSize...........= -1
SARG: PasswdFile.........=
SARG: TempDir............= /tmp
SARG: OutputDir..........= /var/www/htdocs/sarg
SARG: Ip2Name............= no
SARG: TopuserSortField.........= BYTES
SARG: UserSortField.........= BYTES
SARG: TopuserSortOrder.........= reverse
SARG: UserSortOrder.........= reverse
SARG: UserAgentLog.......=
SARG: ExcludeHosts.......=
SARG: DateFormat.........= u
SARG: ExcludeUsers.......=
SARG: PerUserLimitFile...=
SARG: PerUserLimit.......=
SARG: UserIp.............= no
SARG: MaxElapsed.........= 28800000
SARG: LastLog............=
SARG:
SARG: (util) tbuf=2004Aug02
SARG: (util) periodo=2004Aug02-


все. на этом встает

[x029ah]

лень конфиг читать +)
может из-за того, что он IP клиентов в имена пытается преобразовать?

а обратная зона не настроена...