1
2008-04-30 Micah Cowan <micah@cowan.name>
3
* version.c: Bumped version to 1.11.2.
5
* progress.c (create_image): Fix glitch where too many spaces are
6
printed on lines that don't display the ETA, in multibyte
9
2008-04-27 Rabin Vincent <rabin@rab.in>
11
* ftp.c (ftp_retrieve_glob): Prevent attempted retrieval of an
12
empty filename when --recursive hits an empty directory. Fixes
13
bug #22968. [Thanks also to Steven M. Schweda, who also
14
submitted this fix. -mjc]
16
2008-04-27 Rabin Vincent <rabin@rab.in>
18
* http.c (http_loop): Fix return for the case where we don't
19
download a file because of -nc.
21
2008-04-27 Micah Cowan <micah@cowan.name>
23
* url.c (path_simplify): Go back to allowing leading ".." in
24
paths, but only for FTP URLs.
25
(test_path_simplify): Add scheme-specificness to tests, adapt for
28
* test.c (all_tests): Add test_path_simplify.
30
* main.c (main): Downgrade -r, -p with -O to a warning rather than
31
an error; elaborate just a bit more for other -O combination
34
2008-04-26 Micah Cowan <micah@cowan.name>
36
* http.c (gethttp): Move proxy CONNECT handling to below the
37
retry_with_auth label, to deal with properly reconnecting to
38
proxies when we need to authenticate.
39
* version.c: Forgot to move version to a "-devel" one again.
41
2008-04-11 Micah Cowan <micah@cowan.name>
43
* ftp.c (getftp, ftp_loop_internal): Don't append to an existing
44
.listing when --continue is used. Fixes bug #22825. Thanks to
45
Rabin Vincent <rabin@rab.in> for pointing the way with a
48
2008-03-19 Micah Cowan <micah@cowan.name>
50
* utils.c (test_dir_matches_p): More tests related for
53
2008-03-17 Micah Cowan <micah@cowan.name>
55
* connect.c: Include sys/time.h to support use of the select
56
function on older systems.
58
2008-02-11 Benno Schulenberg <bensberg@justemail.net>
60
* http.c: More accurate and descriptive messages for when a file
61
won't be retrieved during spider-mode.
63
2008-02-10 Micah Cowan <micah@cowan.name>
65
* http.c: Added existence_checked member to the http_stat
67
(gethttp): Mark hs->existence_checked when we've checked whether
68
a file-to-download exists; so we don't check it again if the
69
connection gets lost (and potentially pick a new "unique" name).
71
* progress.c (create_image): Add space for an extra column in
72
the "eta" portion of the progress bar image; to deal with
73
too-long Czech translation.
74
* main.c, http.c, init.c: Added --auth-no-challenge option, to
75
bring back 1.10.2 unsafe auth behavior when needed. This fixes
78
2007-02-10 Hrvoje Niksic <hniksic@xemacs.org>
80
* ftp.c (ftp_retrieve_glob): Print both arguments of fnmatch in
81
fnmatch error message.
82
(ftp_retrieve_glob): Don't match with fnmatch if we're only
83
supposed to get one file.
85
2008-02-07 Micah Cowan <micah@cowan.name>
87
* progress.c (create_image): Remove assertion on exceeding
88
screen width, which given the less-than-robust code there, can
89
be broken by a number of factors (such as large file downloads).
91
2008-02-06 Micah Cowan <micah@cowan.name>
93
* progress.c (countcols): Use strlen() when mbtowc or wcwidth
94
not available (or not using NLS).
95
* utils.c: Ensure we use single-byte separators when not doing
97
* wget.h: Determine whether to use NLS for progress-bars, based
98
on whether wcwidth and mbtowc are available.
100
2008-02-03 Micah Cowan <micah@cowan.name>
102
* progress.c (create_image): Use number of characters/columns
103
consumed, rather than number of bytes, to determine how much of
104
a line we've used. Fixes assertion errors and field alignment
105
bugs (#22161, #20481)
106
(get_eta, count_cols): Added to support the changes for
108
* http.c (http_loop): Put no-clobber logic back into http_loop,
109
before starting to fetch, for when we're not doing
112
2008-01-31 Micah Cowan <micah@cowan.name>
114
* http.c (gethttp): Don't derive hs->contlen from possibly
115
invalid/missing Content-Length; instead, get the appropriate
116
value from the Content-Range header values.
117
(parse_content_range): Handle '*' instance-length field.
119
2008-01-30 Micah Cowan <micah@cowan.name>
121
* version.c: Bumped version number to 1.11.1-devel.
123
2008-01-25 Micah Cowan <micah@cowan.name>
125
* Makefile.in, cmpt.c, connect.c, connect.h, convert.c,
126
cookies.c, cookies.h, ftp-basic.c, ftp-ls.c, ftp-opie.c, ftp.c,
127
ftp.h, gen-md5.c, gen-md5.h, gnu-md5.c, gnu-md5.h, gnutls.c,
128
hash.c, hash.h, host.c, host.h, html-parse.c, html-parse.h,
129
html-url.c, http-ntlm.c, http-ntlm.h, http.c, http.h, init.c,
130
init.h, log.c, log.h, main.c, mswindows.c, mswindows.h, netrc.c,
131
netrc.h, openssl.c, options.h, progress.c, progress.h, ptimer.c,
132
ptimer.h, recur.c, recur.h, res.c, res.h, retr.c, retr.h,
133
spider.c, spider.h, ssl.h, sysdep.h, test.c, test.h, url.c,
134
url.h, utils.c, utils.h, wget.h, xmalloc.c, xmalloc.h: Updated
136
* version.c: Bumped version number to 1.11.
138
2007-12-10 Micah Cowan <micah@cowan.name>
140
* main.c: The option is --content-disposition, not
141
--no-content-disposition (at the moment).
143
2007-12-05 Micah Cowan <micah@cowan.name>
145
* utils.c (subdir_p): Handle the case where d1 is "".
146
* convert.c (convert_all_links): Don't return without
149
2007-11-28 Micah Cowan <micah@cowan.name>
151
* Makefile.in, cmpt.c, connect.c, connect.h, convert.c,
152
convert.h, cookies.c, cookies.h, ftp-basic.c, ftp-ls.c,
153
ftp-opie.c, ftp.c, ftp.h, gen-md5.c, gen-md5.h, gnutls.c,
154
hash.c, hash.h, host.c, host.h, html-parse.c, html-parse.h,
155
html-url.c, http-ntlm.c, http-ntlm.h, http.c, http.h, init.c,
156
init.h, log.c, log.h, main.c, mswindows.c, mswindows.h,
157
netrc.c, netrc.h, openssl.c, options.h, progress.c, progress.h,
158
ptimer.c, ptimer.h, recur.c, recur.h, res.c, res.h, retr.c,
159
retr.h, safe-ctype.c, safe-ctype.h, spider.c, spider.h, ssl.h,
160
sysdep.h, test.c, test.h, url.c, url.h, utils.c, utils.h,
161
wget.h, xmalloc.c, xmalloc.h: Updated license exception for
162
OpenSSL, per the SFLC.
164
2007-10-10 Micah Cowan <micah@cowan.name>
166
* http-ntlm.c: Include openssl/opensslv.h explicitly, instead of
167
hoping it'll be included by accident in openssl/des.h.
169
2007-10-09 Gisle Vanem <gvanem@broadpark.no>
171
* mswindows.c: 'argc' and 'argv' in 'windows_main()' are no longer
172
needed. Hence simply the prototype. Free 'exec_name' at exit.
174
2007-10-08 Micah Cowan <micah@cowan.name>
176
* http.c (http_loop): Add send_head_first conditional back
177
around code that needs it, but not around the last-modified
178
header-parsing stuff this time. Removed no-longer-useful (was it
179
ever?) restart_loop boolean, continuing unconditionally at end
180
of send_head_first conditional block (if we haven't jumped out).
182
2007-10-04 Micah Cowan <micah@cowan.name>
184
* http.c (http_loop): We've got_name if content_disposition
185
support isn't on; make sure we continue properly in that case,
186
even though we're not sending HEAD.
188
2007-10-02 Gisle Vanem <gvanem@broadpark.no>
190
* ftp.c: Use "_listing" for MSDOS (".listing" is illegal).
192
* url.c: Update comment for 'filechr_not_windows'.
194
* utils.c: Include <process.h> for 'getpid()' on Watcom.
196
2007-10-02 Micah Cowan <micah@cowan.name>
198
* ftp.c (getftp, ftp_loop_internal), http.c (http_loop), main
199
(main): Use datetime_str instead of time_str, for those who have
200
potentially long-running sessions. Based on suggestions by Saso
201
Tomat <miskox@hotmail.com> and Steven M. Schweda
203
* http.c (gethttp): Warn about host lookup failures. Adjusted
204
from Stephen Gildea's patch.
206
2007-10-02 Stephen Gildea <stepheng+wget@gildea.com>
208
* connect.c (connect_to_host): Warn about host lookup failures.
210
2007-09-25 Micah Cowan <micah@cowan.name>
212
* Makefile.in: Use EXEEXT instead of exeext.
214
2007-09-24 Gisle Vanem <giva@bgnett.no>
216
* connect.c, init.c, main.c, openssl.c, options.h, sysdep.h,
217
url.c, utils.c: Added support for building on MS-DOS.
219
2007-09-24 Jochen Roderburg <roderburg@uni-koeln.de>
221
* http.c (http_zero): Remove no-longer-used local_size variable.
224
2007-09-12 Micah Cowan <micah@cowan.name>
226
* http.c (http_loop): Remove send_head_first from condition for
229
2007-08-29 Micah Cowan <micah@cowan.name>
231
* openssl.c (ssl_init): Re un-const-ified the meth local
232
variable, to match current versions of openssl.
233
* spider.c: Removed visited_url function, as it may be very
235
(print_broken_links): Removed traversal of referrers, until such
236
time as a more efficient implementation can be written.
237
* spider.h: Replaced declaration of visited_url with an
238
empty-bodied, function-like macro.
240
2007-08-27 Gisle Vanem <giva@bgnett.no>
242
* mswindows.c (run_with_timeout): Ensure that the correct
243
conversion specification is used for the return result of
244
the GetLastError function.
245
* getopt.c: Fix missing (but, accidentally, legal) comment
246
delimiter after licensing text.
247
* recur.c (retrieve_tree): Inserted missing cast for strip_auth.
248
Includes adjustment by Ralf Wildenhues.
249
* openssl.c (ssl_init): const-ified the meth local variable.
250
* main.c: Include all the static function definitions in the
251
"#ifndef TESTING" clause, leaving just the definitions for
252
exec_name (not set), and opt.
253
* utils.c (run_with_timeout): Now returns bool, to align with
254
declaration in utils.h.
256
2007-08-27 Micah Cowan <micah@cowan.name>
258
* wget.h: Added macro replacement for ngettext, for environs
261
2007-08-26 Micah Cowan <micah@cowan.name>
263
* spider.c (print_broken_links): Fixed incorrect plurals msgid
264
usage, switched to use ngettext function.
266
2007-08-24 Micah Cowan <micah@cowan.name>
268
* http.c (http_loop): Introduced time_came_from_head boolean
269
flag, to help avoid parsing the same Last-Modified header twice.
270
Replaced spidering returns of RETRUNNEEDED for some situations,
271
to RETROK, as otherwise it will be interpreted as an error.
272
RETRUNNEEDED appears never to be referenced outside of
273
http.c (and wget.h), and, when returned by gethttp, is
274
translated by http_loop to RETROK.
275
* url.c (are_urls_equal): Don't call getchar_from_escaped_string
276
if u2 is shorter than u1.
277
(getchar_from_escaped_string): Don't decode reserved characters.
278
Handle illegally appearing '%'s as literal '%'s. Ensure hex
279
digits before attempting to decode.
280
(test_are_urls_equal): Added tests to handle u2 shorter than u1,
281
and %2f not treated the same as /.
282
* spider.c (in_url_list_p): Don't call are_urls_equal if one of
285
2007-08-23 Joshua David Williams <yurimxpxman@gmail.com>
287
* spider.c (in_url_list_p): Removed the bool verbose argument
289
2007-08-22 Mauro Tortonesi <mauro@ferrara.linux.it>
291
* http.c (http_loop): Fall back to GET if HEAD fails with a 500 or 501
294
2007-08-21 Mauro Tortonesi <mauro@ferrara.linux.it>
296
* http.c (http_loop): Send preliminary HEAD request if -N is given and
297
the destination file exists already.
299
2007-08-10 Mauro Tortonesi <mauro@ferrara.linux.it>
301
* http.c (http_loop): Fixed HTTP HEAD requests logic when --spider is
304
2007-08-10 Ralf Wildenhues <Ralf.Wildenhues@gmx.de>
306
* url.c (append_uri_pathel): Do not assume dest string to be
308
(test_append_uri_pathel): Terminate string to fix test failure.
310
2007-08-09 Ralf Wildenhues <Ralf.Wildenhues@gmx.de>
312
* url.c (url_string): Use comparison, not assignment, in
313
check for auth_mode == URL_AUTH_HIDE_PASSWD.
315
2007-08-09 Micah Cowan <micah@cowan.name>
317
* http.c (http_loop): If we got a HEAD and then a GET, and the
318
GET had a timestamp, use that one, not any we may have gotten
321
2007-08-08 Micah Cowan <micah@cowan.name>
323
* init.c (defaults): Content disposition will not be default,
324
since it currently results in extra round-trips.
326
2007-07-31 Micah Cowan <micah@cowan.name>
328
* http.c (gethttp): Set contlen = -1 when we encounter a
329
negative-valued Content-Length header, so we don't consider it
330
an internal error later on and call abort().
332
2007-07-29 Micah Cowan <micah@cowan.name>
334
* url.h, url.c (url_string): Replaced bool arg of the url_string
335
function with enum url_auth_mode, with added option to
336
completely remove user/pass auth information.
337
* http.c, ftp.c, url.c, recur.c: Adapted call to url_string
338
function to fit new usage.
339
* recur.c (retrieve_tree): Remove auth info from Referer header.
341
2007-07-28 Micah Cowan <micah@cowan.name>
343
* options.h, init.c, retr.c, main.c: renamed opt maxredirect
344
field to max_redirect, for improved consistency.
345
* init.c: changed max_redirect parser from cmd_number_inf to
346
cmd_number, as infinite redirects may not be appropriate.
347
Alternatively, if cmd_number_inf should be used, then
348
opt.max_redirect's value should be checked a bit differently in
349
retr.c, to allow for the "infinite" meaning of zero.
351
2007-07-25 Micah Cowan <micah@cowan.name>
353
* http.c (create_authorization_line)
354
(basic_authentication_encode, known_authentication_scheme_p)
355
(load_cookies): Moved declarations up.
356
(basic_authed_hosts): Added. Tracks what hosts have issued Basic
357
challenge and been given the global username, password.
358
(maybe_send_basic_creds): Added. Sends Basic creds for hosts that
359
have issued Basic challenges.
360
(register_basic_auth_host): Added. Instantiates
361
basic_authed_hosts if necessary, then registers the host that
362
has issued a challenge.
363
(gethttp) <auth>: Only send authentication credentials after
364
we've received a challenge from that host. This is a stop-gap
365
fix until a proper fix can be implemented; still isn't quite
366
right, as we should only be sending credentials automatically
367
for authenticated paths and below, and not for the entire host.
369
2007-07-16 Joshua David Williams <yurimxpxman@gmail.com>
371
* options.h: added maxredirect to options struct
372
* init.c: added maxredirect to list of variables
373
* retr.c (retrieve_url): replaced MAX_REDIRECTIONS with opt.maxredirect
374
* main.c: added option --max-redirect
376
2007-07-16 Joshua David Williams <yurimxpxman@gmail.com>
378
* test.h: tests made more verbose; now displays the name
381
2007-07-10 Mauro Tortonesi <mauro@ferrara.linux.it>
383
* http.c (http_loop): Fixed the HTTP requests logic. Now it skips the
384
preliminary HEAD request if either -O or --no-content-disposition are
385
given, and neither --spider and -N are given.
387
2007-07-05 Micah Cowan <micah@cowan.name>
389
* cmpt.c, connect.c, connect.h, convert.c, convert.h:
390
* cookies.c, cookies.h, ftp-basic.c, ftp.c, ftp.h, ftp-ls.c:
391
* ftp-opie.c, gen-md5.c, gen-md5.h, getopt.c, getopt.h, gnu-md5.c:
392
* gnu-md5.h, gnutls.c, hash.c, hash.h, host.c, host.h:
393
* html-parse.c, html-parse.h, html-url.c, http.c, http.h:
394
* http-ntlm.c, http-ntlm.h, init.c, init.h, log.c, log.h, main.c:
395
* Makefile.in, mswindows.c, mswindows.h, netrc.c, netrc.h:
396
* openssl.c, options.h, progress.c, progress.h, ptimer.c:
397
* ptimer.h, recur.c, recur.h, res.c, res.h, retr.c, retr.h:
398
* safe-ctype.c, safe-ctype.h, spider.c, spider.h, ssl.h, sysdep.h:
399
* test.c, test.h, url.c, url.h, utils.c, utils.h, wget.h:
400
* xmalloc.c, xmalloc.h:
401
Updated GPL reference to version 3 or later, removed FSF
404
2007-07-04 Mauro Tortonesi <mauro@ferrara.linux.it>
406
* http.c (http_loop): Skip HEAD request and start immediately with GET
409
2007-02-02 Hrvoje Niksic <hniksic@xemacs.org>
411
* http.c (print_server_response): Escape non-printable characters
414
2007-02-02 Hrvoje Niksic <hniksic@xemacs.org>
416
* netrc.c: Don't make netrc_list static, as it prevents
417
compilation with DEBUG_MALLOC.
419
* utils.c (aprintf): Don't use vasprintf when DEBUG_MALLOC is
420
requested because, in that case, we want the calls to malloc to be
423
2007-01-23 Hrvoje Niksic <hniksic@xemacs.org>
425
* cookies.c (parse_set_cookie): Would erroneously discard cookies
426
with unparsable expiry time.
428
2007-01-23 Hrvoje Niksic <hniksic@xemacs.org>
430
* progress.c (create_image): Check for ETA overflow.
431
(print_row_stats): Ditto.
433
2007-01-09 Mauro Tortonesi <mauro@ferrara.linux.it>
435
* init.c (cmd_spec_prefer_family): Small fix to get rid of a gcc
436
warning about strict-aliasing violation.
438
2007-01-09 Steven M. Schweda <sms@antinode.org>
440
* ftp-basic.c (ftp_syst): Fixed segfault if response text is missing.
442
2006-12-29 Gisle Vanem <giva@bgnett.no>
444
* mswindows.c: Avoid a warning if 'ws_hangup()' is unused.
446
2006-12-27 Mauro Tortonesi <mauro@ferrara.linux.it>
448
* http.c (parse_content_disposition): Consider directory prefix, if
451
2006-11-21 Hrvoje Niksic <hniksic@xemacs.org>
453
* retr.c (retrieve_from_file): Ditto.
454
(url_uses_proxy): New function.
456
* main.c (main): Don't check for opt.use_proxy when deciding
457
whether to call retrieve_url or retrieve_tree; check whether the
458
proxy would be used for *this* URL.
460
2006-10-17 Mike Grant <mggr@pml.ac.uk>
462
* ftp.c (ftp_loop_internal): Would incorrectly skip changing
463
working directory when retrying after a failed FTP attempt.
464
Originally reported by Nate Eldredge.
466
2006-10-12 Mauro Tortonesi <mauro@ferrara.linux.it>
468
* convert.c (downloaded_file): Fixed bug which used to break -E -k -K
471
2006-08-28 Mauro Tortonesi <mauro@ferrara.linux.it>
473
* http.c: #include'd spider.h to get rid of compiler warnings.
479
2006-08-24 Mauro Tortonesi <mauro@ferrara.linux.it>
481
* Makefile.in: Added spider.c to the list of files to compile and
482
spider.h to the list of header files. Updated copyright information.
484
* http.c: Major changes to recursive spider mode. Now for every
485
resource we are supposed to check, we send a HEAD request to find out
486
if it exists. If the resource is a HTML file, we retrieve it and parse
487
it to discover links to other resources.
491
* res.c (res_retrieve_file): Disable opt.timestamping and opt.spider
492
when retrieving robots.txt. Updated copyright information.
494
* convert.c: Moved code tracking broken links to spider.c.
498
* spider.c: Created new file to keep track of visited URLs in spider
503
2006-08-21 Mauro Tortonesi <mauro@ferrara.linux.it>
505
* http.c: Fixed timestamping-related bug.
507
2006-08-16 Mauro Tortonesi <mauro@ferrara.linux.it>
509
* http.c: Fixed bug which broke --continue feature. Now if -c is
510
given, http_loop sends a HEAD request to find out the destination
511
filename before resuming download.
513
2006-08-08 Hrvoje Niksic <hniksic@xemacs.org>
515
* utils.c (datetime_str): Avoid code repetition with time_str.
517
2006-07-21 Hrvoje Niksic <hniksic@xemacs.org>
519
* init.c (commands): Correctly place "contentdisposition".
521
2006-07-14 Mauro Tortonesi <mauro@ferrara.linux.it>
523
* sysdep.h: If intptr_t isn't defined, simply typedef it to long.
525
* http.c: Added explicit cast to int in logprintf call to remove
526
compiler warnings on 64-bit platforms.
528
* connect.c: Added a few casts to intptr_t to remove compiler warnings
531
* main.c: Disable -r, -p and -N when -O is used. Disable -k when -O is
532
used and multiple URLs are given. Update maintainer information.
534
* all: Update copyright information.
536
2006-07-10 KJKHyperion <hackbunny@reactos.com>
538
* url.c (filechr_table): Mark DEL (0x7f) as a control character
539
and | as a character Windows can't handle.
541
2006-06-28 Mauro Tortonesi <mauro@ferrara.linux.it>
543
* res.c: Implemented is_robots_txt_url function for detection of
544
robots.txt URLs and related test routine.
548
* url.c: Implemented are_urls_equal function for URL comparison and
549
related testing routine.
553
* convert.c: Fixes for recursive spider mode: don't consider
554
non-existing robots.txt as a broken link, and use are_urls_equal
555
instead of strcasecmp for referrer URLs comparison.
557
* test.c: Call tests routines for are_urls_equal and
560
2006-06-26 Hrvoje Niksic <hniksic@xemacs.org>
562
* wget.h (wgint): Typedef to any 64-bit (or larger) type we can
563
find, not necessarily off_t or long.
565
2006-06-26 Hrvoje Niksic <hniksic@xemacs.org>
567
* cmpt.c (strtoll): Check for overflow and underflow without
568
relying on (technically) undefined behavior. Don't assume that
569
strtoll_type is 64 bits wide.
571
2006-06-21 Hrvoje Niksic <hniksic@xemacs.org>
573
* utils.c (base64_encode): Cast void pointer to char * before
576
2006-06-20 Hrvoje Niksic <hniksic@xemacs.org>
578
* utils.c (base64_encode): Made TBL const.
579
(base64_decode): Made the base64_char_to_value table const.
581
2006-06-19 Hrvoje Niksic <hniksic@xemacs.org>
583
* utils.c (base64_encode): Made the DATA pointer void * so the
584
callers can pass it any kind of pointer (including both signed and
585
unsigned char pointers).
586
(base64_decode): Ditto for DEST.
588
2006-06-19 Hrvoje Niksic <hniksic@xemacs.org>
590
* utils.c (base64_encode): Would read past end of STR.
591
Reported by rick@eckle.org.
593
2006-06-13 Mauro Tortonesi <mauro@ferrara.linux.it>
595
* options.h (struct options): Introduced member restrict_files_case to
596
keep track of preferences on character case restrictions for
599
* init.c: Modified defaults and cmd_spec_restrict_file_names to
600
support character case restrictions for filenames. Added
601
test_cmd_spec_restrict_file_names unit test.
603
* url.c: Modified append_uri_pathel to support character case
604
restrictions for filenames. Added test_append_uri_pathel unit test.
606
* test.c: Added test_cmd_spec_restrict_file_names and
607
test_append_uri_pathel to the list of unit tests to run.
609
2006-06-12 Mauro Tortonesi <mauro@ferrara.linux.it>
611
* retr.c (retrieve_from_file): Use retrieve_tree and automatically
612
turn on opt.follow_ftp in case of recursive FTP retrieval through HTTP
615
* main.c: Automatically turn on opt.follow_ftp in case of recursive
616
FTP retrieval through HTTP proxy.
618
2006-06-12 Tony Lewis <tlewis@exelana.com>
620
* main.c: Improved CHEN Peng's patch by proposing a simpler logic.
622
2006-06-12 CHEN Peng <chenpeng@alumni.nus.edu.sg>
624
* main.c: Use retrieve_tree in case of recursive FTP retrieval through
627
2006-05-25 Mauro Tortonesi <mauro@ferrara.linux.it>
629
* convert.c: Added mechanisms to keep track broken links.
633
* wget.h: Reordered and enumerated uerr_t constants.
635
* recur.c: Fixes to support recursive spider mode.
639
* main.c: Print broken links in case of recursive spider mode.
641
* retr.c: Changed interface of retrieve_url.
645
* ftp.c: Changed interface of ftp_loop.
649
* res.c: Minor change to reflect changes in interface of retrieve_url.
651
2006-05-18 Lawrence Jones <lawrence.jones@ugs.com>
653
* ftp-ls.c (ftp_parse_unix_ls): Correct size parsing, add size
654
and filename debugging output.
656
2006-04-28 Mauro Tortonesi <mauro@ferrara.linux.it>
658
* http.c: If Content-Disposition header is present, allow unique
659
filename generation unless -nc is given. Permit to disable parsing of
660
Content-Disposition header.
662
* options.h: Added option --no-content-disposition to disable parsing
663
of HTTP Content-Disposition header.
669
2006-04-11 Hrvoje Niksic <hniksic@xemacs.org>
671
* hash.c (TOLOWER): Wrap macro arg in parentheses.
673
2006-04-08 Hrvoje Niksic <hniksic@xemacs.org>
675
* http.c (parse_content_disposition): Doc fix.
677
2006-03-15 Mauro Tortonesi <mauro@ferrara.linux.it>
679
* utils.c: Restricted operational semantics of frontcmp and proclist
680
from generic strings to directory names and them to subdir_p and
681
dir_matches_p respectively. Applied George Ogata's one line patch to
682
restrict algorithm of subdir_p to full directory name matching. Added
683
testcases for subdir_p and dir_matches_p.
685
* utils.h: Changed all frontcmp occurrences to subdir_p.
689
* test.c: Changed type returned by test functions from char * to const
690
char *. Added test_subdir_p and test_dir_matches_p to the list of
693
* http.c (test_parse_content_disposition): Changed return type from
694
char * to const char *.
696
2006-03-14 Mauro Tortonesi <mauro@ferrara.linux.it>
698
* recur.c (struct queue_element): Changed type of html_allowed member
701
2006-03-09 Mauro Tortonesi <mauro@ferrara.linux.it>
703
* ftp.c (ftp_list): Try `LIST -a' command first and revert to `LIST'
706
2006-03-06 Hrvoje Niksic <hniksic@xemacs.org>
708
* hash.c (TOLOWER): Fix definition when STANDALONE.
709
Reported by Beni Serfaty.
711
2006-03-02 Mauro Tortonesi <mauro@ferrara.linux.it>
713
* http.c (http_loop): Fixed recursive HTTP retrieval.
715
2006-02-28 Hrvoje Niksic <hniksic@xemacs.org>
717
* http.c (extract_param): Declare extern so it can be used from
719
(extract_param): Return error for empty name.
721
2006-02-28 Hrvoje Niksic <hniksic@xemacs.org>
723
* url.c (find_last_char): Define in terms of memrchr.
725
* cmpt.c (memrchr): Define it on systems that don't have it.
727
* http.c (extract_param): New function for parsing header values
729
(parse_content_disposition): Use it. Don't allow slashes and
730
backslashes in the file name.
732
2006-02-27 Hrvoje Niksic <hniksic@xemacs.org>
734
* url.c (path_simplify): Don't preserve ".." at beginning of path.
735
Suggested by Frank McCown.
737
2006-02-25 Hrvoje Niksic <hniksic@xemacs.org>
739
* http.c (gethttp): Only use FILE.N.html if FILE.html exists.
741
2006-02-09 Hrvoje Niksic <hniksic@xemacs.org>
743
* mswindows.c (run_with_timeout): Made thread_hnd non-static.
745
2006-02-05 Hrvoje Niksic <hniksic@xemacs.org>
747
* retr.c (sleep_between_retrievals): Sleep at a minimum of 1/2 of
748
the specified wait period.
750
2006-02-03 Hrvoje Niksic <hniksic@xemacs.org>
752
* utils.c (number_to_string): Don't use sprintf for printing
753
WGINT_MIN; simply divide n by 10 and defer printing the last
755
(number_to_string): Removed the SPRINTF_WGINT macro.
757
2006-02-03 Mauro Tortonesi <mauro@ferrara.linux.it>
759
* http.c: Fixed support for Content-Disposition header.
761
* test.c: Added test_parse_content_disposition to the list of unit
764
2006-02-02 Hrvoje Niksic <hniksic@xemacs.org>
766
* hash.c: Don't define countof if it's already defined.
768
* hash.c: Obtain the definition of uintptr_t when standalone.
770
2006-01-30 Mauro Tortonesi <mauro@ferrara.linux.it>
772
* http.c: Changed output format. Removed excessively verbose debugging
775
2005-12-07 Mauro Tortonesi <mauro@ferrara.linux.it>
777
* http.c: Fixed pre-download verbose output which was broken by
778
HTTP code refactoring.
780
2005-11-23 Mauro Tortonesi <mauro@ferrara.linux.it>
782
* http.c: Refactored HTTP code. If -O is not used, the new code
783
delays the choice of the file name where the downloaded resource
784
will be saved until the HTTP headers have been retrieved.
785
Added support for Content-Disposition header.
787
2005-11-19 Hrvoje Niksic <hniksic@xemacs.org>
789
* hash.c (INVALID_PTR): Use uintptr_t instead of unsigned long.
790
(hash_pointer): Don't assume a pointer fits in `unsigned long'.
792
2005-11-02 Mauro Tortonesi <mauro@ferrara.linux.it>
794
* Makefile.in: Removed support for unit testing (now it is in
797
2005-10-27 Mauro Tortonesi <mauro@ferrara.linux.it>
799
* Makefile.in: Added basic support for unit testing.
1
805
2005-10-13 Daniel Stenberg <daniel@haxx.se>
3
807
* http-ntlm.c (ntlm_output): Fixed buffer overflow vulnerability.
809
2005-10-09 Russ Allbery <rra@stanford.edu>
811
* snprintf.c: Remove round to round_int and pow10 to pow10_int, to
812
avoid warnings from GCC 4.0.
814
2005-10-05 Mauro Tortonesi <mauro@ferrara.linux.it>
816
* retr.c: Changed semantics of no_proxy_match.
818
2005-09-17 Hrvoje Niksic <hniksic@xemacs.org>
820
* main.c (main): Don't print the summary if nothing has been downloaded.
822
2005-09-17 Hrvoje Niksic <hniksic@xemacs.org>
824
* retr.c (retr_rate): Rename parameter from MSECS to SECS since it
825
no longer holds milliseconds.
827
2005-09-01 Hrvoje Niksic <hniksic@xemacs.org>
829
* progress.c: Introduce symbolic constants for "magic" values of
830
0.2 and 0.9, REFRESH_INTERVAL and ETA_REFRESH_INTERVAL.
832
2005-08-27 Hrvoje Niksic <hniksic@xemacs.org>
834
* cmpt.c (strtoll): Correctly handle strtoll("0x", ptr, 0) and
835
strtoll("0x<nonhexchar>", ptr, 0) -- in both cases *ptr must be
836
set to the position of 'x', not after it.
838
2005-08-27 Hrvoje Niksic <hniksic@xemacs.org>
840
* hash.c (hash_table_map): Rename to hash_table_for_each and
842
Document the meaning of the callback's return value.
843
(hash_table_iterate): New function.
844
(hash_table_iter_next): Likewise.
845
Update most places that used hash_table_for_each to use the
846
iteration, which doesn't require a temporary function with
847
explicit state management.
849
2005-08-26 Albert Chin <wget@mlists.thewrittenword.com>
851
* Makefile.in: Use @datadir@. Define localedir as $(datadir)/locale.
5
853
2005-08-26 Jeremy Shapiro <jnshapiro@gmail.com>
7
855
* openssl.c (ssl_init): Set SSL_MODE_AUTO_RETRY.
857
2005-08-23 Hrvoje Niksic <hniksic@xemacs.org>
859
* host.c (address_list_from_ipv4_addresses): Use IP_INADDR_DATA.
861
2005-08-12 Hrvoje Niksic <hniksic@xemacs.org>
863
* wget.h: Renamed strtoll_return to strtoll_type.
865
2005-08-11 Hrvoje Niksic <hniksic@xemacs.org>
867
* progress.c (eta_to_human_short): Switch to days when printing
868
more than 48h rather than 100h. (It's not immediately apparent
869
how many days there are in 83h.)
9
871
2005-08-11 Hrvoje Niksic <hniksic@xemacs.org>
11
873
* cmpt.c (strtoll): Define it if missing on the system and if Wget
40
971
2005-07-05 Hrvoje Niksic <hniksic@xemacs.org>
42
* cmpt.c (timegm): New function, used where timegm is unavailable.
973
* cmpt.c (timegm): Remove unused variable.
975
2005-07-05 Hrvoje Niksic <hniksic@xemacs.org>
977
* cmpt.c (timegm): Don't call mktime; simply count the seconds
978
between 1970-01-01 and the specified date.
980
2005-07-05 Hrvoje Niksic <hniksic@xemacs.org>
982
* wget.h (or): Define HAVE_SSL when either HAVE_OPENSSL or
983
HAVE_GNUTLS are defined.
985
* gnutls.c: New file.
44
987
2005-07-05 Hrvoje Niksic <hniksic@xemacs.org>
46
989
* http.c (gethttp): Don't print the request write error message
48
(http_atotm): Use timegm instead of mktime_from_utc.
992
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
994
* openssl.c (openssl_errstr): Instead of always using a large
995
static buffer, only allocate the error string when there is an
50
998
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
52
1000
* xmalloc.c (debugging_free): Prefix hex pointer value with "0x"
1003
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
1005
* utils.c (NEXT_BASE64_CHAR): Rename to NEXT_CHAR and simplify to
1006
get the next non-whitespace character.
1008
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
1010
* utils.c (base64_decode): Don't silently tolerate non-base64
1011
non-white-space characters in the base64 stream.
1013
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
1015
* connect.c (LAZY_RETRIEVE_INFO): Make last_tick unsigned to match
1016
transport_map_modified_tick.
1018
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
1020
* config-post.h (alloca): Updated declaration to not enumerate all
1023
2005-07-04 Hrvoje Niksic <hniksic@xemacs.org>
1025
* openssl.c (openssl_errstr): Separate error messages with "; ".
1027
2005-07-03 Hrvoje Niksic <hniksic@xemacs.org>
1029
* ftp.c (getftp): Ditto.
1031
* http.c (gethttp): Use fd_errstr.
1033
* connect.c (fd_register_transport): Restructure parameters to
1034
include only a single structure that describes transport
1037
* openssl.c (openssl_errstr): New function: dump SSL error strings
1038
into a static buffer and return a pointer to the buffer.
1040
* connect.c (fd_errstr): New function; returns transport-specific
1041
error message, or strerror(errno) if transport doesn't supply one.
55
1043
2005-07-03 Hrvoje Niksic <hniksic@xemacs.org>
57
1045
* mswindows.h: Also wrap accept() and listen().
1047
2005-07-03 Hrvoje Niksic <hniksic@xemacs.org>
1049
* url.c (path_end): Skip separators appropriate for the scheme.
1050
(strpbrk_or_eos): Remove gcc-specific version, as the optimization
1051
it tried to perform no longer applies.
59
1053
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
61
1055
* host.c: Don't include "connect.h" now that we no longer have
62
1056
socket_has_inet6.
64
* host.c: Remove extraneous include of netdb.h.
1058
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
1060
* host.c: Remove extraneous definition of netdb.h.
66
1062
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
68
1064
* http.c (gethttp): Skip error message body in the keep-alive
1067
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
1069
* url.c (url_parse): Would crash when parsing fragments. Support
1070
fragments for FTP URLs too.
1072
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
1074
* version.c: Don't use "cvs" in version name, since we're not
1077
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
1079
* progress.c (create_image): Ditto.
1081
* retr.c (retr_rate): Display smaller rate numbers with greater
1084
2005-07-02 Hrvoje Niksic <hniksic@xemacs.org>
1086
* http.c (response_head_terminator): Minor optimization.
1088
* retr.c (fd_read_hunk): Call terminator with pointer to the start
1089
of the data and the pointer to the current data. Changed all
71
1092
2005-07-01 Hrvoje Niksic <hniksic@xemacs.org>
73
* url.c (url_parse): Don't crash on []-delimited IPv6 addresses
1094
* url.c (url_parse): Make sure u->params is not initialized for
1096
(url_parse): Don't crash on garbage following []-delimited IPv6
76
1099
2005-07-01 Hrvoje Niksic <hniksic@xemacs.org>
78
1101
* main.c (print_help): Don't refer to the non-existent -nr in
79
1102
description of --mirror.
1104
2005-06-30 Hrvoje Niksic <hniksic@xemacs.org>
1106
* host.c (pretty_print_address): Renamed to just print_address.
1107
Clarify documentation.
1109
2005-06-30 Hrvoje Niksic <hniksic@xemacs.org>
1111
* http.c (gethttp): Explicitly document the different cases when
1112
generating the Host header.
1114
2005-06-30 Hrvoje Niksic <hniksic@xemacs.org>
1116
* host.c (pretty_print_address): Handle error result from
1119
2005-06-30 Gisle Vanem <giva@bgnett.no>
1121
* mswindows.c (inet_ntop): New function. Print IPv6 addresses
1122
using WSAAddressToString.
1124
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
1126
* progress.c (dot_update): Remove unused variable row_qty.
1128
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1130
* main.c: Check for both SIGHUP and SIGUSR1 before using them.
1132
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1134
* utils.c: Unconditionally include locale.h.
1136
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1138
* ptimer.c: Include sys/time.h to get struct timeval.
1140
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1142
* wget.h: Remove obsolete definition of with_thousand_seps_sum.
1144
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1146
* gnu-md5.h: Unconditionally include limits.h.
1148
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1150
* utils.c (random_number): Use lrand48 if available.
1151
(random_float): Use drand48 if available.
1153
2005-06-29 Hrvoje Niksic <hniksic@xemacs.org>
1155
* main.c (secs_to_human_time): Use print_decimal when printing
1156
total download time in seconds.
1158
* progress.c (print_row_stats): Use it to print total download
1159
time at the end of the download.
1160
(create_image): Ditto.
1162
* utils.c (print_decimal): New function; print small decimal
1163
numbers with more precision than large ones.
1165
* progress.c (print_row_stats): New function. Print ETA after the
1166
download rate at the end of each row.
81
1168
2005-06-28 Hrvoje Niksic <hniksic@xemacs.org>
83
1170
* init.c (parse_line): Check for alphanumerics.
85
1172
2005-06-28 Hrvoje Niksic <hniksic@xemacs.org>
1174
* (dot_create): Remove unnecessary casts.
1176
2005-06-28 Hrvoje Niksic <hniksic@xemacs.org>
87
1178
* ftp.c (getftp): Delete trailing newlines from LIST output so
88
1179
lines don't come out with trailing \015\012 with -S.
90
1181
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
1183
* mswindows.h: Remove superfluous includes.
1185
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
1187
* config-post.h (alloca): Amend alloca declaration to take care of
1188
all Win32 compilers, not just MSVC and MinGW.
1190
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
1192
* utils.c (get_grouping_data): Force separator to "." rather than
1193
" " when "," is taken.
1195
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
1197
* wget.h (PTR_FORMAT): Cast the result of sizeof to int before
1198
passing it to printf's %*.
1200
* retr.h: Declare output_stream and output_stream_regular.
1202
* ftp.h: Declare ftp_last_respline.
1204
* convert.h: Declare dl_url_file_map.
1208
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>
92
1210
* cookies.c: Make cookies_now static.
94
1212
2005-06-27 Hrvoje Niksic <hniksic@xemacs.org>