~narada-team/narada/trunk

« back to all changes in this revision

Viewing changes to perl/workers/url_fetcher_worker.pl

  • Committer: narada
  • Date: 2011-03-30 18:45:47 UTC
  • Revision ID: narada@ip-10-243-119-22-20110330184547-rwlicszsw6hkle19
Changed config to use Config::YAML, no external requirements for config variables

Show diffs side-by-side

added added

removed removed

Lines of Context:
23
23
 
24
24
sub fetch_remote_doc {
25
25
    my ($local_url)= @_;
26
 
    warn "processing url $local_url\n";
27
 
    print "RECURSE: $recurse\n";
 
26
    warn "processing url $local_url\n" if $DEBUG;
 
27
    print "recursion level: $recurse\n" if $DEBUG;
28
28
 
29
29
    my $last_modified; 
30
30
    my $if_modified= get_if_modified($local_url);