Webmaster forum - Copying parts of websites

Author

Copying parts of websites

Tom Galenson

2005-07-02, 4:25 am

I am very interested in being able to copy parts of websites. The websites
I want to copy feature cd-roms online (on the hard disk) from old bbs
collections as well as Gnu etc.

I have discovered that most website file grabbers choke if I try to grab a
whole site with 90 cd-roms online. But many refuse to limit themselves to a
paticular sub-directory path and lower. So I am looking for
recommendations. My target is: http://cd.textfiles.com and I run
www.chatnfiles.com

Thanks,
Tom Miller, longtime computer hobbyist

ps. I am taking another whack at a better looking website... but the above
is my most important technical issue. T.

John Bokma

2005-07-02, 4:25 am

"Tom Galenson" <tlgalenson@sunflower.com> wrote:

> I am very interested in being able to copy parts of websites. The
> websites I want to copy feature cd-roms online (on the hard disk) from
> old bbs collections as well as Gnu etc.
>
> I have discovered that most website file grabbers choke if I try to
> grab a whole site with 90 cd-roms online. But many refuse to limit
> themselves to a paticular sub-directory path and lower. So I am
> looking for recommendations. My target is: http://cd.textfiles.com
> and I run www.chatnfiles.com

wget?

--
John PERL SEO tools: http://johnbokma.com/perl/
Experienced (web) developer: http://castleamber.com/
Get a SEO report of your site for just 100 USD:
http://johnbokma.com/websitedesign/seo-expert-help.html

Blinky the Shark

2005-07-02, 4:25 am

Tom Galenson wrote:

> I am very interested in being able to copy parts of websites. The
> websites I want to copy feature cd-roms online (on the hard disk) from
> old bbs collections as well as Gnu etc.

> I have discovered that most website file grabbers choke if I try to
> grab a whole site with 90 cd-roms online. But many refuse to limit
> themselves to a paticular sub-directory path and lower. So I am
> looking for recommendations. My target is: http://cd.textfiles.com
> and I run www.chatnfiles.com

That's quite an archive, already. Just a couple of minutes of poking
around rendered a nifty old 486 logo and a photo of Christina Applegate
from 1994.

--
Blinky Linux Registered User 297263
Killing all Usenet posts from Google Groups
Info: http://blinkynet.net/comp/uip5.html
*ALSO contains links for access to the NON-BETA GG archive interface*

Tom Galenson

2005-07-02, 4:25 am

"Blinky the Shark" <no.spam@box.invalid> wrote in message
news:slrndcbt7t.52t.no.spam@thurston.blinkynet.net...
--snip-
>
> That's quite an archive, already. Just a couple of minutes of poking
> around rendered a nifty old 486 logo and a photo of Christina Applegate
> from 1994.
-snip-
True. If I wasn't able to hand cd-roms directly to the Host Master, I
couldn't do this, there is no way I could upload that many without paying an
arm/leg/other flesh....
However, I do have an ambition to fully fill up his Western Digital 250
Gigabyte drive with my downloads.... Most of the rest of his websites live
on a different drive... <g>

Tom, longtime comuter hobbyist...

--
---------------------------------------------
Would you believe 1 of the largest files collections
in the world with 1 of the most limited web-designs?
www.chatnfiles.com

Tom Galenson

2005-07-02, 4:25 am

"John Bokma" <john@castleamber.com> wrote in message
news:Xns9686CBD2E668castleamber@130.133.1.4...
> "Tom Galenson" <tlgalenson@sunflower.com> wrote:
>
--snip-
So I am[color=darkred]
>
> wget?
>
> --
> John
John, I have a copy of wget. Unfortunately, I am consulting with someone
else to figure out the regular expressions I need on the command line. I
just am not upto figuring out the "regular expressions" I need. I may have
to go bother some perl-mongers...

Thanks,
Tom, longtime computer hobbyist

--
---------------------------------------------
Would you believe 1 of the largest files collections
in the world with 1 of the most limited web-designs?
www.chatnfiles.com

John Bokma

2005-07-02, 4:25 am

"Tom Galenson" <tlgalenson@sunflower.com> wrote:

> "John Bokma" <john@castleamber.com> wrote in message
> news:Xns9686CBD2E668castleamber@130.133.1.4...
> --snip-
> So I am

[color=darkred]
> John, I have a copy of wget. Unfortunately, I am consulting with
> someone else to figure out the regular expressions I need on the
> command line. I just am not upto figuring out the "regular
> expressions" I need. I may have to go bother some perl-mongers...

wget is quite powerful. I guess you mean the GET that comes with perl? Not
sure what that can do.

wget has recently been updated, can do even more IIRC.

--
John PERL SEO tools: http://johnbokma.com/perl/
Experienced (web) developer: http://castleamber.com/
Get a SEO report of your site for just 100 USD:
http://johnbokma.com/websitedesign/seo-expert-help.html