Home » Posts tagged 'wget'

  • Fetching Files with wget

    Perhaps your X server has crashed. Or you’re working on a shell script. Or you’re SSHed into a headless server. For one reason or another, if you need to fetch a file and a web browser’s not an option, you might want to look into wget. If you’ve used the Linux shell much and worked [...]

    Fetching Files with wget originally published on Make Tech Easier (RSS)
    Follow us at Facebook | Twitter

    continue reading »

     
     

  • Some wget tricks

    The wget is a command line utility that can download files from web servers and FTP servers.
    For example , you can download the DVD image of Karmic Koala using the following command.

    $ wget http://cdimage.ubuntu.com/releases/9.10/release/ubuntu-9.10-dvd-i386.iso

    If an FTP server requires a login and password, you can enter that information on
    the wget command line in the following form.

    $ wget ftp://user:password@ftp.example.com/path/to/file

    You can use wget to download a single web page as follows:

    $ wget http://unixlab.blogspot.com

    A file named index.html will be created in your current directory

    If you open this index.html in a web browser , you will find some of the links broken especially images. . To download all the images and other elements required to render the page properly, -p option can be used.

    $ wget -p http://unixlab.blogspot.com

    This will create a folder named unixlab.blogspot.com with index.html in it.

    But if you open the resulting index.html in your browser, chances are you will still
    have all the broken links even though all the images were downloaded. That’s because
    the links need to be translated to point to your local files. So instead, do this:

    $ wget -pk http://unixlab.blogspot.com

    Sometimes an HTML file you download does not have an.html extension, but ends
    in .php or .cgi instead. . If you wget files from such a site , your browser will complain when you try to open the file. To solve the problem , you can ask wget to append .html to such files using the -E option:

    $ wget -E http://unixlab.blogspot.com

    I use the following command line to keep a usable copy of the website on my hard disk.

    $ wget -mEkK http://unixlab.blogspot.com

    continue reading »

     
     
 

 
Extra Tags