Download File dan Web menggunakan wget

Beberapa Contoh Penggunaan wget

Download Sebuah File

Mendownload file menggunakan wget

# wget -c --limit-rate=20k url-file-yang-akan-di-download file-tujuan

contoh

# wget -c --limit-rate=20k http://opensource.telkomspeedy.com/repo/iso/JauntyRepoDVD/ubuntu-9.04-repository-i386-2_contrib.iso /home/library/iso/ubuntu-dvd-9.04/ubuntu-9.04-repository-i386-2_contrib.iso

Mengambil database SpeedyWiki

wget http://125.160.17.21/speedyorari/view.php?file=datawiki/wikidb.sql.gz -O /home/library/library/datawiki/wikidb.sql.gz 
wget http://125.160.17.21/speedyorari/view.php?file=datawiki/images.tar.gz -O /home/library/library/datawiki/images.tar.gz 

Download Recursive

wget -r <URL>

wget  -r -p -U Mozilla http://www.stupidsite.com/restricedplace.html

wget --wait=20 --limit-rate=20K -r -p -U Mozilla http://www.stupidsite.com/restricedplace.html

Supaya jangan download directory di bawahnya

--no-parent

Contoh

wget --no-parent -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/

wget --no-check-certificate --no-parent -r -p -U Mozilla http://lms.onnocenter.or.id/pustaka/

Meneruskan Download

switch -c untuk meneruskan (continue) proses download / retrieve

wget -c --no-parent -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/

wget -c --no-parent --limit-rate=8K -r -p -U Mozilla http://www.everyayah.com/data/Abdurrahmaan_As-Sudais_192kbps/

Menset Level Mirror

Level Mirror akan menentukan seberapa dalam web yang akan di copy, misalnya

 wget -c --level=5 -r -p -U Mozilla http://www.web.com/

Mirror Web

Mirroring sebuah Web

wget -m -k -K -E http://url/of/web/site

atau batasi dengan level

wget -m -k -K -E -l 3 http://url/of/web/site

atau

wget -rkp -l6 -np -nH -N http://example.com/

Mirror Web CSS image

Memastikan CSS image dll terdownload dengan baik

wget -E -H -k -K -p --convert-links http://example.com

wget --random-wait -r -p -e robots=off -U mozilla http://www.example.com

wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains example.com \
         www.example.com

wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains darmajaya.ac.id \
         www.darmajaya.ac.id

Referensi

• http://www.boutell.com/newfaq/creating/mirroring.html
• http://fosswire.com/post/2008/04/create-a-mirror-of-a-website-with-wget/
• http://ask.metafilter.com/15565/How-to-convert-a-dynamic-web-pages-into-static-ones
• http://www.techrepublic.com/blog/linux-and-open-source/mirroring-web-sites-with-wget/
• http://www.techrepublic.com/blog/linux-and-open-source/mirroring-web-sites-with-wget/

Pranala Menarik

• Download Database SpeedyWiki Menggunakan wget dan cron
• Beberapa Tips Menggunakan Shell di Linux
• Mirror Web Internet menjadi Web Lokal
• Linux Howto