How to Download all Files From a Website [10 Free Ways]

There are times when you will end up on a web page that doesn’t look like a webpage but instead looks like a folder and you can only find files being listed. This is because the webserver directory index file (index.html, default.asp and etc) is not present in the folder and the directory listings option in the webserver is turned on.

One of the reasons to offer directory listings is to provide a convenient way for the visitor to quickly browse the files in the folders and allow them to easily download the files to their computer. Sometimes directory listings are accidental due to webmasters who forget to include a .htaccess or a blank index file to prevent all the files from being listed.

website directory listing

To download a file, you can either left click on it or right click and select “Save link as” in your favorite browser like Firefox or Chrome. However, if you need to download multiple or even all of the files from the directory including the subfolders automatically, you will need third party tools to help you achieve that. Here are 5 different methods that you can use to download all files from a folder on a website.

Download Files With A Download Manager

If you are a frequent downloader, you probably already have a download manager program installed. Some of the popular and feature rich download managers like JDownloader are even open source software.

1. JDownloader

This very popular download manager is based on Java which means it’s cross platform and available for Windows, macOS and Linux.

jdownloader link grabber

While this program is able to download all files in a specific folder very easily it cannot recurse into sub folders. All you have to do is copy a URL to the clipboard while JDownloader is running and it will add a new package or set of packages to the Link Grabber with all the files. File types can be filtered out with checkboxes or deselected/removed manually. Note the JDownloader installer version contains adware.

Download JDownloader | JDownloader Portable (no adware on install)


2. FlashGet

This next download manager program is quite old but has a feature called Site Explorer which allows you to browse websites like in Windows Explorer. FlashGet has more recent versions than the 1.96 we’re looking at here, but we found this version handles HTTP and FTP sites better.

flashget site explorer

After installing and running Flashget go to the Tools menu > Site Explorer. Enter the URL and then you can browse through the site and download the files in any folder. If the site is using FTP, folders can also be multi selected and the files inside those folders will be downloaded. Only the files inside the root folder will download if the site is HTTP. Make sure to avoid the Google Toolbar offer during install.

Download Flashget v1.96

Download From A Folder Or FTP With A Web Browser Extension

Popular browser extensions for downloading files in recent times have been DownThemAll! and Flashgot for Firefox. Sadly, they don’t work anymore since the change to the WebExtensions system in Firefox 57. However, there are still extensions available for both Chrome and Firefox that can download files from a website or FTP folder. Here’s a couple of selections for each.

Note: All the browser extensions below will only download the files from the root folder in the browser tab, they will not recurse into sub folders. If you select a folder from the download list it will simply download as an unknown file.

3. Chrono Download Manager (Chrome)

Chrono Download Manager is one of the most popular extensions of its type for Chrome. There are some advanced options but it’s relatively straightforward to quickly download all the files in a folder. Click the Chrono toolbar button and switch to the sniffer mode with the top right button in the window.

chrono download manager for chrome

Then, cycle through the tabs selecting all the files with the top checkbox, check files individually or use the file type filter boxes below. Click the “Download All!” button and the files will be added to the queue and downloaded.

Download Chrono Download Manager


4. Download Master (Chrome)

This is another Chrome extension that downloads a load of files in a folder pretty easily. Download Master works in a similar way to Chrono but is a little more straightforward to use and what you see in the main window is it, there are no separate settings or options windows.

download master chrome extension

After you press the icon to open the download window all you have to do is check the file extension filter boxes, supply a custom filter or add files manually. Then press Download. As all the selection filters are in the same window it makes Download Master a bit faster to select multiple files or all files at once.

Download Download Master


5. Simple Mass Downloader (Firefox)

Simple Mass Downloader is a pretty good option for Firefox since the classic old extensions no longer work. It also has some useful features like being able to add downloads from multiple tabs at once and add automatic folders to directly download files of certain types into specific folders.

simple mass downloader for firefox

Files do not automatically populate the resource list and you have to click the “Load Page Links” button to start. The checkbox at the top will select all files at once while the extensions or text filter boxes at the bottom will filter the list by whatever characters are entered. Files can be added to a queue or downloaded directly with the buttons at the bottom right.

Download Simple Mass Downloader


6. DownloadStar (Firefox)

The final extension we’ll talk about is DownloadStar for Firefox. It’s not much different than the options we’ve mentioned above but to make all files visible you have to click “Show media from links” at the bottom left of the window or only images will be shown.

downloadstar for firefox

The filter checkboxes don’t have a select all files option but simply putting an asterisk “*” into the Fast Filter box will quickly do that. The button to download the files isn’t immediately obvious but it’s located at the top right with the number of files to download in brackets.

Download DownloadStar

To download files from a folder using something other than browser extensions or download managers, try the methods on Page 2.

7. Wget

Wget is a free and very powerful file downloader that comes with a lot of useful features including resume support, recursive download, FTP/HTTPS support, and etc. In “The Social Network” movie, Mark Zuckerberg is seen using the Wget tool to download all the student photos from his university to create Facemash. Wget is a command line tool which can be a bit difficult to use for some basic users.

VisualWget

Thankfully there are free front-end GUI’s for Wget such as VisualWget that make it so much easier to use Wget by simply clicking on the checkboxes rather than manually typing the command line arguments. Download VisualWget, extract and run VisualWget.exe. Click on the New icon to open a New Download window. Enter the URL that you want to download and select the location that you want to save the files to.

VisualWget New Download

If you need to download multiple folders including subfolders, go to Advanced, click on Recursive Retrieval and tick on the first checkbox “–recursive“. Finally, click OK to start downloading.

VisualWget Recursive

Although there are a few GUIs for Wget, we recommend VisualWget because it is free, portable, comes together with Wget and there is no need to download separately and manually unpacking it to the program’s folder or even configuring the path. Note that if you are a Windows 10 user and don’t already have .NET Framework 2/3.5 installed, you will need to download it during the VisualWget installation.

Download VisualWget


8. HTTrack

HTTrack is an offline browser that downloads the whole website for offline viewing. Software like this is capable of crawling into subfolders, downloading all or filtered files and then converting the live hyperlinks to an offline version. Some other offline browsers are Offline Explorer and Teleport but they are shareware and come with powerful parsing capabilities.

HTTrack is a good free alternative to the paid offline browsers. You can download the portable version of HTTrack, extract and run WinHTTrack.exe. Click Next, give the project a name and click Next.

WinHTTrack Project

Now enter or paste the URL(s) that you want to download to the Web Addresses box and click Next. If the URL requires authentication, click the Add URL button and you get to enter the login and password for the URL. Click Next and Finish. HTTrack will now start crawling the given URL and download files that it finds.

httrack site mirroring in progress

Download HTTrack


9. FileZilla

The best program to download all files and subfolders from an FTP server is of course going to be dedicated FTP client software like FileZilla. They obviously understand FTP commands and are able to crawl recursively into subfolders without problems. In FileZilla Client, all you need to do is enter the FTP address in the Host box, enter a username and password if it requires authentication, or leave it blank if not, and click the Quickconnect button.

Once you’re logged in, simply right click on a folder in the right pane and select Download which will start downloading all files and folders from the selected directory.

FileZilla

Please take note that FTP clients can only handle the FTP protocol and they cannot download files from HTTP web pages.

Download FileZillaPortable


10. Windows File Explorer FTP

A lot of people will know that Windows File Explorer can access FTP sites but a lot of people also won’t know that. It’s pretty easy and quite basic but if you just want to select and download some files or folders on a site then it may be all you need and requires no extra software.

enter ftp address in windows explorer

To access an FTP site all you have to do is enter its address in a File Explorer window address bar. Note that only a genuine FTP address will work and anything HTTP related won’t work. Browse and select the files and folders you want like you would in a local folder, right click and select Copy. Then Paste into the location of your choice and the files will download. A “Copy to Folder” option is also available on right click.

copy files from ftp site

The useful thing about the Windows Explorer option is it will recurse into subfolders so if you select a root folder everything inside it will download. Simply close the Explorer window or browse to a local folder when you want to close the FTP connection.

50 Comments - Write a Comment

  1. Meloddy 2 years ago
  2. Christopher M 2 years ago
  3. Ali 3 years ago
  4. john 4 years ago
  5. Elise 4 years ago
  6. Robert Astan 5 years ago
  7. Andy 5 years ago
    • HAL9000 5 years ago
  8. web 5 years ago
    • HAL9000 5 years ago
  9. Abdul Mannan Zafar 5 years ago
  10. Chris C 6 years ago
    • jmmy 6 years ago
  11. Adrian 6 years ago
    • John 6 years ago
      • sloani 6 years ago
  12. Hesham Orainan 7 years ago
  13. Irgend Jemand 7 years ago
  14. Randy Bar 8 years ago
  15. Sazzad Hossain MBA CSCA™ 8 years ago
  16. MELISSA MCELHANEY SCHMIDT 9 years ago
  17. edmar 9 years ago
  18. Ehsan 9 years ago
  19. Burhan 9 years ago
  20. Matt 10 years ago
  21. Nhan Nguyen 10 years ago
  22. Leandro 10 years ago
  23. Mitja 11 years ago
  24. JW 11 years ago
  25. Osama 11 years ago
  26. chaitanya 11 years ago
  27. chetan 11 years ago
  28. Robert 12 years ago
  29. Lolipop 12 years ago
  30. Niall Flynn 12 years ago
  31. gurpreet singh 12 years ago
  32. Martin C. 12 years ago
  33. uzair 13 years ago
  34. Mumtaz 14 years ago
  35. Danial 14 years ago
  36. Eran Hazout 15 years ago
  37. abhinav 15 years ago
  38. jimmy 15 years ago
  39. mitchell 15 years ago
  40. Merlin_Magii 16 years ago
  41. webcadre 16 years ago
  42. brayden 16 years ago
  43. Amirz 16 years ago
  44. Blackrose 16 years ago
  45. jeff 16 years ago

Leave a Reply

Your email address will not be published. Required fields are marked *

Note: Your comment is subject to approval. Read our Terms of Use. If you are seeking additional information on this article, please contact us directly.