Header Wallpaper

Can someone with time and internet speed help saving the forums offline pls ? (instructions inside)

AvatarJack5 min to read

The internet speed in my area is fucking shit at the moment and i posted a offline copy of the forum last year (26-12-19) and i wanted to save all the sermons in the important articles by the clergy subforum till date. However i didn't realize that the previous sermons and the newly posted sermons aren't being arranged in sequence of date by every new reply in any of the sermons is bumping it up the queue. Its absolute mayhem and saving it from 26-12-19 manually would be impossible. Since i can't use Httrack due to low internet speed (thanx lockdown), i figured i'd register the help of someone here who can do this shit. Its completely easy like a child can do it and i'm going to show you step-by-step. There's just massive value on this forum and we need to fucking save this all ,just to be on the save side
https://ancient-forums.com/viewtopic.php?f=5&t=41229

Anyone with high internet speed and a lot of free time can do this so follow along if someone wants pls help.

The first thing you need to understand is that you CANNOT save the entire forum at once. Don't ask me why, its just not happening.I've tried it and you get numerous bullshit errors after wasting 15gbs of data (my friend tried this.) What you have to do is you have to save all of it, with EACH SUBFORUM INDIVIDUALLY. Some of the Subforums with low number of posts an material will be saved pretty quickly but the Subforum JoyofSatan666 main forum will take a huge amount of time (with people's avatars,the pictures they posted and a fucking 7000+ post count.). Save each subforum in descending order of post count to save maximum efficiency. And if you have low internet speed down even think about trying this, it'll take fucking too long and a lot of errors and bullshit with some pages not opening. And here's another thing ,even if you have high internet speed some of the pages might not open. It will usually be in the middle page numbers where number of requests are exceeded and you'll notice the entire list of sermons on that page number may not be saved,if it happens. And then you'll have to save them manually afterwards but thats insignificant to the amount of material you'll save.

So open https://ancient-forums.com/ on your browser (you do not need to log in)

Now go down to the Subforum you wish to save offline and open it (here im using the example of Important sermons forum)

The link here is the subforum link which we need,copy this

Open your HTTRACK program

Project name and category don't matter just name it whatever, and remember the path of the folder where you save this (make a new folder in one of your drives before this)

In the Action drop down menu select (Download Multiple Mirror) (1)
Paste the subforum link you copied earlier in the Web addreses bar (2)

It'll look something like this, then click on Set options

Then click on the 'Build' Tab

Check the 'No External Pages' Option,

Then click okay and next and next until it starts and wait for it to finish ,then go to the folder where you saved it and check if its working or not

Open the Index file,

Click the blue thing,

Now you'll see the offline copy,go to a page number in the middle and check if the sermons are working, for example

Congratulations, your job is done. Now you have to compress the entire folder, split it into parts (for easier downloads) and upload it to mega and share the link here. Download 7-Zip (don't use winrar pls, its not at par with 7-zip)

So right click the folder go to 7-zip and click on add to archive.
Change the Compress level to ultra and copy all the other settings and split the files to 700 mb,click okay thats it.

Now just make a mega account using a free protonmail and upload it if you don't have one already and share the links here. Don't try to improvise and play hackerman if you don't know what your doing. You literally have to play this step by step and do nothing else and we'll have a nice little offline copy.

Also if someone is attempting to do this ,please reply on the topic and say which subforum your doing so others DONT do that. It'll be a waste of time for everyone to do the same task. Divide your labour. Saving the Main forum will require a hell of a lot of internet speed and data i can tell you that.

Reqquired software
https://www.7-zip.org/
https://www.httrack.com/
https://megasync.en.softonic.com/ (for uploading to mega,don't use full sync if you don't wannna waste data and you only want to upload this.)

0
#20

So I downloaded important articles for over 13h and after 10000 links software says "no more". What do?

Basically fifteen pages of stuff dating back to late 2017. Is it good enough?

Suggestions what to mirror next?

0

For beginners: A Beginner's Guide

#21
Jacksaid:
Powerofjusticesaid:

For some reason im having trouble with the download speeds. 1.2gigs dont take 2 hours its ridiculous, the issue lies elsewhere. Still, i'll do my best to finish the important articles.

Unfortunately this does take longer. My friend left it running the whole night and it ended only after 10 a.m in the morning, its some pretty hectic shit to be exact

When i woke up i thought i had it done after 15 hours, then i checked the logs and saw that there was a critical error and it just gave up. I'll try not to..

0
#22
Powerofjusticesaid:

When i woke up i thought i had it done after 15 hours, then i checked the logs and saw that there was a critical error and it just gave up. I'll try not to..

I added some additional steps to Jacks post, they'll definitely help with reducing the number of errors. Also make sure to exclude all links except the one you're trying to download. I made the mistake of not excluding all the links, since I thought I might download the "JoS Newsletter" and the
"JoS Activism - Zevism Internet Batallion" since they're the smallest. But the download has been running for over 22h and downloaded 4.65GB and I get the feeling its gonna be running for another day or 2 cause its pretty much downloading the entire site....Good thing however there is only 1 error and I expect its only on my side and not an actual issue with the site or related sites.

So as I said before make sure to check the options and make sure to exclude all the sites you're not downloading.

HAIL ZEUS AND ALL THOSE ALLIED TO HIM :smile:

0
#23
NoCreativeNameHereV2said:
Powerofjusticesaid:

When i woke up i thought i had it done after 15 hours, then i checked the logs and saw that there was a critical error and it just gave up. I'll try not to..

I added some additional steps to Jacks post, they'll definitely help with reducing the number of errors. Also make sure to exclude all links except the one you're trying to download. I made the mistake of not excluding all the links, since I thought I might download the "JoS Newsletter" and the
"JoS Activism - Zevism Internet Batallion" since they're the smallest. But the download has been running for over 22h and downloaded 4.65GB and I get the feeling its gonna be running for another day or 2 cause its pretty much downloading the entire site....Good thing however there is only 1 error and I expect its only on my side and not an actual issue with the site or related sites.

So as I said before make sure to check the options and make sure to exclude all the sites you're not downloading.

Thats exactly what happened to me, for some reason its about 100x slower than it should be with my internet speed, but at 5:30 in the morning it just said-nope critical error imma delete the whole thing since it can't compile. Now im trying your method and i literally excluded every other link aside form the JoS Newsletter and still at the time of writing its at 1:30 hours and 1gig of data, so not exactly sure whats going on there.

Maybe we should try another program ? But with so many people trying it on their own will it even work with everyone sharing a different file ?

0
#24
Powerofjusticesaid:

Thats exactly what happened to me, for some reason its about 100x slower than it should be with my internet speed, but at 5:30 in the morning it just said-nope critical error imma delete the whole thing since it can't compile. Now im trying your method and i literally excluded every other link aside form the JoS Newsletter and still at the time of writing its at 1:30 hours and 1gig of data, so not exactly sure whats going on there.

Maybe we should try another program ? But with so many people trying it on their own will it even work with everyone sharing a different file ?

HTTrack is very restricting on internet download speed to assure no security risks happen during mirroring of website, I had added even more filters to the links I was trying to download and yet it was downloading the entire site.

However I found another program to use which is far better than HTTrack, it is called NCollector Studio. Link can be found here :smile:
Httrack is all about preference, but I believe everyone should abandon HTTrack and use NCollector Studio, I will be experimenting with it to get the offline version looking exactly like the online version, but tied down at the moment.

http://www.calluna-software.com/Products/Downloads

-Download speed is way faster in my opinion (Can't say much since I'm downloading the entire site, but the difference is there)
-You get to see how many files need to be downloaded before being completed
-Excluding links actually works now, however this so far for me is optional adding a single link to a sub-forum will download all the contents only within
the link you provided
-On Completion the project will provide a log file(Same as HTTrack)however it is a lot more easier to understand, a gallery of images that were
downloaded from the listed site/forum. There is even more information on the completion of a project...I'm unable to check it since I'm downloading the entire forum.

There are a lot more benefits with this program that I have missed, however I'm unsure how to improve the download speed further but the download speed is faster as I mentioned above but people should still follow the general rule and download the smaller forums first. Then once all those are done we'll have to combine them into one folder.....I have an idea on how to do it but I'll test it out later on tonight or tomorrow sometime.

HAIL ZEUS AND ALL THOSE ALLIED TO HIM :smile:

0
#25

Where are the IT wizards when you need them .

0
#26
NoCreativeNameHereV2said:
Powerofjusticesaid:

Thats exactly what happened to me, for some reason its about 100x slower than it should be with my internet speed, but at 5:30 in the morning it just said-nope critical error imma delete the whole thing since it can't compile. Now im trying your method and i literally excluded every other link aside form the JoS Newsletter and still at the time of writing its at 1:30 hours and 1gig of data, so not exactly sure whats going on there.

Maybe we should try another program ? But with so many people trying it on their own will it even work with everyone sharing a different file ?

HTTrack is very restricting on internet download speed to assure no security risks happen during mirroring of website, I had added even more filters to the links I was trying to download and yet it was downloading the entire site.

However I found another program to use which is far better than HTTrack, it is called NCollector Studio. Link can be found here :smile:
Httrack is all about preference, but I believe everyone should abandon HTTrack and use NCollector Studio, I will be experimenting with it to get the offline version looking exactly like the online version, but tied down at the moment.

Do it and take some screenshots with instructions so that people here can divide the labor.

0
#27
Jacksaid:

Do it and take some screenshots with instructions so that people here can divide the labor.

Of course, still experimenting with it but once I have everything down I'll start posting screenshots.....Should I post it here or make a new topic?

HAIL ZEUS AND ALL THOSE ALLIED TO HIM :smile:

0
#28
Jacksaid:
NoCreativeNameHereV2said:
Powerofjusticesaid:

Thats exactly what happened to me, for some reason its about 100x slower than it should be with my internet speed, but at 5:30 in the morning it just said-nope critical error imma delete the whole thing since it can't compile. Now im trying your method and i literally excluded every other link aside form the JoS Newsletter and still at the time of writing its at 1:30 hours and 1gig of data, so not exactly sure whats going on there.

Maybe we should try another program ? But with so many people trying it on their own will it even work with everyone sharing a different file ?

HTTrack is very restricting on internet download speed to assure no security risks happen during mirroring of website, I had added even more filters to the links I was trying to download and yet it was downloading the entire site.

However I found another program to use which is far better than HTTrack, it is called NCollector Studio. Link can be found here :smile:
Httrack is all about preference, but I believe everyone should abandon HTTrack and use NCollector Studio, I will be experimenting with it to get the offline version looking exactly like the online version, but tied down at the moment.

Do it and take some screenshots with instructions so that people here can divide the labor.

http://www.calluna-software.com/Articles/View/how-to-download-a-website

Can you add to this ?

0
#29

Bruuh, is it just me or do the forums lag all of a sudden now? It's not like everyone here is downloading the whole thing.

Also quick update i'll be looking into alternative programs to mirror the forums as Httrack just doesnt seem to work and NCcollector is in beta and just isnt compatable with my machine for some reason

0
#30
Powerofjusticesaid:

Bruuh, is it just me or do the forums lag all of a sudden now? It's not like everyone here is downloading the whole thing.

Also quick update i'll be looking into alternative programs to mirror the forums as Httrack just doesnt seem to work and NCcollector is in beta and just isnt compatable with my machine for some reason

What operating system software are you on? Also is your pc 32bit or 64bit?

0
#31

Windows 10 64 bit.

Do you have any progress ?

0
#32
Powerofjusticesaid:

Windows 10 64 bit.

Do you have any progress ?

Strange I'm on the pro edition, I dont see how its not working for you. If you would like to know about my progress. I've downloaded

Jos Activism
Jos Newsletter
Jos BlackSun
Jos BlackRace
Jos Animals and Jos Oriental Alliance, downloading the astrology forum now.

0
#33
This is the targeted message.

I’m on it because my internet’s speed and performance is really good. But why are you using this bad internet? I would suggest you have a look at other internet broadbands in your area which are giving fast internet speed and are cheap too. You can also take help from this site allspeedtest as it’s specially designed to solve such problems. It will help you determine the actual reason behind this terrible internet and then you will be able to solve it easily. Also, go for Comcast internet because they are giving some amazing internet plans in almost every area.

0
#34
kenneth889said:

I’m on it because my internet’s speed and performance is really good. But why are you using this bad internet? I would suggest you have a look at other internet broadbands in your area which are giving fast internet speed and are cheap too. You can also take help from this site allspeedtest as it’s specially designed to solve such problems. It will help you determine the actual reason behind this terrible internet and then you will be able to solve it easily. Also, go for Comcast internet because they are giving some amazing internet plans in almost every area.

Don't worry I have done it. I'll just have to update since December to now.

0
#35

Bump. :)

0