Header Wallpaper

Can someone with time and internet speed help saving the forums offline pls ? (instructions inside)

AvatarJack5 min to read

The internet speed in my area is fucking shit at the moment and i posted a offline copy of the forum last year (26-12-19) and i wanted to save all the sermons in the important articles by the clergy subforum till date. However i didn't realize that the previous sermons and the newly posted sermons aren't being arranged in sequence of date by every new reply in any of the sermons is bumping it up the queue. Its absolute mayhem and saving it from 26-12-19 manually would be impossible. Since i can't use Httrack due to low internet speed (thanx lockdown), i figured i'd register the help of someone here who can do this shit. Its completely easy like a child can do it and i'm going to show you step-by-step. There's just massive value on this forum and we need to fucking save this all ,just to be on the save side
https://ancient-forums.com/viewtopic.php?f=5&t=41229

Anyone with high internet speed and a lot of free time can do this so follow along if someone wants pls help.

The first thing you need to understand is that you CANNOT save the entire forum at once. Don't ask me why, its just not happening.I've tried it and you get numerous bullshit errors after wasting 15gbs of data (my friend tried this.) What you have to do is you have to save all of it, with EACH SUBFORUM INDIVIDUALLY. Some of the Subforums with low number of posts an material will be saved pretty quickly but the Subforum JoyofSatan666 main forum will take a huge amount of time (with people's avatars,the pictures they posted and a fucking 7000+ post count.). Save each subforum in descending order of post count to save maximum efficiency. And if you have low internet speed down even think about trying this, it'll take fucking too long and a lot of errors and bullshit with some pages not opening. And here's another thing ,even if you have high internet speed some of the pages might not open. It will usually be in the middle page numbers where number of requests are exceeded and you'll notice the entire list of sermons on that page number may not be saved,if it happens. And then you'll have to save them manually afterwards but thats insignificant to the amount of material you'll save.

So open https://ancient-forums.com/ on your browser (you do not need to log in)

Now go down to the Subforum you wish to save offline and open it (here im using the example of Important sermons forum)

The link here is the subforum link which we need,copy this

Open your HTTRACK program

Project name and category don't matter just name it whatever, and remember the path of the folder where you save this (make a new folder in one of your drives before this)

In the Action drop down menu select (Download Multiple Mirror) (1)
Paste the subforum link you copied earlier in the Web addreses bar (2)

It'll look something like this, then click on Set options

Then click on the 'Build' Tab

Check the 'No External Pages' Option,

Then click okay and next and next until it starts and wait for it to finish ,then go to the folder where you saved it and check if its working or not

Open the Index file,

Click the blue thing,

Now you'll see the offline copy,go to a page number in the middle and check if the sermons are working, for example

Congratulations, your job is done. Now you have to compress the entire folder, split it into parts (for easier downloads) and upload it to mega and share the link here. Download 7-Zip (don't use winrar pls, its not at par with 7-zip)

So right click the folder go to 7-zip and click on add to archive.
Change the Compress level to ultra and copy all the other settings and split the files to 700 mb,click okay thats it.

Now just make a mega account using a free protonmail and upload it if you don't have one already and share the links here. Don't try to improvise and play hackerman if you don't know what your doing. You literally have to play this step by step and do nothing else and we'll have a nice little offline copy.

Also if someone is attempting to do this ,please reply on the topic and say which subforum your doing so others DONT do that. It'll be a waste of time for everyone to do the same task. Divide your labour. Saving the Main forum will require a hell of a lot of internet speed and data i can tell you that.

Reqquired software
https://www.7-zip.org/
https://www.httrack.com/
https://megasync.en.softonic.com/ (for uploading to mega,don't use full sync if you don't wannna waste data and you only want to upload this.)

#1

I'm on it. I have a very good internet connection but this is taking more time than I thought it would. I will download as much as possible today but my time is limited, tomorrow I will post the full backup here and on a separate topic.

I have tried downloading the JoS website with HTTrack a lot before but had awful results, perhaps someone who had successfully downloaded the website could point me to how to correctly do it and I will make sure to download every single page there is, including related websites.

#2

I will do at a certain time as well

For any Inquiries on Translations matters please message me on the Forums or Vultus Templorum or email me at [email protected]

#3
Coraxosaid:

I'm on it. I have a very good internet connection but this is taking more time than I thought it would. I will download as much as possible today but my time is limited, tomorrow I will post the full backup here and on a separate topic.

I have tried downloading the JoS website with HTTrack a lot before but had awful results, perhaps someone who had successfully downloaded the website could point me to how to correctly do it and I will make sure to download every single page there is, including related websites.

The main websites are segmented into different parts therefore some links don't open, rest assured I have the complete backups from the Root area where all the links are stored. I'll post it.

#4

I can't seem to be able to download the forums completely, I've tried many times now and every time some random pages go missing. Also it takes an absurd amount of time, where in reality it should take only few minutes to download with how fast my connection is.

Any idea what to do?

#5
Coraxosaid:

I can't seem to be able to download the forums completely, I've tried many times now and every time some random pages go missing. Also it takes an absurd amount of time, where in reality it should take only few minutes to download with how fast my connection is.

Any idea what to do?

Do what I tell you to do in my post here ,did you read it ? You have to download each sub forum INDIVIDUALLY.

#6
Jacksaid:

Do what I tell you to do in my post here ,did you read it ? You have to download each sub forum INDIVIDUALLY.

It's impossible to download each sub-forum individually, I got it to work on the Satan is God site by excluding the ancient-forums group-archives but that in my opinion follows a different structure compared to Ancient-forums.com. I've been trying ever since this post went up, searched all over the internet for help on how to do it. I even downloaded a certain script from github, however I'm unsure how to utilize the file.
After a bit of research on what a .sh file is, it is a file which is originally a Linux script and attempting to run the file on Windows command prompt will not work and you will need a a program called Cygwin. Here is the link in case anyone wants to have a try.

.sh file - https://gist.github.com/a1phanumeric/5474848

Cygwin - https://cygwin.com/install.html

Another option/s you should check in Httrack is "No Error Pages" found in Set Options > Build, Browser ID and change
"Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98)" from Browser "Identity" to HTTrack Website Copier/3.0x (offline browser; web mirror utility)
Links and check "Get non-HTML files related to link, eg external .ZIP or pictures" "Get HTML files first!"

I have tested this with the Satan is God site, excluding ancient-forums.com and group-archives.com and it produced many errors, but these related to false errors...How ever there were some errors which were even apparent on the Satan is God site. Preferably the Arabic and French translations in

#7
This is the targeted message.
Jacksaid:

Do what I tell you to do in my post here ,did you read it ? You have to download each sub forum INDIVIDUALLY.

I did read it, and that's what I've been doing.

#8
NoCreativeNameHereV2said:
Jacksaid:

Do what I tell you to do in my post here ,did you read it ? You have to download each sub forum INDIVIDUALLY.

It's impossible to download each sub-forum individually, I got it to work on the Satan is God site by excluding the ancient-forums group-archives but that in my opinion follows a different structure compared to Ancient-forums.com. I've been trying ever since this post went up, searched all over the internet for help on how to do it. I even downloaded a certain script from github, however I'm unsure how to utilize the file.
After a bit of research on what a .sh file is, it is a file which is originally a Linux script and attempting to run the file on Windows command prompt will not work and you will need a a program called Cygwin. Here is the link in case anyone wants to have a try.

.sh file - https://gist.github.com/a1phanumeric/5474848

#9

This is an example of the results I've been having:
https://mega.nz/folder/mEwEWA7B#ssdiUb1BLvCuEqFk-YwO3A

Many pages are missing like page no. 8 or pages within an article.

#10
Coraxosaid:

This is an example of the results I've been having:
https://mega.nz/folder/mEwEWA7B#ssdiUb1BLvCuEqFk-YwO3A

Many pages are missing like page no. 8 or pages within an article.

That's the best you'll get. Is this all ? Then I'll manually save Pqge 8 and check the articles. You continue with the other Subforums. The lower count subforums shouldn't have this problem.

#11
Jacksaid:
Coraxosaid:

This is an example of the results I've been having:
https://mega.nz/folder/mEwEWA7B#ssdiUb1BLvCuEqFk-YwO3A

Many pages are missing like page no. 8 or pages within an article.

That's the best you'll get. Is this all ? Then I'll manually save Pqge 8 and check the articles. You continue with the other Subforums. The lower count subforums shouldn't have this problem.

It's not working,unfortunately. Can't open index file (shows file not found) and extraction showed many errors. Its not working on your computer. Someone else needs to do this.

#12

I put it on the list to actually generate something like that, I really hope it works. HTTrack is a great tool, it works, but you need to make sure to be 100% certain you set it up properly.

#15
Jacksaid:

Have you tried using HTTRACK and using a specific sub forum link like I outlined ? I'm almost certain it will save most of the particular subforum except some page numbers in the middle. One of my friends did exactly this and I posted the link in 2019 in a topic by someone named SATArchives. I think you can do it. Please try and report back, possibly the Important articles subforum.

You cannot save all of it at once, it doesn't work like that. Even within the Forum were at, you need to fragment it into parts for the Software to work effectively. And don't bother with trying to archive the main websites, I have the root folders which I'll post if needed.

Yes I'm using HTTRACK, whenever I downloaded any of sites especially "JoS Newsletter" which is the smallest of all sub-forums and yet it was downloading the other forums too. So you need to add filters in the "Scan Rules" in "Set Options" or else HTTRACK will download all sites.

May be different for everyone but I always ran into these problems. As I mentioned in my previous post, I would say the .sh file is a huge and absolutely mandatory to download the sites effectively but you can ignore Cygmax file. Adding the line below in "Scan Rules"

"http://domain.com/path/?querystring" '-*' '+http://domain.com/path/*' -v" without quotation marks and changing the first section to a small subforum site which contains the ?querystring and leaving the 2nd option as https://ancient-forums.com/ Then excluding all the other sites, for example: adding
-https://ancient-forums.com/viewforum.php?f=3 which is the main Jos Forum, will exclude it from being saved.

I'm downloading both the "JoS Newsletter" and the "JoS Activism - Zevism Internet Batallion" since they are the smallest forum, and due to adding filters to "Scan Rules" following the procedure:
https://ancient-forums.com/viewforum.php?f=27" '-*' '+https://ancient-forums.com/viewforum.php?f=4*' -v and excluding the
https://ancient-forums.com is only downloading those forums. So I believe everyone should be using the same Project Category but naming the Project Name to the forum/subforum you're downloading will be more helpful if we're going to be archiving it. And as I mentioned above with the extra option will ensure that all gif,images,pdf and zip files will be visible during offline viewing.

The file will include everything contained within those 2 subforums, other subforums such as the "Important Articles from JoS Ministry" will not work since I have excluded them from being downloaded, thats why using the same Project Category name and the Project Name assigned to the subforum will be a huge help in assuring that the site works without any errors.

Everyone who is reading this follow all the steps in Jacks post, then make updates using the images below. If anyone is confused on any of this please let me know and I'll try my best to help you :smile:

Download this file and extract it to the HTTRACK directory and paste it in the src folder. This will help with including and excluding sites to assure for faster download.





HAIL ZEUS AND ALL THOSE ALLIED TO HIM :smile:

#16
NoCreativeNameHereV2said:
Jacksaid:

Have you tried using HTTRACK and using a specific sub forum link like I outlined ? I'm almost certain it will save most of the particular subforum except some page numbers in the middle. One of my friends did exactly this and I posted the link in 2019 in a topic by someone named SATArchives. I think you can do it. Please try and report back, possibly the Important articles subforum.

You cannot save all of it at once, it doesn't work like that. Even within the Forum were at, you need to fragment it into parts for the Software to work effectively. And don't bother with trying to archive the main websites, I have the root folders which I'll post if needed.

Yes I'm using HTTRACK, whenever I downloaded any of sites especially "JoS Newsletter" which is the smallest of all sub-forums and yet it was downloading the other forums too. So you need to add filters in the "Scan Rules" in "Set Options" or else HTTRACK will download all sites.

May be different for everyone but I always ran into these problems. As I mentioned in my previous post, I would say the .sh file is a huge and absolutely mandatory to download the sites effectively but you can ignore Cygmax file. Adding the line below in "Scan Rules"

Maybe People should try this and report back.

#17
Jacksaid:

Maybe People should try this and report back.

step 7 didnt load, so I'm posting it again

#18
Powerofjusticesaid:

For some reason im having trouble with the download speeds. 1.2gigs dont take 2 hours its ridiculous, the issue lies elsewhere. Still, i'll do my best to finish the important articles.

Unfortunately this does take longer. My friend left it running the whole night and it ended only after 10 a.m in the morning, its some pretty hectic shit to be exact

#19
Anonymous666said:

ping

I am reaching towards a green apple.