Author Topic: Resurecting x10's forum?  (Read 14156 times)

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Resurecting x10's forum?
« on: August 05, 2013, 09:36:15 AM »
Many users are interested in having this info saved.

What exactly should be salvaged?
Can this legally be done?
Would this be opening a can of worms?
So many questions ::)

If someone can get the forum rebuilt there are some that can access all parts of it (myself included)
The X10forum was run original using Simple Machines 1.1.2 if memory serves me right.
It also had some customization done that makes it difficult to upgrade.
It was however updated to 1.1.4  with a lot of work.

I have someone looking at the files that was familiar with the customization of the forum.
What will result from it is any ones guess.
« Last Edit: August 06, 2013, 03:50:55 PM by Tuicemen »
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #1 on: August 05, 2013, 10:02:32 AM »
It is starting to look like I will not be able to host the X10 Forum archive after all.  It is apparently just too big for the level of service that I have.

There are about 120,000 files, and the unpacked size is almost 6GB.  Uploading individual files was terminated at 1GB, so I tried to unpack the archive directly on the server.  That process terminated at 760MB.

What I will do for now is host the packed archive, but even that is over 300MB.  I am hesitant to make it publicly available to keep the bandwidth demands reasonable.

I'm going to try to identify the files associated with just the automation and troubleshooting boards, and see if I can upload just that portion.

Jeff
X10 automation since the BSR days...

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #2 on: August 05, 2013, 10:24:05 AM »
I managed to unpack the files and can view all sections viewable to a guest.
However I'm unable to logon and edit or post this is most likely because of the customization done to the forum as it looks for info from another location which isn't accessible.
I've started to upload all files to my server so users may be able to at least look up old info.
That is if I don't run into the same issues as you Jeff.
In any case there are others working on this and my hopes are high that the old X10 Web master can access everything to make it a working forum again.

All isn't lost! ;)
 
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #3 on: August 05, 2013, 11:22:33 AM »
It doesn't appear feasible to pair down the size to just the automation boards.  While it is easy to identify each of the indexes (Airpad boards are 130-135), the individual topics themselves have random numbers - probably based on when that topic was created in the sequence.  So it is not possible to sort the topics into groups for each of the boards.  There may be some tool out there that can do that, but it is impossible to do manually.

I will try to resurrect my own "child board" on Powerline Control Reliability, but even that encompasses almost a hundred files.  The more popular boards have thousands of files.

Sorry this isn't working out as I had hoped.

Jeff
X10 automation since the BSR days...

noam

  • Active Newbie
  • *
  • Posts: 7
Re: Resurecting x10's forum?
« Reply #4 on: August 05, 2013, 11:30:56 AM »
Jeff -
Thanks for trying.
I know that Tuicemen (and maybe others) are working on a better way to do it. As individual HTML files, these forums can get rather large, especially if they were captured using a crawler that follows every link, even ones that were already covered another way.
If we can get a "real" export of the forums (in their native format), I'm guessing that would be a lot smaller, and could probably be imported into a new SMF instance more easily.

Since the old forums can be still be accessed by IP, there is hope that one of the old admins might be able to pull a full backup of the old forums.

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #5 on: August 05, 2013, 01:39:09 PM »
The best way to get this is using FileZila in binary mode and download the forums complete folder and all sub folders.
Once that is done a new file needs to be added to repair info in the setup file that points to the new location of the folders.
Since I have the same files as Jeff it looks like I may be missing some folders.
I'm unable to access the site from my location for what ever reason so I can grab using FileZila.
I'm uploading what I have to my server in an attempt to get something working but I still have over 4 gigs to go.
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #6 on: August 05, 2013, 02:12:37 PM »
Thanks to the efforts of Tuicemen and the folks at Authinx, the Powerline Control Reliability board is back on line:

    http://forums.x10.com/index.php?board=102.0

Jeff
« Last Edit: September 20, 2016, 06:20:24 AM by Jeff »
X10 automation since the BSR days...

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #7 on: August 06, 2013, 05:27:41 AM »
There are a couple of files that cause upload error these may have been what cause Jeff's file uploads to fail.
FileZile just reports these files and continues on.
I still have over 1.5 gigs in queue once it is finished I'll see what the problem files are and retry them.
I have a few tricks to try to enable this to be resurrected but there are source files that are missing.
A update or reinstall of SMF may help with that ???
I've yet to hear anything from my X10 IT contact.
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #8 on: August 06, 2013, 07:02:12 AM »
There are a couple of files that cause upload error these may have been what cause Jeff's file uploads to fail.

In my case I believe it was the sheer size of the upload.  Reading the terms of service again in detail, they say they do "NOT provide unlimited space for online storage, backups, or archiving of electronic files, documents, log files, etc".  And they do mention 2GB as an upper limit for a database.  Going beyond that can result in additional fees or termination of service.

The next step up in service would provide sufficient capacity, but it would increase my cost by a factor of four.  I would be willing to do that if the forum could be reconstructed to the point that it would be active again, and not just a dead archive.

The compressed file is available if someone wants to recreate the archive on their own computer.

Jeff
X10 automation since the BSR days...

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #9 on: August 06, 2013, 04:11:37 PM »
I finally got all files uploaded to my server.
However besides it missing several folders it is missing crucial sub folders and files from the folders that were copied.

I've attempted a rebuild using 1.1.4 version install files  (the  version the forum was running)  as well as attempting a repair settings.
Both attempts have failed but I'm getting write errors. The file attributes need to be set by my server host as my attempts have failed :'(
I'm doubtful this will allow a rebuild or repair at this point but there is nothing to lose right now. ::)

I've also requested the x10 forum files or for it to be reactivated however I doubt anyone (real person) will reply.
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #10 on: August 06, 2013, 05:56:07 PM »
I finally got all files uploaded to my server.
However besides it missing several folders it is missing crucial sub folders and files from the folders that were copied.

When I unpacked the files on my PC, I was able to enter at the top and then select any of the individual boards and topics in them.  They are all strictly read-only, but the structure appears to be complete except for the search tool.  And obviously, all the links that went to the previous X10 website are now dead.

I think that if I was able to upload all 120,000 files to my server, it would have worked the same as it does here on my PC.  You can check the one board that I did upload:

    http://jvde.us/x10_forum_pcr/index.php@board=102.0.html

I understand this is just the html file structure, and it is not running on the forum software.

Jeff
X10 automation since the BSR days...

mldenison

  • Active Newbie
  • *
  • Posts: 5
Re: Resurecting x10's forum?
« Reply #11 on: August 06, 2013, 06:16:09 PM »
Pretty neat, Jeff.  Good work.

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #12 on: August 07, 2013, 06:37:22 AM »

I think that if I was able to upload all 120,000 files to my server, it would have worked the same as it does here on my PC.  You can check the one board that I did upload:

    http://jvde.us/x10_forum_pcr/index.php@board=102.0.html

I understand this is just the html file structure, and it is not running on the forum software.

Jeff
Don't get me wrong, I do have the forum setup using the html files structure.
However there were files that lead me to believe this could be more then just a data base.
I was hoping to have something other then that similar to The Way back machine
I'm cleaning up the extras I added trying to get a working forum but at least we have a read only data base which stopped being active July 29, 2013, 12:44:34 PM :)
I'll try to keep this up until hopefully someone reactivates the forum
The X10 Forms
X10 turned me into a Software programmer.
A warning label should have been added ;)

Jeff

  • Administrator
  • Hero Member
  • *****
  • Posts: 216
    • Owner, JV Digital Engineering
Re: Resurecting x10's forum?
« Reply #13 on: August 07, 2013, 06:59:19 AM »
Quote
Don't get me wrong, I do have the forum setup using the html files structure.
However there were files that lead me to believe this could be more then just a data base.
I was hoping to have something other then that similar to The Way back machine
I'm cleaning up the extras I added trying to get a working forum but at least we have a read only data base which stopped being active July 29, 2013, 12:44:34 PM :)
I'll try to keep this up until hopefully someone reactivates the forum
The X10 Forms

That's GREAT!  It is exactly what I was trying to do myself until I ran into the size limitations.

Jeff
X10 automation since the BSR days...

Tuicemen

  • Administrator
  • Hero Member
  • *****
  • Posts: 267
  • Software Developer
    • Tuicemens Software
Re: Resurecting x10's forum?
« Reply #14 on: August 07, 2013, 08:14:18 AM »
There still is a lot of unnecessary files that can be removed to free up some space.
I'll slowly get them removed.
I only wish (still hope) a working X10forum could/can be recreated. ???
X10 turned me into a Software programmer.
A warning label should have been added ;)

 

succession-resounding