Wiki Community/LocalWiki Migration

This page is a to-do list of things that need done before RocWiki moves to the LocalWiki code base.

TEST SITE: http://sapling.rocwiki.org/

Currently takes about 1.5 hours to export the database and 5 hours to import it into LocalWiki.

Snapshot production server
Restore snapshot onto new instance (Linode 2048 minimum!) and boot into Finnix
ssh into lish, do the following:

fsck /dev/xvda && mount /dev/xvda && cd /media/xvda
mount --bind /proc proc
mount --bind /dev/shm dev/shm
sysctl kernel.shmmax=150000000
chroot .
/etc/init.d/postgresql-8.3 start
cd /home/rocwiki/live_production/Sycamore
python user_export.py
python export.py --just_pages
python export.py --just_files
python export.py --just_maps

Copy dumps to sapling instance.

Import dumps and reindex: (NOTE: Check branch name in github URL)

sudo curl --location --output /usr/share/localwiki/env/src/localwiki-import-wikis/import_wikis/sycamore/syc_import.py https://github.com/rtucker/localwiki-import-wikis/raw/comment_model_support/import_wikis/sycamore/syc_import.py
sudo sed --in-place=.bak 's/\/home\/philip\/sycamore/\/home\/rtucker\/sycamore/' /usr/share/localwiki/env/src/localwiki-import-wikis/import_wikis/sycamore/syc_import.py
sudo localwiki-manage runscript syc_import --script-args=destroy *.xml 2>&1 | tee import_YYYYMMDD_HHMM.txt
sudo localwiki-manage rebuild_index

• RocWiki Export 2012-11-25: Imported on 11/28, 12/24, and 12/26
  

• RocWiki Export 2013-01-05: Imported on 1/6
  

• RocWiki Export 2013-01-19
  

• Import 1/19 (old import script revision; Pages: 10978, Redirects: 2280, Files: 5568, Comments: 9081)
  

• Import 1/20 (new import script revision; Pages: 10797, Redirects: 2230, Files: 5568, Comments: 8134)
  

• Import 1/20 x2 (comment newline fix; Pages: 10880, Redirects: 2248, Files: 5568, Comments: 9865)
  

• Import 1/21 (Pages: 10978, Redirects: 2280, Files: 5568, Comments: 10718)
  

• RocWiki Export 2013-01-27
  

• Import 1/27 (Pages: 10989, Redirects: 2281, Files: 5577, Comments: 10747)

• Commenting: basic functionality (adding comments, viewing comments) is in place, syc_import hooks are in progress
  

• Events Board

• User metadata (creation time, etc) is not transferred — Fixed in 7ab2afb
  

• Placeholder e-mail addresses — many e-mail addresses are missing from the RocWiki user database, and this needs fixed somehow. (Is there a user-settings section somewhere?)
  

• Users with old-style passwords need to be reset — Fixed in d6678ab; I can't recall if I tested this.
  

• Permissions on admin-only pages
  

• Extraneous quotes appear around geocoded addresses from import — Fixed in 1788fcf
  

• Some pages are missing: Conventions — Partial fix in 784da2, other fixes in later commits
  

• Flickr image resources are not being included — Fixed in bfe4417
  

• Redirects (particularly renamed pages) are not existing — Fixed in 721ebc9
  

• Strike-through not importing properly — Test page: Abandoned, fix at localwiki #414, committed in a3cbaa2b26
  

• Users not added to Authenticated group on import — fix in 4b6350e
  

• Banned users not added to Banned group on import — I don't think this is exported automatically, but it should be a relatively easy manual import. (Is this because I'm doing "unprivileged" exports?)
  

• Broken/hanging redirects — removed from RocWiki itself January 20th.
  

• Flickr macro ought to display the "isn't a valid Flickr image" placeholder when macro fails
  

• Multi-paragraph comments were not imported properly on 2013-01-05 run — test page is The Owl House, fix in 1aff15c922
  

• Some poorly-formatted comments are gumming up the works. These are being spotted and fixed in the live wiki.
  

• Comments with newlines before the signature are causing page imports to fail completely — test pages are Rochester Optical Stores and The Owl House, fix in dee6dbd
  

• Comment cache invalidation: comments are not showing up immediately w/o restarting memcached
  

• Comments in Recent Changes: shows 'new' icon, doesn't do diffing properly
  

• Comment sections with two HRs in a row crash the importer — test page is MicheleFineout, probable fix in 57c6bcf

• favicon — part of rocwiki theme on rocwiki-theme-elements branch... might revert to existing "RW" favicon, because the circle-R favicon isn't doing it for me yet
  

• RocWiki logo — part of rocwiki theme on rocwiki-theme-elements branch
  

• HTTPS
  

• Google Analytics

• Map polygons for cities, neighborhoods, parks, etc
  

• Tagging: add tags to existing pages
  

• Tags could, in many cases, replace directory pages (Caribbean Food, etc) — indeed, we should probably automatically tag each page linked from a directory page post-import — now possible with a script!
  

• Identify "meta pages" (pages with lists of other pages, on a theme) that could use auto-tagging
  

• Mobile templates: Django has mobile detection support, would be nice to have some mobile templates in the localwiki project :-)
  

• See Responsive milestone on localwiki github

Wondering When and IF RocWiki will be migrating to a LocalWiki installation? Currently, my TorontoWiki.org has been reduced to becoming a part of LocalWiki.org/Toronto and I feel that is incorrect. It must remain in its own full URL. What is the status of any potential RocWiki to LocalWiki migration? — HiMYSYeD