Editing Evopedia

Warning: You are not logged in. Your IP address will be recorded in this page's edit history.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 1: Line 1:
Evopedia is an offline Wikipedia viewer. It allows to search for articles based on their title or the geographic location on a map. If there is a connection to the internet, even images are displayed.
Evopedia is an offline Wikipedia viewer. It allows to search for articles based on their title or the geographic location on a map. If there is a connection to the internet, even images are displayed.
-
'''The information here is partly outdated. Please visit the
+
Apart from the software you also need to download a specially prepared dump of the articles available here.
-
[http://evopedia.info project website].'''
+
== Dumps ==
== Dumps ==
-
'''BitTorrent'''
+
Dumping Wikipedia is a very time-consuming task. Please be patient or help creating the dumps.
-
Since downloads of the dumps caused 2 TB of data transfer on the server in one week, the big dumps are now only available via BitTorrent. Please install a [http://www.bittorrent.com BitTorrent client] (if not already installed on your system) to use the .torrent files.
+
Please report if you find errors in the dumps.
'''New dumps:'''
'''New dumps:'''
-
* [http://dumpathome.evopedia.info/dumps/finished List of dumps]
+
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_de_2010-01-17.zip German Wikipedia], 2010-01-17 (2.2 GB)
-
Note that you need evopedia version 0.3.0 (NOT 0.3.0 RC 3) for the search function to work properly for languages not based on the latin alphabet.
+
'''Converted dumps:'''
-
Dumping Wikipedia is a very time-consuming task. Please be patient or [http://dumpathome.evopedia.info/contribute help creating the dumps].
+
These dumps are from older versions of evopedia, some features may be missing.
-
Please report if you find errors in the dumps.
+
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_nl_2009-10-16.zip Dutch Wikipedia], 2009-10-16 (0.8 GB)
-
 
+
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_eo_2009-11-17.zip Esperanto Wikipedia], 2009-11-17 (0.1 GB)
-
'''Distributed dump processing'''
+
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_fr_2009-10-11.zip French Wikipedia], 2009-10-11 (1.9 GB)
-
* [http://dumpathome.evopedia.info/ Distributed dumping for evopedia at dumpathome].
+
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_it_2009-11-09.zip Italian Wikipedia], 2009-11-09 (1.7 GB)
 +
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_ja_2009-03-01.zip Japanese Wikipedia], 2009-03-01 (1.5 GB) (pages are a bit broken but content should be there)
 +
* [http://www.reitwiessner.de/openmoko/wikipedia_dumps/wikipedia_es_2009-11-16.zip Spanish Wikipedia], 2009-11-16 (1.4 GB)
== Dump Installation ==
== Dump Installation ==
Line 30: Line 31:
== Tweaks ==
== Tweaks ==
-
Evopedia creates a configuration file at <code>/home/user/.evopediarc</code> when it is first started. Most of the options are self-explanatory.
+
Evopedia creates a configuration file at /home/user/.evopediarc when it is first started. Most of the options are self-explanatory.
By changing listen_address to 0.0.0.0 you (or anybody else, so be careful) can also access evopedia from a different computer using the url http://<ip adress of your device>:8080/
By changing listen_address to 0.0.0.0 you (or anybody else, so be careful) can also access evopedia from a different computer using the url http://<ip adress of your device>:8080/
Line 41: Line 42:
== Creating a Wikipedia Dump ==
== Creating a Wikipedia Dump ==
-
 
-
'''Please consider joining the distributed dump system mentioned above. Also, the information below is a bit outdated.'''
 
Creating a Wikipedia dump is unfortunately a rather lengthy process (some days). If you have any suggestions for speeding it up, please step forward. Concerning space, 20 GB should be enough for creating the dump.
Creating a Wikipedia dump is unfortunately a rather lengthy process (some days). If you have any suggestions for speeding it up, please step forward. Concerning space, 20 GB should be enough for creating the dump.
Line 50: Line 49:
==== 1. install needed software (please add packages if I forgot some): ====
==== 1. install needed software (please add packages if I forgot some): ====
-
apt-get install php5-cli php5-mysql python mysql-server mysql-client wget zip tidy git-core texlive texlive-math-extra
+
apt-get install php5-cli php5-mysql python mysql-server mysql-client wget zip tidy git-core latex
-
 
+
-
On some distributions, texlive must be replaced by tetex and texlive-math-extra by tetex-extra
+
==== 2. download evopedia source code ====
==== 2. download evopedia source code ====
-
git://gitorious.org/evopedia/evopedia.git
+
 
-
+
git clone git://github.com/crei/evopedia.git
-
Note: '''Please don't use the github address anymore, it's deprecated:'''
+
-
<strike>git clone git://github.com/crei/evopedia.gitr (deprecated) </strike>
+
==== 3. adjust settings ====
==== 3. adjust settings ====
-
Set php's memory_limit to some higher value (128 MB) in <code>/etc/php5/cli/php.ini</code> (or similar)
+
set php's memory_limit to some higher value (128 MB) in /etc/php5/cli/php.ini (or similar)
-
Create empty mysql database and grant all rights to some user -
+
create empty mysql database
-
e.g. for database named ''wikidb'', user ''thomas'' and password ''x1lx'':
+
-
> mysql -p
+
-
mysql> create database wikidb;
+
-
mysql> grant all privileges on wikidb.* to thomas@localhost identified by 'x1lx';
+
-
Edit paths and database settings in <code>dumpscripts/createdump.sh</code>
+
edit paths and database settings in dumpscripts/createdump.sh
-
(especially: dbuser, password, REPODIR, DUMPDIR) - make sure DUMPDIR points to area with plenty of space
+
-
Change the dump language ("de" in "for" statement at bottom of dumpscripts/createdump.sh)
+
change the dump language (bottom of dumpscripts/createdump.sh)
-
 
+
-
Make <code>~/evopedia/evopedia/evopedia/*.py</code> files executable (chmod a+x ...).
+
==== 4. start the dump process ====
==== 4. start the dump process ====
-
call <code>createdump.sh</code>
+
call createdump.sh
-
 
+
-
(Don't be too optimistic though. After part of the day the database is filled with several gigabytes of downloaded wikipedia content, but something is broken and the final dump gives no results.)
+
[[Category:Software]]
[[Category:Software]]

Learn more about Contributing to the wiki.


Please note that all contributions to maemo.org wiki may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see maemo.org wiki:Copyrights for details). Do not submit copyrighted work without permission!


Cancel | Editing help (opens in new window)