Editing Migrating to Community-driven Infrastructure

Warning: You are not logged in. Your IP address will be recorded in this page's edit history.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 1: Line 1:
-
'''please somebody does a major rework of this page, to a new wiki page like "community maemo.org infra - at IPHH" and clean out all the history data that doesn't give any useful info anymore. Also splitting off the autobuilder stuff into a separate page might help'''
 
-
'''''--[[User:joerg_rw|joerg_rw]] 15:20, 4 June 2013 (UTC)'''''
 
-
 
-
Started to move stuff
 
-
 
-
http://wiki.maemo.org/Maemo.org_Infrastructure
 
-
 
-
http://wiki.maemo.org/Maemo.org_Infrastructure/Autobuilder
 
-
 
-
Please use Categories below for any future pages of this topic
 
-
<pre>
 
-
[[Category:maemo.org]]
 
-
[[Category:Infrastructure]]
 
-
</pre>
 
-
 
-
'''''--[[User:sixwheeledbeast|sixwheeledbeast]] 20:46, 5 June 2013 (UTC)'''''
 
-
 
-
Suggest maintainers should be removed an [[Maemo.org_team]] page should be updated
 
-
 
-
'''''--[[User:sixwheeledbeast|sixwheeledbeast]] 20:50, 5 June 2013 (UTC)'''''
 
-
 
== Introduction ==
== Introduction ==
-
[2013-11-07] migration to our own servers at IPHH accomplished since ~6 months now, below info is for historical documentation.
 
-
 
[up to date as of 2013-02-08]
[up to date as of 2013-02-08]
-
 
Albeit Nokia's plans about discontinuation of maemo support been known since spring 2012, Nokia gave "Go" to Nemein (service provider on behalf of Nokia) for the real migration work not earlier than 2 weeks before christmas 2012.
Albeit Nokia's plans about discontinuation of maemo support been known since spring 2012, Nokia gave "Go" to Nemein (service provider on behalf of Nokia) for the real migration work not earlier than 2 weeks before christmas 2012.
Line 40: Line 16:
===further plans, state of migration===
===further plans, state of migration===
-
(obsolete. thus deleted. See wiki history if interested in what happened when)
+
Further plans are to migrate again to some hosted root servers, either on a sponsor like http://osuosl.org/about-osuosl or to our own stuff we may rent from e.g. Hetzner.
-
+
-
This page is intended as a central place where status and other operational information can be gathered.
+
-
=== Plan for migration / Timeline  [2013-03-15]===
+
[2013-02-08] currently we're in negotiations about 3 possible ways into future hosting:
 +
* osuosl (could provide VM or rootservers or CoLo [UPS server shipping: 48h:1200EUR, 7d:630EUR, +customs])
 +
* IPHH, a ISP in Hamburg. Falk contacted them and they are willing to offer CoLo basically free of charge. Of course we will put their name on our maemo.org frontpage to give due credit. HW service will be done by Falk. (costs ~300EUR for setup and HW upgrade, plus 50..300EUR for shipping the iron to Hamburg)
 +
* get own paid rootservers, like 2 of http://www.hetzner.de/en/hosting/produkte_rootserver/ex10 (costs ~300EUR/month, 400EUR setup)
 +
Depending on option chosen, we might or might not keep the SuperMicro.
-
* Friday, 22.2. (falk)
+
[2013-02-17] Hildon Foundation board has agreed on following IPHH and keeping OSUOSL open as an alternative if something with our "plan-A" goes awry. Tech staff wholheartedly agrees and will act occordingly, sending iron to IPHH/Falk on 2013-02-18/19, and also negotiating with OSUOSL about how a possible migration to them would look like so we get a decent checklist in case we need it.
-
** Rack Hardware @ IPHH - Hardware is racked
+
-
** Install base system (CentOS 6.3 with patches from xes)
+
-
* Saturday, 23.2. (xes/falk)
+
Falk's mail forwarded form IPHH to HiFo:
-
** Start migrating repository.m.o
+
<pre>
-
** Start migrating VMs with static data
+
Hi everyone,
-
* ... (hidden DNS master set up)
+
these are the details, what IPHH is willing to offer us.  
-
** sync databases, switch DNS entries
+
-
** DNS switched [Nokia] to new IPs on 2013-03-14 1700UTC. Final sync established 1900. since then machines up and running on *new*
+
-
VMs we need to migrate:
+
Best regards,
-
{|
+
Falk
-
! Name !! Disk Size !! Location of act. instance !! _migrated? !! _Comments on *new* instance
+
-
|+
+
-
| static || 30G || nemein || synced+up || works
+
-
|+
+
-
| wiki || 20G || nemein || synced+up || works
+
-
|+
+
-
| repository || 900G || nemein || synced+up || We need to check the disk size, this might be too big for current hw, maybe split tablets-dev off.
+
-
|+
+
-
| mail || 20G || nemein || synced+up || also has lists
+
-
|+
+
-
| scratchbox || 100G || iphh || setup! || will be setup new
+
-
|+
+
-
| vcs || 50G || nemein || synced+up || has NFS mounts from garage and repository (copying)
+
-
|+
+
-
| garage || 100G || nemein || synced+up || has NFS mounts from stage and vcs (copied, seems to work)
+
-
|+
+
-
| db || 100G || nemein || synced+up || works, needs tuning
+
-
|+
+
-
| builder || 50G || nemein || copied+up || still needs fixing several aspects
+
-
|+
+
-
| talk || 20G || nemein || synced+up || up since 2013-03-13, via HTTP-forward
+
-
|+
+
-
| dns || ?? || ipph || setup! || dns records/serial incomplete, bind inactive
+
-
|}
+
-
=== State of final migration ===
+
Begin forwarded message:
-
all VMs got migrated to IPHH server, DNS still owned and managed by Nokia [2013-05-29]
+
 +
> From: Rene Sasse <support@iphh.xxx>
 +
> Subject: [IPHH #442659] Re: maemo.org
 +
> Date: 18. Februar 2013 11:08:33 MEZ
 +
> To: falk@fourecks.xxx
 +
> Cc: joerg@openmoko.xxx
 +
> Reply-To: support@iphh.xxx
 +
>
 +
> Falk,
 +
>
 +
> IPHH offers the following services to Hildon Foundation for one year free of
 +
> charge:
 +
>
 +
> * Colocation/electricity for the following devices:
 +
> - 1 Server (2RU)
 +
> - 1 Switch (1RU)
 +
> * 1 100MBit/s Uplink Port
 +
> * A /27 IPv4 Network
 +
>
 +
> This offer is valid for one year and has to be discussed for renewal after 11
 +
> month.
 +
>
 +
> Legal Contact will be:
 +
>
 +
> Hildon Foundation
 +
> 120 West 10th Street, Erie, PA, 16501, USA
 +
>
 +
> Technical Contact will be:
 +
>
 +
> Falk Stern (FS7182-RIPE)
 +
> Rathmann-Cohrs-Straße 12, 21357 Bardowick, Germany
 +
> Mobile: +49-160-71560xx
 +
>
 +
>
 +
> best regards
 +
> Rene
 +
>
 +
> --
 +
> Rene Sasse                          E-Mail: support@iphh.xxx
 +
> Technical Consultant                Tel: +49 (0)40 374919-xx
 +
> IPHH Internet Port Hamburg GmbH      Fax: +49 (0)40 374919-xx
 +
> Wendenstrasse 408                    AG Hamburg, HRB 76071
 +
> D-20537 Hamburg                      Geschaeftsfuehrung: Axel G. Kroeger--7E94C7404EC25FD69CC85C3653348297
 +
>
 +
</pre>
 +
Iron to move form:  ( http://nemein.com/fi/ )
 +
Nemein Oy
 +
tel. +358 20-198 6030
 +
Vilhonvuorenkatu 11 D, 8 krs
 +
00500 Helsinki, FINLAND
 +
FIN-1647219-2
 +
    support AT nemein.com
-
==== Tips & Tricks for migration ====
+
to ( http://www.iphh.net/en/contact.html )
 +
  IPHH Internet Port Hamburg GmbH
 +
  #444615
 +
  Wendenstrasse 408
 +
  20537 Hamburg
 +
  Germany
 +
T : +49 40 37 49 19-0
 +
F : +49 40 37 49 19-29
 +
E : info@iphh.net
-
Copying:  
+
Package details:
 +
size
 +
  x: 100cm
 +
  y:  66cm
 +
  z: 28cm
 +
weight: ~40kg
-
Create an image on vmhost
 
-
<pre>fallocate -l 200g image.img</pre>
 
-
or, in case fallocate is unavailable
 
-
<pre>dd if=/dev/zero of=image.img bs=1 count=1 seek=200G</pre>
 
-
Attach as loop-device
 
-
<pre>losetup -f image.img</pre> (find the loop-device and create a filesystem on it)
 
-
Copy stuff
+
Hosting migration timing plan:
-
<pre>tar --create -p -j --one-file-system . | pv -br | ssh root@host 'cd /mountpoint ; tar xpj '</pre> or
+
  https://docs.google.com/spreadsheet/ccc?key=0AuQnrvWRbTtzdFhERzlDbEp0eVNQQTdfNWpQbzdIT0E&usp=sharing
-
<pre>cd / ; rsync -arvSxz . root@host:/mount/point</pre>
+
-
==== Stuff to do [2013-03-15] ====
 
-
* Implement a proper service monitoring for all machines and applications - nagios pending, http://monitor.maemo.org/ganglia/
+
Alternatives - however obvious - for the above plans have been discussed with Nemein and HiFo and are not feasible. E.G. there was no way we could get the money instead of the server iron hardware. Sustaining the current xen-grid based VM hosting would be ~1500EUR per month plus a basically not evadable 2200EUR on top for maintenace. We want to switch away from that by all means, thus the 2nd migration.
-
* Setup a common policy for root/user accounts and sudo permissions
+
-
* Change root-passwords - done
+
-
* Make SSH root-login key-only - done?
+
-
* Find out, what to sync for final migration - done
+
-
* Configure internal DNS server in /etc/resolv.conf
+
-
* Coordinate DNS setup with Nokia - partially done
+
-
* Consolidate Databases - WIP
+
-
* Add disks to system - done, 4TB on blade-a
+
-
* Setup bugtracking system for infrastructure - done: roundup?
+
-
* fix NFS mounts - WIP
+
-
* update VMs to 3.2.0-38
+
-
==== Problems we walked into ====
 
-
===== Machines throwing their network away =====
+
 +
This page is intended as a central place where status and other operational information can be gathered.
-
Apparently, XEN has issues if a vm sends too many/too large network packets.
+
== Inventory (obsolete, please update) ==
-
http://lists.xen.org/archives/html/xen-devel/2013-01/msg00198.html
+
As a first step we try to gather information about the present infrastructure at *.maemo.org. This "inventory" is intended to provide an overview about all components of the infrastructure as well as to provide information that will later on aid during the actual migration.
-
has an interesting read about that problem.  
+
-
Symptom:
+
Currently the following topics are considered important for the migration:
-
 
+
-
  xenbr1: port 8(vif51.0) entered forwarding state
+
-
  vif vif-51-0 vif51.0: Too many frags
+
-
  vif vif-51-0 vif51.0: fatal error; disabling device
+
-
  xenbr1: port 8(vif51.0) entered disabled state
+
-
 
+
-
in dmesg
+
-
 
+
-
Temporary fix: Disable all offloading on eth0
+
-
 
+
-
  for i in rx tx sg tso gso gro lro; do
+
-
          ethtool -K eth0 $i off
+
-
  done
+
-
 
+
-
Source of this problem:
+
-
 
+
-
https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable.git/commit/include/linux/skbuff.h?h=v3.3.1&id=9d4dde5215779f4099730194ad30624fdba3d8b2
+
-
 
+
-
 
+
-
We fixed that problem on our machines by ensuring dom0 and domU use same MAX_SKB_FRAGS
+
-
 
+
-
== Inventory ==
+
-
 
+
-
As a first step we gathered information about the former infrastructure at *.maemo.org. This "inventory" provided an overview about all components of the infrastructure as well as information that would later on aid during the migration.
+
-
 
+
-
The following topics were considered important for the migration:
+
* Legal Issues (Names, Trademarks, Domain Names, etc.)
* Legal Issues (Names, Trademarks, Domain Names, etc.)
* Infrastructure (Web Site, Forum, Wiki, Autobuilder, Mailinglists, Garage, etc.)
* Infrastructure (Web Site, Forum, Wiki, Autobuilder, Mailinglists, Garage, etc.)
 +
== Legal Issues ==
== Legal Issues ==
Line 205: Line 173:
== Operational Platform ==
== Operational Platform ==
-
[2013-03-20] All of maemo.org is running on our supermicro server colocated at IPHH
+
For now (2013-01,02) all services are implemented as VM running on Nemein's xen-grid. Plan is to migrate those VM to a virtualization installed on the serevrs (see below) that Nokia donates to the community. This hardware is located at Nemein office right now (2013-02-16) and '''should''' get shipped to iphh.net in Hamburg on Monday 2013-02-18.
List of hardware Nokia will donate to HiFo, according to Nemein's plans. [2013-02-08]
List of hardware Nokia will donate to HiFo, according to Nemein's plans. [2013-02-08]
Line 229: Line 197:
|-
|-
| 01
| 01
-
| blade-a.maemo.org
+
|  
|  
|  
|  
|  
Line 237: Line 205:
| http://www.supermicro.nl/products/system/2u/2027/SYS-2027TR-HTRF.cfm?parts=SHOW
| http://www.supermicro.nl/products/system/2u/2027/SYS-2027TR-HTRF.cfm?parts=SHOW
| 2U 19" Rackmount
| 2U 19" Rackmount
-
| Intel® Xeon® processor E5-2620
+
| 2 * Intel® Xeon® processor E5-2620
-
| 32GB
+
| 2 * 32GB
-
| (raid1:2*)1TB, 2*2TB=4TB aux.
+
| 2 * (raid1 2 * 1TB)
|
|
| 3 years
| 3 years
Line 246: Line 214:
|-
|-
| 02
| 02
-
| blade-b.maemo.org
+
|  
|  
|  
|  
|  
Line 254: Line 222:
|  
|  
|  
|  
-
| Intel® Xeon® processor E5-2620
+
|  
-
| 32GB
+
|
-
| (raid1:2*)1TB
+
|  
|
|
|
|
Line 262: Line 230:
|}
|}
-
http://wstaw.org/m/2013/06/02/plasma-desktopVf3743.png
 
=== OS and virtulization on community iron (planning, discussion) ===
=== OS and virtulization on community iron (planning, discussion) ===
Please don't forget to tag your contributions with your nick!
Please don't forget to tag your contributions with your nick!
Line 272: Line 239:
-
====Virtualization====
+
====Virtulization====
===== alternative A =====
===== alternative A =====
XEN (with OS blabla of above)
XEN (with OS blabla of above)
Line 297: Line 264:
| Maemo Main Web Site
| Maemo Main Web Site
| http://www.maemo.org
| http://www.maemo.org
-
| style="background-color:yellow;" |<span style="display:none">1</span> BUGS
+
| style="background-color:lime;" |<span style="display:none">1</span> DONE
 +
| ?
| ?
| ?
-
| Nemein
 
|
|
|
|
|
|
-
| orphaned links/404s: http://maemo.org/community/council/system_operator_needed/; '''Login doesn't work'''
+
| orphaned links/404s: http://maemo.org/community/council/system_operator_needed/
|  2013-01-25
|  2013-01-25
|-
|-
Line 319: Line 286:
| Maemo Wiki
| Maemo Wiki
| http://wiki.maemo.org
| http://wiki.maemo.org
-
| style="background-color:yellow;" |<span style="display:none">1</span> BUGS
+
| style="background-color:yellow;" |<span style="display:none">1</span> WIP
| ?
| ?
| Nemein
| Nemein
Line 325: Line 292:
|
|
|
|
-
| '''(Watch) Email not working'''; random connection timeouts
+
| (Watch) Email not working; random connection timeouts
| 2013-01-25
| 2013-01-25
|-
|-
| Repositories
| Repositories
| http://repository.maemo.org
| http://repository.maemo.org
-
| style="background-color:yellow;" |<span style="display:none">1</span> BUGS
+
| style="background-color:lime;" |<span style="display:none">1</span> DONE
| X-Fade, Merlin1981
| X-Fade, Merlin1981
| Nemein
| Nemein
Line 336: Line 303:
|
|
|
|
-
| former akamai serverfarm, now points to stage.m.o VM master of farm. '''Hashsum errors legacy'''
+
| former akamai serverfarm, now points to stage.m.o VM master of farm. Hashsum errors legacy
-
| 2013-02-20
+
| 2013-02-10
|-
|-
| Blog aggregator
| Blog aggregator
Line 369: Line 336:
|
|
|
|
-
| '''OFFLINE''', x-fade working on it
+
| OFFLINE, x-fade working on it
-
| 2013-02-20
+
| 2013-02-10
|-
|-
| Maemo Nameservers
| Maemo Nameservers
|  
|  
-
| style="background-color:yellow;" |<span style="display:none">1</span> WIP
+
| style="background-color:red;" |<span style="display:none">1</span> NST
-
| Merlin, Falk
+
| ?
| Nokia
| Nokia
|
|
|
|
|
|
-
| Still using Nokia Nameservers; following hidden primary plan til domain transfer to HiFo established
+
| Still using Nokia Nameservers
| 2013-01-25
| 2013-01-25
|-
|-
Line 407: Line 374:
| Listserv
| Listserv
| https://lists.maemo.org
| https://lists.maemo.org
-
| style="background-color:yellow;" |<span style="display:none">1</span> BUGS
+
| style="background-color:yellow;" |<span style="display:none">1</span> WIP
|  
|  
| Nemein
| Nemein
Line 413: Line 380:
|
|
|
|
-
| '''occasional lockups resp interface down'''
+
| occasional lockups
-
| 2013-02-20
+
| 2013-02-10
|-
|-
| Static
| Static
Line 424: Line 391:
|
|
|
|
-
| '''temporary fix via NAT port81 redir''', instable?
+
| temporary fix via NAT redir, instable?
-
| 2013-02-20
+
| 2013-01-25
|-
|-
| Stage
| Stage
| http://stage.maemo.org
| http://stage.maemo.org
-
| obsolete
+
| style="background-color:red;" |<span style="display:none">1</span> obsolete
| X-Fade
| X-Fade
| Nemein
| Nemein
Line 435: Line 402:
|
|
|
|
-
| VM got assigned to repository.m.o
+
| VM got assigned to repository.m.o via DNAT redir, DNS changes pending (remove stage, change repo)
-
| 2013-02-20
+
| 2013-01-25
|-
|-
| Bugs
| Bugs
Line 451: Line 418:
| Scratchbox
| Scratchbox
| http://scratchbox.org/
| http://scratchbox.org/
-
| style="background-color:yellow;" |<span style="display:none">1</span> WIP
+
| style="background-color:red;" |<span style="display:none">1</span> ?
-
| thedead1440
+
| ?
-
| Nemein, thedead1440
+
| Nemein
|
|
|
|
|
|
-
| 80.248.164.245, Logica Finland Oy, migration pending
+
| 80.248.164.245, Logica Finland Oy, migration pending, thedead1440
-
| 2013-02-20
+
| 2013-01-25
|-
|-
| Voting Infrastructure  
| Voting Infrastructure  
| ?
| ?
-
| style="background-color:yellow;" |<span style="display:none">1</span> WIP
+
| style="background-color:red;" |<span style="display:none">1</span> ?
| woody14619
| woody14619
|
|
Line 469: Line 436:
| ?
| ?
| ?
| ?
-
| 2013-02-20
+
| 2013-01-25
|}
|}
=== More Detailed Information ===
=== More Detailed Information ===
-
''this is based on what we got/found on Nemein temporary infra - it's NOT related/applicable to new IPHH infra. For IPHH new infra IPs [[Maemo.org_Infrastructure]]''
 
In this sub section more detailed information about the entries in the table can be placed. The intent is to keep the table concise while still being able to have all relevant information at hand.
In this sub section more detailed information about the entries in the table can be placed. The intent is to keep the table concise while still being able to have all relevant information at hand.
Line 488: Line 454:
  188.117.59.202      wiki.maemo.org
  188.117.59.202      wiki.maemo.org
  188.117.59.212      bugs.maemo.org
  188.117.59.212      bugs.maemo.org
-
  # 188.117.59.203      repository.maemo.org scrubbed
+
  188.117.59.203      repository.maemo.org
-
  188.117.59.205      stage.maemo.org repository.maemo.org (reassigned)
+
  188.117.59.205      stage.maemo.org
  188.117.59.206      vcs.maemo.org
  188.117.59.206      vcs.maemo.org
Line 556: Line 522:
These are the Service Maintainers (in spe), for services like forum (tmo), wiki, bugs, etc. They are (generally) not sysops of the machines their service is running on.
These are the Service Maintainers (in spe), for services like forum (tmo), wiki, bugs, etc. They are (generally) not sysops of the machines their service is running on.
-
{|
 
-
! From !! Nick !! Full Name !! E-Mail !! Services Maintained !! Status !! Comments
 
-
|+
 
-
| Nemein || mashiara || Rambo Eero af Heurlin ||  eero.afheurlin at <to be disclosed by owner> || (sysop) || || [leaving?] ||
 
-
|+
 
-
| Nemein || x-fade || Niels Breet || Niels<at>maemo.org || (mail, IRC, builder, ???...) || || [leaving?] ||
 
-
|+
 
-
| Nemein || ferenc || Ferenc Szekely ||  ferenc<at>maemo.org || (mail, sysop, ???...) || || [leaving?] ||
 
-
|+
 
-
| maemo || warfare || Falk Stern || falk<at>fourecks.de || (maemo master sysop) || ||
 
-
|+
 
-
| maemo || chemist || Ruediger Schiller || webmaster<at>talk.m.o || Talk || || ||
 
-
|+
 
-
| maemo || merlin1991 || Christian Ratzenhofer || <at> || Repos || || [preliminary accepted] ||
 
-
|+
 
-
| ??? || andre_ || Andre Klapper || ???<at>??? || Bugs || || [???] ||
 
-
|+
 
-
| || || || || ??? (wiki) || ||
 
-
|+
 
-
| || || || || (planet???) || ||
 
-
|}
 
-
== Unsorted Hints ==
+
<company> / <nick> | <full name> <email> (<list of services the maintainer is responsible for>) [<status if not "established">]
-
=== ssh access ===
+
-
All legacy accounts got ported to new infra.
+
-
Access to any VM is via plain direct ssh:
+
Nemein / mashiara | Rambo | Eero af Heurlin, eero.afheurlin at <to be disclosed by owner> (sysop)  [leaving?]
-
  ssh <user>@<VM>.maemo.org
+
-
=== backup ===
+
Nemein / x-fade | Niels BreetNiels at maemo.org (mail, IRC, builder, ???...) [leaving?]
-
we're doing backups to the 4TB auxiliary storage on blade-a, using backupPC:
+
-
  ssh -L8088:localhost:80 blade-a
+
-
  konqueror http://localhost:8088
+
-
backup-master is Falk
+
-
talk VM sysop (chem|st) has access to it and control over own backups, via ssh confic on blade-a:
+
Nemein / ferenc | Ferenc Szekelyferenc at maemo.org (mail, sysop, ???...) [leaving?]
-
  command="sleep 1d",permitopen="127.0.0.1:80" <ssh-pubkey>
+
-
== Steering ==
+
maemo / warfare |  Falk Stern, falk at fourecks.de (maemo master sysop)
-
council is in charge of any steering.
+
maemo / chemist | Ruediger Schiller, chemist at <to-be-disclosed-by-owner> (talk)
 +
maemo / merlin1991 | Christian Ratzenhofer ??? (repos) [preliminary accepted]
 +
 +
??? / andre_ | Andre Klapper, ??? at ??? (bugs)  [???]
 +
 +
??? / ???, ??? at ??? (wiki)
 +
 +
(planet???):...
 +
 +
...
 +
 +
== Steering ==
 +
council is in charge of any steering.
Joerg Reisenweber got appointed for "maemo.org infra administration coordinator" and thus is the single point of coordination for any detail questions.
Joerg Reisenweber got appointed for "maemo.org infra administration coordinator" and thus is the single point of coordination for any detail questions.
Line 605: Line 554:
* OBS @ TiZen or SuSe : https://bugs.tizen.org/jira/browse/TINF-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
* OBS @ TiZen or SuSe : https://bugs.tizen.org/jira/browse/TINF-48?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
-
 
-
* links: http://wiki.maemo.org/Maemo.org_team/Updating_maemo.org_sites
 
-
 
-
[[Category:maemo.org]]
 
-
[[Category:Infrastructure]]
 

Learn more about Contributing to the wiki.


Please note that all contributions to maemo.org wiki may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see maemo.org wiki:Copyrights for details). Do not submit copyrighted work without permission!


Cancel | Editing help (opens in new window)