Editing Improving Modest email sync reliability
Warning: You are not logged in.
Your IP address will be recorded in this page's edit history.
The edit can be undone.
Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
- | Lots of complains have been reported regarding Modest | + | Lots of complains have been reported regarding Modest N900 email client. Particularly when it comes to sync emails. Quoting [http://talk.maemo.org/showthread.php?t=37225 DaveQB]: |
# It takes about 20mins to check my email. | # It takes about 20mins to check my email. | ||
Line 33: | Line 33: | ||
This deb file can be found, see links section at the end of this page. | This deb file can be found, see links section at the end of this page. | ||
- | First, copy mutt deb file to your N900 (scp, mail, etc...) and install it | + | First, copy mutt deb file to your N900 (scp, mail, etc...) and install it as root: |
sudo gainroot | sudo gainroot | ||
Line 39: | Line 39: | ||
You then need to write your .muttrc file to setup your IMAP account connection. Here's my basic muttrc file I used to access my Gmail account: | You then need to write your .muttrc file to setup your IMAP account connection. Here's my basic muttrc file I used to access my Gmail account: | ||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | # IMAP | + | # General |
- | set imap_authenticators="login" | + | set move=no |
- | set imap_passive="no" | + | set quit=ask-yes |
- | set imap_user = 'username' | + | set timeout=15 |
- | set imap_pass = 'password' | + | auto_view text/html |
- | set spoolfile = imaps://imap.gmail.com:993/INBOX | + | set realname="Sebastien Lelong" |
- | set folder = imaps://imap.gmail.com:993 | + | |
- | set record="imaps://imap.gmail.com/[Gmail]/Sent Mail" | + | # IMAP |
- | set maildir_trash = yes | + | set imap_authenticators="login" |
- | set postponed="imaps://imap.gmail.com/[Gmail]/Drafts" | + | set imap_passive="no" |
- | set header_cache = yes | + | set imap_user = 'username' |
- | set smtp_url = smtp://username@gmail.com@smtp.gmail.com:587/ | + | set imap_pass = 'password' |
- | set smtp_pass = "password" | + | set spoolfile = imaps://imap.gmail.com:993/INBOX |
- | + | set folder = imaps://imap.gmail.com:993 | |
+ | set record="imaps://imap.gmail.com/[Gmail]/Sent Mail" | ||
+ | set maildir_trash = yes | ||
+ | set postponed="imaps://imap.gmail.com/[Gmail]/Drafts" | ||
+ | set header_cache = yes | ||
+ | set smtp_url = smtp://username@gmail.com@smtp.gmail.com:587/ | ||
+ | set smtp_pass = "password" | ||
+ | |||
Replace username and password as needed. Launch mutt: | Replace username and password as needed. Launch mutt: | ||
Line 73: | Line 73: | ||
== offlineimap to read emails when no network connection is available == | == offlineimap to read emails when no network connection is available == | ||
- | While one major advantage to IMAP protocol is being able to directly and remotely access emails on an account, when you don't have any network connection, you just can | + | While one major advantage to IMAP protocol is to being able to directly and remotely access emails on an account, when you don't have any network connection, you just can access them... A workaround is to use a tool like [http://wiki.github.com/jgoerzen/offlineimap/ OfflineIMAP], which can synchronize an IMAP account with a local maildir. |
This sync occurs both ways: changes on IMAP account will propagate to maildir, changes on maildir will propagate to IMAP account. This ensure what you'll locally read will also be marked as read on the IMAP server. | This sync occurs both ways: changes on IMAP account will propagate to maildir, changes on maildir will propagate to IMAP account. This ensure what you'll locally read will also be marked as read on the IMAP server. | ||
- | In order to use offlineimap, I had to get last sources including patches to select only emails not olders than X days. This will prevent getting *all* emails from the server (headers and bodies)... | + | In order to use offlineimap, I had to get last sources including patches to select only emails not olders than X days. This will prevent getting *all* emails from the server (headers and bodies)... You'll find a link at the end of this page to download a very quick & dirty deb package for offlineimap. Install it as root: |
sudo gainroot | sudo gainroot | ||
- | + | dpkg -i offlineimap_6.2.1_all.deb | |
exit | exit | ||
- | Once installed, you'll need to create | + | Once installed, you'll need to create ~/.offlineimaprc in order to define remote IMAP and local maildir accounts. Here's mine, again minimalist. See offlineimap.conf on OfflineIMAP website to figure out possible options. |
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | [ | + | [general] |
- | + | accounts = GMail | |
- | + | ui = Noninteractive.Basic | |
- | + | ||
- | [Repository Local] | + | [Account GMail] |
- | type = Maildir | + | localrepository = Local |
- | localfolders = ~/Mail/GMail | + | remoterepository = Remote |
- | + | maxage = 5 | |
- | + | ||
- | [Repository Remote] | + | [Repository Local] |
- | type = Gmail | + | type = Maildir |
- | remoteuser = username | + | localfolders = ~/Mail/GMail |
- | remotepass = password | + | |
- | realdelete = no | + | [Repository Remote] |
- | trashfolder = [Gmail].Trash | + | type = Gmail |
- | + | remoteuser = username | |
- | + | remotepass = password | |
- | + | realdelete = no | |
- | We | + | trashfolder = [Gmail].Trash |
+ | |||
+ | |||
+ | We basically telling offlineimap to sync a GMail IMAP account on a local maildir located in ~/Mail/GMail. Only emails younger than 5 days will be considered. All IMAP directories will be synced (no filter). | ||
Also create maildir location: | Also create maildir location: | ||
Line 116: | Line 113: | ||
Finally, because my deb packaging isn't that good, let's create a wrapper bash script to run offlineimap: | Finally, because my deb packaging isn't that good, let's create a wrapper bash script to run offlineimap: | ||
- | + | ||
- | #!/bin/bash | + | #!/bin/bash |
- | offlineimap 2>&1 | tee /tmp/offlineimap.log | + | PYTHONPATH=/scratchbox/tools/lib/python2.3/site-packages /scratchbox/tools/bin/offlineimap 2>&1 | tee /tmp/offlineimap.log |
- | echo Last run: `/bin/date` | + | echo Last run: `/bin/date` |
- | + | ||
- | Save this script in | + | Save this script in ~/bin (for instance) as "syncemail.sh", and make executable: |
chmod +x syncemail.sh | chmod +x syncemail.sh | ||
- | Each time it's launched, you can check what it does looking as | + | Each time it's launched, you can check what it does looking as /tmp/offlineimap.log. |
Time to test. Run it ! | Time to test. Run it ! | ||
Line 141: | Line 138: | ||
autorefresh = 15 | autorefresh = 15 | ||
- | this will tell offlineimap to sync every 15 minutes. Since it'll always run, you need to "daemonize" it when starting it. This | + | this will tell offlineimap to sync every 15 minutes. Since it'll always run, you need to "daemonize" it when starting it. This init script can be saved as /etc/init.d/offlineimap to start it at boot time: |
+ | |||
+ | #!/bin/sh | ||
+ | # License is public domain. | ||
+ | |||
+ | DAEMON=/home/user/bin/syncemail.sh | ||
+ | |||
+ | test -x $DAEMON || exit 1 | ||
+ | set -e | ||
+ | |||
+ | if pgrep offlineimap > /dev/null; then | ||
+ | running=yes | ||
+ | else | ||
+ | running=no | ||
+ | fi | ||
+ | |||
+ | case "$1" in | ||
+ | start) | ||
+ | echo -n "Starting offlineimap" | ||
+ | su - user -c "/sbin/start-stop-daemon --background --start --exec $DAEMON" | ||
+ | echo "." | ||
+ | ;; | ||
+ | stop) | ||
+ | if test $running = yes; then | ||
+ | echo "Stopping offlineimap" | ||
+ | pkill offlineimap | ||
+ | echo "." | ||
+ | else | ||
+ | echo "offlineimap is already stopped." | ||
+ | fi | ||
+ | ;; | ||
+ | *) | ||
+ | echo "Usage: /etc/init.d/offlineimap {start|stop}" >&2 | ||
+ | exit 1 | ||
+ | ;; | ||
+ | esac | ||
+ | |||
+ | exit 0 | ||
+ | |||
+ | |||
+ | Don't forget to make it executable: | ||
+ | |||
+ | chmod +x /etc/init.d/offlineimap | ||
+ | |||
+ | CAREFUL: in syncemail.sh script, offlinemap will log into /tmp/offlineimap.log. Since we're daemonizing it, it'll run indefinitely. This log file may become huge. When fully tested, you should remove "2>&1 | tee /tmp/offlineimap.log" from syncemail.sh script. | ||
+ | |||
+ | Then register it as boot script: | ||
+ | |||
+ | update-rc.d offlineimap defaults | ||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
So far so good, we have our emails synced. We can read them using mutt. Still, we may like to use a graphical front-end, fully integrated to N900 system (applet, widgets, contacts, etc...). | So far so good, we have our emails synced. We can read them using mutt. Still, we may like to use a graphical front-end, fully integrated to N900 system (applet, widgets, contacts, etc...). | ||
Line 160: | Line 196: | ||
If only Modest could directly access our local maildir... Since it only support POP and IMAP account, we could install a local IMAP server, serving our maildir. Modest would then access this local IMAP server. This way, the remote sync part is delegated to offlineimap, while we can still use GUI front-ends. You'll still need to tell Modest to sync to the local maildir to check new emails. A short interval, 5 min, will ensure it'll be able to sync (since it's local, there's no network related issue anymore). | If only Modest could directly access our local maildir... Since it only support POP and IMAP account, we could install a local IMAP server, serving our maildir. Modest would then access this local IMAP server. This way, the remote sync part is delegated to offlineimap, while we can still use GUI front-ends. You'll still need to tell Modest to sync to the local maildir to check new emails. A short interval, 5 min, will ensure it'll be able to sync (since it's local, there's no network related issue anymore). | ||
- | So, there are many IMAP server out there, I found dovecot to be easy to package and use. | + | So, there are many IMAP server out there, I found dovecot to be easy to package and use. See end of page for a link to deb file. Install it as root |
sudo gainroot | sudo gainroot | ||
- | + | dpkg -i dovecot_1.2.11-1_armel.deb | |
exit | exit | ||
Line 171: | Line 207: | ||
cp /usr/local/etc/dovecot-example.conf /usr/local/etc/dovecot.conf | cp /usr/local/etc/dovecot-example.conf /usr/local/etc/dovecot.conf | ||
- | Dovecot is very powerful, you can set a lot of parameters. I tried to keep it as simple as possible. Dovecot will | + | Dovecot is very powerful, you can set a lot of parameters. I tried to keep it as simple as possible. Dovecot will /etc/passwd as it's user/password database. Here's my dovecot.conf file: |
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | ||
- | + | base_dir = /var/run/dovecot/ | |
- | + | protocols = imap | |
- | + | listen = 127.0.0.1 | |
- | + | disable_plaintext_auth = no | |
+ | ssl = no | ||
+ | login_user = dovecot | ||
+ | mail_location = maildir:~/Mail/GMail/INBOX | ||
- | + | protocol imap { | |
+ | } | ||
- | + | auth default { | |
- | + | ||
+ | mechanisms = plain | ||
+ | |||
+ | passdb passwd { | ||
+ | } | ||
+ | |||
+ | userdb passwd { | ||
+ | } | ||
- | + | user = root | |
- | + | } | |
- | |||
- | |||
- | |||
Note dovecot will serve INBOX only (more work/search to be done in order to serve multiple maildirs...). Since we'll use it locally, we can specify an IP address to listen. Else you (or someone else) could access your IMAP account using Wifi for instance. | Note dovecot will serve INBOX only (more work/search to be done in order to serve multiple maildirs...). Since we'll use it locally, we can specify an IP address to listen. Else you (or someone else) could access your IMAP account using Wifi for instance. | ||
Line 202: | Line 238: | ||
dovecot -n | dovecot -n | ||
+ | |||
Dovecot auth will be done under user "dovecot". We need to create it: | Dovecot auth will be done under user "dovecot". We need to create it: | ||
Line 212: | Line 249: | ||
sudo gainroot | sudo gainroot | ||
passwd user | passwd user | ||
+ | |||
Launch dovecot, as root | Launch dovecot, as root | ||
Line 226: | Line 264: | ||
* OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN] Dovecot ready. | * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=PLAIN] Dovecot ready. | ||
- | In order dovecot to be started at boot time, you can create this | + | In order dovecot to be started at boot time, you can create this init script as /etc/init.d/dovecot (taken from []) |
+ | |||
+ | # License is public domain. | ||
+ | |||
+ | DAEMON=/usr/local/sbin/dovecot | ||
+ | |||
+ | test -x $DAEMON || exit 1 | ||
+ | set -e | ||
+ | |||
+ | base_dir=`$DAEMON -a|grep '^base_dir: '|sed 's/^base_dir: //'` | ||
+ | pidfile=$base_dir/master.pid | ||
+ | |||
+ | if test -f $pidfile; then | ||
+ | running=yes | ||
+ | else | ||
+ | running=no | ||
+ | fi | ||
+ | |||
+ | case "$1" in | ||
+ | start) | ||
+ | echo -n "Starting Dovecot" | ||
+ | $DAEMON | ||
+ | echo "." | ||
+ | ;; | ||
+ | stop) | ||
+ | if test $running = yes; then | ||
+ | echo "Stopping Dovecot" | ||
+ | kill `cat $pidfile` | ||
+ | echo "." | ||
+ | else | ||
+ | echo "Dovecot is already stopped." | ||
+ | fi | ||
+ | ;; | ||
+ | reload) | ||
+ | if test $running = yes; then | ||
+ | echo -n "Reloading Dovecot configuration" | ||
+ | kill -HUP `cat $pidfile` | ||
+ | echo "." | ||
+ | else | ||
+ | echo "Dovecot isn't running." | ||
+ | fi | ||
+ | ;; | ||
+ | restart|force-reload) | ||
+ | echo -n "Restarting Dovecot" | ||
+ | if test $running = yes; then | ||
+ | kill `cat $pidfile` | ||
+ | sleep 1 | ||
+ | fi | ||
+ | $DAEMON | ||
+ | echo "." | ||
+ | ;; | ||
+ | *) | ||
+ | echo "Usage: /etc/init.d/dovecot {start|stop|reload|restart|force-reload}" >&2 | ||
+ | exit 1 | ||
+ | ;; | ||
+ | esac | ||
+ | |||
+ | exit 0 | ||
+ | |||
+ | Then register it (as root): | ||
+ | |||
+ | update-rc.d dovecot defaults | ||
- | |||
- | |||
- | |||
- | |||
- | |||
Now open Modest, and add a new account: | Now open Modest, and add a new account: | ||
Line 244: | Line 338: | ||
About SMTP, you can use the one you're used to use. Another improvement would be to install a small local SMTP server, and let it send its emails when it can. So far SMTP sending works with Modest, so I didn't dig further. | About SMTP, you can use the one you're used to use. Another improvement would be to install a small local SMTP server, and let it send its emails when it can. So far SMTP sending works with Modest, so I didn't dig further. | ||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
== Conclusions == | == Conclusions == | ||
Line 267: | Line 350: | ||
* ... | * ... | ||
- | == | + | == Links == |
- | + | ||
- | + | ||
* [http://dl.dropbox.com/u/7090003/dovecot_1.2.11-1_armel.deb dovecot_1.2.11-1_armel.deb] | * [http://dl.dropbox.com/u/7090003/dovecot_1.2.11-1_armel.deb dovecot_1.2.11-1_armel.deb] | ||
Line 275: | Line 356: | ||
* [http://dl.dropbox.com/u/7090003/mutt_1.5.20-2_armel.deb mutt_1.5.20-2_armel.deb] | * [http://dl.dropbox.com/u/7090003/mutt_1.5.20-2_armel.deb mutt_1.5.20-2_armel.deb] | ||
* [http://dl.dropbox.com/u/7090003/offlineimap_6.2.1_all.deb offlineimap_6.2.1_all.deb] | * [http://dl.dropbox.com/u/7090003/offlineimap_6.2.1_all.deb offlineimap_6.2.1_all.deb] | ||
- | |||
- | |||
Line 284: | Line 363: | ||
Seb | Seb | ||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- | |||
- |
Learn more about Contributing to the wiki.