Search results for "Postorius" - Mailman-users

Initial success: Mailman 3.3 integrated with Zimbra 8.8

by Morris Jones

I have a very old existing mail server running Zimbra 6 with a mailman 2.1 instance alongside. I needed to rebuild my mail server for some compelling reasons (the old server used outdated TLS protocol, I could no longer compile clamav, nothing could really be updated). The final straw was a lack of support for my old commercial SSL certificates. I patched in a letsencrypt certificate to get through the past six months. I'm in the process of commissioning a new mail server using an 8GB Linode, Ubuntu 18, Zimbra 8.8, and Mailman 3.3. A couple of days ago I had my first successful list creation, with user confirmation working by email. I have django running with uwsgi, and am using Zimbra's installed nginx proxy to reverse proxy http traffic to Postorius and Hyperkitty. Nginx is doing the SSL layer. The mailman core mta hooks are all done using Zimbra's "local configuration" technique. In theory I should be able to do Zimbra upgrades with a minimum of hassle. I've written up a "case history" of how it came together. I have a .rst file in a gitlab project here: https://gitlab.com/MojoLA/mailman3.3-zimbra-8.8-integration I suppose this is a crazy project, but it's worthwhile to me. (Mark, thank's so much for integrating the virtual domain maps. It took me about three days to recognize that they were the solution to bounced mails to list-owner@...) Now I can spend some time migrating my email accounts (only four) from the old server to the new one, and move a dozen or so mailing lists to the new mailman3 instance. I'll have to get accustomed to a new way to manage the mail lists, and already really like what I've seen. Thank you. :) Best regards, Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

5 years, 11 months

Re: Confirmation emails to Users has wrong domain name (example.com!)

by Abhilash Raj

On Thu, Sep 30, 2021, at 2:20 AM, Odhiambo Washington wrote: > On Thu, Sep 30, 2021 at 1:59 AM Abhilash Raj <maxking(a)asynchronous.in> > wrote: > >> >> >> > On Sep 29, 2021, at 2:34 PM, Odhiambo Washington <odhiambo(a)gmail.com> >> wrote: >> > >> > On Wed, Sep 29, 2021 at 8:31 PM Mark Sapiro <mark(a)msapiro.net> wrote: >> > >> >> On 9/29/21 9:50 AM, Odhiambo Washington wrote: >> >>> 1. Confirmation emails to Users has wrong domain name (example.com!) >> >>> <https://docs.mailman3.org/en/latest/faq.html#id1> >> >>> < >> >> >> https://docs.mailman3.org/en/latest/faq.html#confirmation-emails-to-users-h… >> >>> >> >>> >> >>> This happens when your reverse (SSL) proxy isn’t setting up the correct >> >>> headers when proxying requests. Fix this by setting the right >> >>> proxy_set_header directives: >> >> ... >> >>> How is this supposed to be mitigated in Apache when using WSGI? >> >>> >> >>> My config: >> >>> >> >>> WSGIDaemonProcess hyperkitty threads=25 python-path=/usr/local/mailman >> >>> user=mailman group=mailman >> >>> WSGIPythonHome "/usr/local" >> >>> WSGIProcessGroup hyperkitty >> >> >> >> >> >> You are using mod_wsgi and not proxying at all, so this is not relevant >> >> in your case. >> >> >> >> Are you actually seeing this issue? If so, it might be related to >> >> >> >> >> https://docs.mailman3.org/en/latest/faq.html#the-domain-name-displayed-in-h… >> >> >> > >> > My issue is related to this, but the documentation referred to is not for >> > the faint-hearted! >> > I can't make head or tails of it. >> >> Click on “Domain” in Postorius from the top bar, which should take you to >> the Domains page. >> >> For your domain (in the “Mail Host” column), see the corresponding “Web >> Host” column, it should look something like: >> >> lists.mailman3.org (lists.mailman3.org) >> (Edit) >> SITE_ID = 1 >> > > Mine looks different, slightly. But there is no example.com at all. > > [image: Abhilash.png] > > > >> >> on a new-ish version of Postorius. >> > > I have the newest versions of everything, having installed only yesterday. > > >> >> If it doesn’t show the right values and instead shows “example.com” for >> you, click on the “Edit” link, which will take >> you to a page that will allow you to edit both the values. >> > > It shows the right values, but with "SITE_ID = 2". In my settings_local.py > I have SITE_ID = 1. > I suppose the example.com is the one tied to SITE_ID = 1 and that is what I > have in my settings_local.py. That is most likely what is happening. > Should I edit my settings_local.py? Yes, please update it to have SITE_ID = 2 to correspond to the site you want and restart. > > I am still confused. > > -- > Best regards, > Odhiambo WASHINGTON, > Nairobi,KE > +254 7 3200 0004/+254 7 2274 3223 > "Oh, the cruft.", egrep -v '^$|^.*#' :-) > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- thanks, Abhilash Raj (maxking)

5 years, 1 month

Re: Strange password problem

by Eggert Ehmke

There may be broken entries in my config. In web/logs/uwsgi-error.log I get: Unknown command: 'qcluster' when the entry in uwsgi.ini is: *attach-daemon* *=* python3 /opt/mailman/venv/lib/python3.9/site-packages/ mailman_web/manage.py qcluster When I change that line to: *attach-daemon* *=* python3 ./manage.py qcluster I get: python3: can't open file '//./manage.py': [Errno 2] No such file or directory This may be unrelated to the password problem, but this line runs every minute in the cron job. Am Donnerstag, 22. Juni 2023, 11:50:57 CEST schrieb Odhiambo Washington: > On Thu, Jun 22, 2023 at 12:34 PM Eggert Ehmke via Mailman-users < > mailman-users(a)mailman3.org> wrote: > > > > This happened several times recently with Postorius Version 1.3.8: > > -I try to log in as admin > > -rejected because of wrong password (password is stored in browser) > > -used forgotten password function > > -reset password to the stored value from browser > > -login works now. Works also when logged out/in again > > -however, the next day this behaviour repeats. > > > > > > > > Any hints? > > > > 1. You have a bug in the browser cache. Try a different browser. > 2. You can check also mailmanweb logs for clues?? > > -- > Best regards, > Odhiambo WASHINGTON, > Nairobi,KE > +254 7 3200 0004/+254 7 2274 3223 > "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) > [How to ask smart questions: > http://www.catb.org/~esr/faqs/smart-questions.html] > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message > /BWAVUEMHI56YI7FHTDULIZNIKIAM7324/ > > This message sent to eggert(a)eehmke.de ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Replaced multipart/alternative part with first alternative.

3 years, 4 months

Re: nginx configuration on a multitasking server

by David Newman

On 12/22/21 8:50 PM, Mark Sapiro wrote: > On 12/22/21 7:54 PM, David Newman wrote: >> On 12/22/21 7:29 PM, Mark Sapiro wrote: >> >>> This looks like a uwsgi issue as discussed at >>> https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… >>> although that's with apache and not nginx so it may not be. >> >> If I'm reading the thread correctly, it's Apache workarounds to an >> underlying Debian issue, so I agree it may not apply with nginx. > > > I think you're correct that it doesn't apply to nginx, but the symptom > is not the same. It is not a Debian issue per se. It is an Apache change > that got installed with a Debian update, but the underlying issue is > with Apache. See > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > > >> There are 260 files named 'urls.py' under /opt/mailman, mostly for >> socialaccount stuff. >> >> Where does that change go? All files? Or just this one: >> >> /opt/mailman/venv/lib/python3.9/site-packages/postorius/urls.py > > > Not that one. The one whose content looks like > https://gitlab.com/mailman/mailman-web/-/blob/master/mailman_web/urls.py. It > is probably in the same directory as your Django settings. On my system that file lives here: /opt/mailman/venv/lib/python3.9/site-packages/mailman_web/urls.py But the error persists after this addition and restarting MM3 and mailmanweb and nginx: url(r'^mailman/', include('postorius.urls')), There is this 404 error in uwsgi.log: [pid: 73356|app: 0|req: 3/3] 127.0.0.1 () {48 vars in 1544 bytes} [Wed Dec 22 21:13:48 2021] GET /mailman/admindb/listname => generated 5328 bytes in 14 msecs (HTTP/1.0 404) 6 headers in 197 bytes (1 switches on core 0) If this is a uwsgi issue, is there something else to tweak with that? Thanks dn > >

4 years, 10 months

Re: mailman addmember/syncmember commands print undecoded UTF-8 [ADD] or [DEL] mail addresses in its messages like "[ADD] =?utf-8?q?John_=....."

by Wikinaut

Not a single mail was sent - I am migrating (and newly setting up from textfiles) the mailman3 suite, installed fresh from the scratch in (venv) in /opt/mailman. I noticed that after having used a mix of addmember and also syncmember, one (or yesterday about 100 entries) of 500 had the MIME-coding. Then I used a script to remove users with the "=?UTF...." begin. In postorius users the user was gone and also in the lists where this user was in. def delete_users(): url = f"{API_URL}/users" r = requests.get(f'{url}', auth = AUTH) r.raise_for_status() users = r.json()['entries'] for user in users: dn = user.get('display_name') if type(dn) == type("string") and dn.startswith("="): print (dn) self_link = user.get('self_link') requests.delete(self_link, auth=AUTH) def main(): delete_users() After a new add/syncmember, that spooky entry was up again! Then I used mailman delmembers --fromall --no-goodbye-msg --no-admin-notify -m <this@address>: Then after a new add/syncmember, that entry was gone and the correct entry was shown. That means, that somewhere some remains were stored somewhere. I also have a another issue, where I cannot get rid of a test display_name like "1111 [äöo]" <myemailaddress> for my own user entry (this issue has not yet been filed, as I do not want to flood you here; the "=?utf.." issue seems to be a more apparent problem). At the moment, none of the ~500 users have "utf" searchable, which is some good news. Perhaps to mention: I noticed the utf-problems when I used Ctrl-C during heavy script actions while add/syncing the lists which I needed to stop. while testing. Perhaps this caused an inconsistent database state??? and that present issue was a consequence of my harsh break?

1 year, 3 months

Re: [Mailman-Developers] Mailman 3.1 beta coming soon

by Barry Warsaw

Thanks for doing the testing Florian. Btw I fixed the venv problem. It was actually a bug in one of the dependencies. I have another small branch to land before spinning the beta but I think the MySQL docker image on ci is having some problems. I can't double check ATM. Sent from my digital lollipop. > On Dec 3, 2016, at 15:22, Florian Fuchs <f(a)florianfuchs.com> wrote: > >> On Fri, Dec 02, 2016 at 11:07:24AM -0500, Barry Warsaw wrote: >> Hello Mailman 3 users and developers! >> >> It's been a long slog but I think we are finally ready to begin the release >> process for Mailman 3.1. I am pretty happy about the state of the Core, and >> Florian is going to do some more integration testing with HyperKitty and >> Postorius. We still have a few issues and a merge proposal or two to address, > > I did some manual integration testing today > (core+mailmanclient+postorius) which looked fine so far. I didn't get > to test HyperKitty and the bundler though, so any help testing those > would be very much appreciated. I will have some more time tomorrow. > > I did all of my testing locally, which has some limitations. So I > started setting up a more realistic environment on one of my dev > machines. But I'm not done yet. Will report back when I'm done... ;-) > >> but I am planning to spin a beta of Core this weekend to facilitate testing. > > I think it's OK to put out a separate beta of the core, because the > version pulled from pypi will still be 3.0 if I'm not terribly mistaken. > > For the real 3.1 we should probably do a coordinated release of all > components, once everything's tested a little more thoroughly. > > Cheers > Florian

9 years, 11 months

Re: invalid parameter response of the rest-api

by Stephen J. Turnbull

gioklr71(a)gmail.com writes: > Dear Jacob did you make any progress on this issue? I've exactly > the same problem.... Is Jacob's problem really exactly the same as yours? Please compare your error message to Jacob's: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Jacob Sievert writes: > Since a few days we get an error response from our automated membership > script. > > We use the following code to control the membership for some lists: > ``` > def mailinglist_manage(list_address, members): This looks like it should work. > Since Tuesday without any update performed by us we get the following > error from the script when it's running: *Something* changed. It would likely help if one of you can figure out what. > line 339, in subscribe > response, content = self._connection.call('members', data) > File > "/root/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", Either mailmanclient is now marshalling the URL and data incorrectly (which is hard to believe, it's hard to imagine this simple call is causing an error without causing both Postorius and HyperKitty to break too), or the REST protocol has changed for that resource, and the resource accessed by the URL that is constructed by self._connection.call() is not the member roster. This also seems unlikely. Your installation seems very old. From the next version of Mailman, we will not target Python 3.6 (that is, we have dropped it from the automated test pipeline), so regressions may occur. I know of at least one that occurs in old versions of core if you upgrade Python from < 3.8 to >= 3.8. Your Mailman installation also seems quite old: the code that the frame above says is on line 339 is on line 491 in git head. Are you sure you haven't applied a batch of security updates or the like that might affect any of Python, mailmanclient, or Mailman core?

4 years, 1 month

Re: Confirmation emails aren't sent to users.

by Stephen J. Turnbull

Ibiam Chihurumnaya via Mailman-users writes: > Mark Sapiro wrote: > > > OK, this is Django. The default EMAIL_BACKEND from > > mailman_web/settings/base.py is > > django.core.mail.backends.smtp.EmailBackend and unless you've changed > > that or added overrides various other defaults are > > EMAIL_HOST = "localhost" > > EMAIL_PORT = 25 > > EMAIL_HOST_USER = "" > > EMAIL_HOST_PASSWORD = "" > > EMAIL_USE_TLS = False > > EMAIL_USE_SSL = False > > EMAIL_SSL_CERTFILE = None > > EMAIL_SSL_KEYFILE = None > > Are those appropriate? Do you have an outgoing MTA listening on > > localhost:25? What's in it's logs? > > I don't have any of those set, didn't realize I needed to have them > set, the docs didn't make it obvious too. Those defaults *are* set in the mailman_web settings files. You can override them in /etc/mailman3/settings.py, but often you don't need to. > I also didn't notice them in schema.cfg in mailman. This is for Django, whose configuration is in /etc/mailman3/settings.py, with defaults set in the mailmanweb package in your venv's site-package in the files in .../mailman_web/settings/. > smtp_port is currently set to 25, and I do have an outgoing MTA > listening on localhost:25. If Mailman can distribute posts that way, Django should be able to send mail with the default settings. > Nothing shows up in the MTA logs about this particular email. Not sure what to say about that. I'm not sure Postorius or Django log outgoing mail messages but I think they use the mailmanweb.log file by default if they log mail at all. (This is separate from the MTA logs which should record any connections from localhost and mail submitted.) -- GNU Mailman consultant (installation, migration, customization) Sirius Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan

8 months, 4 weeks

Re: Docker mailman3 delete social logins, did something change?

by Abhilash Raj

On 9/15/21 7:37 AM, bob B wrote: > I want to remove the social logins from mailman3 in docker. Which version tag are you using? > > I found this info > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > > but the link to the default shows > *************** > INSTALLED_APPS = [] > DEFAULT_APPS = [ > 'hyperkitty', > 'postorius', > 'django_mailman3', > # Uncomment the next line to enable the admin: > 'django.contrib.admin', > # Uncomment the next line to enable admin documentation: > # 'django.contrib.admindocs', > 'django.contrib.auth', > 'django.contrib.contenttypes', > 'django.contrib.sessions', > 'django.contrib.sites', > 'django.contrib.messages', > 'django.contrib.staticfiles', > 'rest_framework', > 'django_gravatar', > 'compressor', > 'haystack', > 'django_extensions', > 'django_q', > 'allauth', > 'allauth.account', > 'allauth.socialaccount', > ] > ***************** The link to default is a dynamic one, so it changes as the changes are made in the repo, unfortunately, this is basically the new stuff that isn't out yet. > > > However when I go to the bug https://github.com/maxking/docker-mailman/issues/283 > > it shows > > ********* > INSTALLED_APPS = ( > 'hyperkitty', > 'postorius', > 'django_mailman3', > # Uncomment the next line to enable the admin: > 'django.contrib.admin', > # Uncomment the next line to enable admin documentation: > # 'django.contrib.admindocs', > 'django.contrib.auth', > 'django.contrib.contenttypes', > 'django.contrib.sessions', > 'django.contrib.sites', > 'django.contrib.messages', > 'django.contrib.staticfiles', > 'rest_framework', > 'django_gravatar', > 'paintstore', > 'compressor', > 'haystack', > 'django_extensions', > 'django_q', > 'allauth', > 'allauth.account', > 'allauth.socialaccount', > 'django_mailman3.lib.auth.fedora', > 'allauth.socialaccount.providers.openid', > 'allauth.socialaccount.providers.github', > 'allauth.socialaccount.providers.gitlab', > 'allauth.socialaccount.providers.google', > ) > > ******** > > > The two examples are different so what should it be? If you want to remove social auth applications, you basically want to override INSTALLED_APPS configuraiton in your settings_local.py. In the list above, you want to remove everything after 'django_mailman3.lib.auth.fedora' and set that as INSTALLED_APPS in your settings_local.py. > > I tried to add it in both ways and when I do I get bad gateway and he mailman website is broke. I have not setup any domains yet, just setup the admin password,. Bad gateway usually will emit some sort of logging error in the mailman logs at /opt/mailman/web/logs/, what kind of exception are you seeing there? The configuration above, while enables social auth, shouldn't *break* the website. There must be errors/exceptions in logs to point in the direction of what the error might be. > > > For example this breaks my website > > cat /opt/mailman/web/settings_local.py > > ALLOWED_HOSTS = ['127.0.0.1','localhost','REDACTED','REDACTED','REDACTED','REDACTED','REDACTED'] > #ALLOWED_HOSTS = ['*'] > DEBUG = True > #DEBUG = False > EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' > EMAIL_HOST = 'REDACTED' > EMAIL_PORT = 25 > INSTALLED_APPS = ( > 'hyperkitty', > 'postorius', > 'django_mailman3', > # Uncomment the next line to enable the admin: > 'django.contrib.admin', > # Uncomment the next line to enable admin documentation: > # 'django.contrib.admindocs', > 'django.contrib.auth', > 'django.contrib.contenttypes', > 'django.contrib.sessions', > 'django.contrib.sites', > 'django.contrib.messages', > 'django.contrib.staticfiles', > 'rest_framework', > 'django_gravatar', > 'paintstore', > 'compressor', > 'haystack', > 'django_extensions', > 'django_q', > 'allauth', > 'allauth.account', > 'allauth.socialaccount', > 'django_mailman3.lib.auth.fedora', > 'allauth.socialaccount.providers.openid', > 'allauth.socialaccount.providers.github', > 'allauth.socialaccount.providers.gitlab', > 'allauth.socialaccount.providers.google', > ) > ************************************************************************* > And I have even removed anything? > > What should my /opt/mailman/web/settings_local.py look like? -- thanks, Abhilash Raj (maxking)

5 years, 1 month

Re: Postorius is not working (throws "Error 500" suddenly after changing POSTORIUS_TEMPLATE_BASE_URL and changing back)

by Stephen J. Turnbull

Wikinaut writes: > I fully understand. Need to look up how to smoothly backup the > mailman3 settings and list databases in order to make that move > with losing stuff... (kinda "mailman3 backup all" and mailman3 > restore all" :-) One piece of generic Python advice: don't mix OS packages and pip (except for Python itself). Always use a venv if you need to use pip for packages that aren't in your OS distro. (Of course it's possible to do so in many cases if you *really* know what you're doing, but it's almost never worth the pain.) All of the site configuration data should be in /etc/mailman3 (except for a few template files in $var_dir/templates), and all of the domain, list configuration, and archive data is in the RDBMS (usually PostgreSQL or MySQL). The RDMBS should be backed up regularly according to its procedures, but that's completely out of scope for Mailman.[1] The RDBMS should "just work" with exactly the same Mailman-side configuration as Debian.[2] As I think Odhiambo mentioned, the Mailman side of the site configuration also does not change (for example, the RDBMS URL and authentication). What you do want to change is the file system configuration. Except for /etc/mailman3, it should be completely different -- as with pip'ing packages, you don't want to share files across a local venv and the OS version of the same package. It just leads to pain. I think among the developers the preferred root = /opt/mailman (or /opt/mailman3) for Mailman's directory hierarchy. This will be populated with subdirectories when you run `mailman info` (or start Mailman) the first time. The directories relevant to configuration are all under $root/var, and you inform Mailman about this by setting `var_dir` in mailman.cfg. If there are other file and directory configurations in mailman.cfg, they need to changed from the Debian values (probably /var/lib/mailman3/...). You may do fine by simply deleting all other directory configurations and let Mailman decide where to put them relative to the `var_dir`, You will need to fix the setting for STATIC_ROOT (I think that's the name, if not search for "static") in settings.py, and maybe in mailman-web.cfg. While it's not necessary (and may be a little inconvenient), I recommend changing the root for Mailman's log files from the Debian value (probably /var/log/mailman3) to the Mailman default of $root/var/logs, and similarly for the Django logs in settings.py. Non-Mailman settings I think you will need to change the settings for your MTA (usually Postfix or Exim4) so that it will recognize Mailman lists and route them to Mailman correctly. There will probably be mailman-related files in /etc/$MTA/conf.d (or something like that). You can edit them directly, but I recommend changing the name (paranoia so that dpkg doesn't overwrite them). The only thing I can think of for the webserver (Apache?) is the location of the static directory. I think Debian uses uwsgi by default so you may need to adjust its configuration too. I think you need to fix logrotate's configuration in /etc/logrotate.d. Not sure how many mailman-related config files are in there. I think you mentioned systemd .service files. If so that doesn't make sense to me -- Debian should provide those. You need to make sure those are disabled or deleted so that Debian Mailman services don't start on reboot. This is automatic if you delete the Debian packages, of course, but not for any files you created yourself. Probably the Debian .service files will work, but you need to make sure they refer to the venv Mailman (using the full path to the `mailman` utility in the venv's bin directory will work, and similarly for `mailman-web`). systemd does not configure the /opt hierarchy in it search path by default. I put the mailman, qcluster, and gunicorn (if you use that instead of uwsgi) .service files in /usr/local/lib/systemd/system, and that works for me. Flotsam and jetsam If you have run Mailman with any success at all, you may find some stuff in Debian's $var_dir/queue/* directories or in its $var_dir/lists/* directories. The queue/* directories contain incoming messages at various stages of processing, and the lists/* directories contain files containing multiple messages that are scheduled to be sent out as digests. You can read the queue files with `mailman qfile /path/to/queue/file.pck`, and the digests are just text files. That way you can check if there's anything important in them. If not, you can just delete them. If there is, you can just copy them to the same place in the venv $var_dir as they were in Debian's $var_dir, but you may want to ask here first before doing that. It's best to let Mailman run until all the queues are cleared (except maybe bad and shunt, but if those have any files in them you need to intervene anyway). Afterword I'm sure this sounds complicated, but in fact it's a pretty short list. When you get there we'll help you. Footnotes: [1] But not for this list. You may as well ask here, somebody probably will tell you the basics quickly. But for troubleshooting, go the the RDBMS's own channels. [2] In fact, it is possible to keep the Debian installation, copy the the mailman.cfg somewhere, edit it, stop Debian Mailman, and start up the venv Mailman. I don't recommend this -- the point is that the venv and the databases are that isolated from the rest of the system.

3 years, 1 month

Mailman-users search results for query "Postorius"