February 2021 - Mailman-users - lists.mailman3.org

Innstall and run Mailman 3 with Postfix in a Docker enviroment
by kwp.klein＠gmail.com 11 Feb '21

11 Feb '21

## Install Mailman 3 The idea is to install Mailman 3 in ad docker container. Also I want to install Postfix in a container. All the mail which will send and receive should handled in a docker container. The reason is, that on the server only applications in a docker environment working. There is no MTA installed. On the server are Discourse as forum, wikijs, portainer, watchtower, homepage, and the NGINX Proxy Manager installed. At next I need Mailman 3. I don't know how to install and run Postfix for Mailman in a docker environment. Here is my first try. I can visit the site lists.example.com, but I can not set the Admin password. I think the reason is, that the MTA not working. I have a gitlab repo. If you like please look here: https://gitlab.com/joklein/mailman ### Configure the docker-compose.yml file ```yml version: '2' services: postfix: image: mailu/postfix restart: unless-stopped container_name: postfix volumes: - /opt/mailman/postfix:/etc/postfix/main.cf.d - /opt/mailman/core:/opt/mailman ports: - "25:25" networks: mailman: ipv4_address: 172.19.199.6 services: mailman-core: image: maxking/mailman-core:0.3 restart: unless-stopped stop_grace_period: 30s container_name: mailman-core hostname: mailman-core volumes: - /opt/mailman/core:/opt/mailman links: - database:database depends_on: - database environment: - DATABASE_URL=postgres://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=postgres - DATABASE_CLASS=mailman.database.postgresql.PostgreSQLDatabase - SMTP_HOST=172.19.199.1 - HYPERKITTY_API_KEY=ZawB3NGBUgbmQcMGhZ0kYIW0WRNw8P9osEudsGiFZWv networks: mailman: ipv4_address: 172.19.199.2 mailman-web: image: maxking/mailman-web:0.3 container_name: mailman-web restart: unless-stopped hostname: mailman-web ports: - "8000:8000" depends_on: - database links: - mailman-core:mailman-core - database:database volumes: - /opt/mailman/web:/opt/mailman-web-data environment: - DATABASE_TYPE=postgres - DATABASE_URL=postgres://mailman:mailmanpass@database/mailmandb - HYPERKITTY_API_KEY=ZawB3NGBUgbmQcMGhZ0kYIW0WRNw8P9osEudsGiFZWv - UWSGI_STATIC_MAP=/static=/opt/mailman-web-data/static - SERVE_FROM_DOMAIN=lists.example.com - MAILMAN_ADMIN_USER=admin - MAILMAN_ADMIN_EMAIL=lists(a)example.com - SECRET_KEY=mailmangeheim networks: mailman: ipv4_address: 172.19.199.3 database: image: postgres:9.6-alpine restart: unless-stopped environment: POSTGRES_DB: mailmandb POSTGRES_USER: mailman POSTGRES_PASSWORD: mailmanpass volumes: - /opt/mailman/database:/var/lib/postgresql/data networks: mailman: ipv4_address: 172.19.199.4 networks: mailman: driver: bridge ipam: driver: default config: - subnet: 172.19.199.0/24 ``` #### Build the API Key für Hyperkitty and SECRET_KEY You can build a key with `pwgen -s 128` #### Make some directorys ```sh mkdir -p /opt/mailman/core mkdir -p /opt/mailman/web mkdir -p /opt/mailman/mailman-web-data/static ``` #### Make a file in /opt/mailman/web/settings_local.py ```sh EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.19.199.1' EMAIL_PORT = 25 USE_SSL = False DEFAULT_FROM_EMAIL = "<E-MAIL>" SERVER_EMAIL = "<E-MAIL>" ``` Change the `<E-MAIL>` with your server address. For example `mailman(a)lists.example.com` So that Postfix also sends your e-mails, you create the file `/opt/mailman/core/mailman-extra.cfg` with the following content: ```sh [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.19.199.2 lmtp_port: 8024 smtp_host: 172.19.199.1 smtp_port: 25 configuration: /etc/postfix-mailman.cfg ``` Now you are ready to start your container: ```sh sudo su - cd /root/mailman-docker docker-compose up -d ``` #### Check the mailman images ```sh docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES f6990a2f808f maxking/mailman-web:0.3 "docker-entrypoint.s…" 55 seconds ago Up 52 seconds 8000/tcp, 8080/tcp mailman-web a7fa6334b2b8 maxking/mailman-core:0.3 "docker-entrypoint.s…" 58 seconds ago Up 54 seconds 8001/tcp, 8024/tcp mailman-core e8812dc42663 postgres:9.6-alpine "docker-entrypoint.s…" About a minute ago Up 57 seconds 5432/tcp docker-mailman_database_1 ``` #### Check the conection ```sh curl http://172.19.199.3:8000/postorius/lists/ ```

2 2

error when starting the mailman executable from the venv
by Christian Stalberg 10 Feb '21

10 Feb '21

I tried to access a 'held' message and got the 'Mailman REST API not available. Please start Mailman core.' error message. When I went to start the mailman executable from the venv I get this #~mailman/mm/venv/bin/mailman start Starting Mailman's master runner Generating MTA alias maps Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/mailman", line 11, in <module> load_entry_point('mailman==3.3.2', 'console_scripts', 'mailman')() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman/bin/mailman.py", line 68, in invoke return super().invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman/commands/cli_control.py", line 131, in start os.execl(*execl_args) File "/usr/lib/python3.7/os.py", line 539, in execl execv(file, args) TypeError: expected str, bytes or os.PathLike object, not NoneType Please advise. Thank you. ~Christian

2 3

Problems with web interface after upgrade
by Victoriano Giralt 10 Feb '21

10 Feb '21

Hi, I just applied all the recipes that have been recently posted for upgrading (pip install --upgrade of all pieces, migrate, collectstatic) The compress part refuses to work "OFF_LINE", whatever that is. I tried with mailman running and stopped. I can access hte main Postorius page and the basic list information, but I cannot login nor access the archives. Operations end on two exceptions logged to the log file (and two mail messages to the owner = me). Very similar to what I get if I try to --force the "compress". I'm sure I'm missing somethning, but do not know what ... Thanks! Traceback: ERROR 2021-02-09 19:57:41,414 726 django.request Internal Server Error: /listas/accounts/login/ Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 263, in precompile mod = import_module(mod_name) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 994, in _gcd_import File "<frozen importlib._bootstrap>", line 971, in _find_and_load File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked ModuleNotFoundError: No module named 'sassc -t compressed {infile} {outfile}' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.6/site- packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/usr/local/lib/python3.6/site- packages/django/core/handlers/base.py", line 145, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python3.6/site- packages/django/core/handlers/base.py", line 143, in _get_response response = response.render() File "/usr/local/lib/python3.6/site- packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/usr/local/lib/python3.6/site- packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/usr/local/lib/python3.6/site- packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 171, in render return self._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/compressor/templatetags/compress.py", line 131, in render return self.render_compressed(context, self.kind, self.mode, forced=forced) File "/usr/local/lib/python3.6/site- packages/compressor/templatetags/compress.py", line 107, in render_compressed rendered_output = compressor.output(mode, forced=forced) File "/usr/local/lib/python3.6/site-packages/compressor/css.py", line 49, in output ret.append(subnode.output(*args, **kwargs)) File "/usr/local/lib/python3.6/site-packages/compressor/css.py", line 51, in output return super(CssCompressor, self).output(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 295, in output output = '\n'.join(self.filter_input(forced)) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 235, in filter_input for hunk in self.hunks(forced): File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 205, in hunks precompiled, value = self.precompile(value, **options) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 268, in precompile return True, filter.input(**kwargs) File "/usr/local/lib/python3.6/site- packages/compressor/filters/base.py", line 229, in input return super(CachedCompilerFilter, self).input(**kwargs) File "/usr/local/lib/python3.6/site- packages/compressor/filters/base.py", line 196, in input raise FilterError(err) compressor.exceptions.FilterError: Error: It's not clear which file to import for '@import "../libs/bootstrap/stylesheets/bootstrap"'. Candidates: ../libs/bootstrap/stylesheets/_bootstrap.scss ../libs/bootstrap/stylesheets/bootstrap.scss Please delete or rename all but one of these files. on line 4 of static/hyperkitty/sass/hyperkitty.scss >> @import "../libs/bootstrap/stylesheets/bootstrap"; ^ -- Victoriano Giralt Innovation Director Digital Transformation Vicerectorate University of Malaga +34952131415 SPAIN ================================================================== Note: signature.asc is the electronic signature of present message A: Yes. > Q: Are you sure ? >> A: Because it reverses the logical flow of conversation. >>> Q: Why is top posting annoying in email ?

3 6

Reason for Shunting
by Brian Carpenter 09 Feb '21

09 Feb '21

Is there a way to determine why a message keeps ending up in the shunt queue? -- Brian Carpenter Harmonylists.com Emwd.com

2 4

Running Mailman3 v3.2.1 on Devuan 10.0, getting a pid permissions error on Mailman3-web
by rainbear＠gmail.com 09 Feb '21

09 Feb '21

# service mailman3-web stop [....] Stopping Mailman3-web uWSGI service: mailman3-webstart-stop-daemon: matching on world-writable pidfile /run/mailman3-web/mailman3-web.pid is insecure # ls -l /run/mailman3-web/mailman3-web.pid -rw-rw-rw- 1 root root 6 Feb 9 13:00 /run/mailman3-web/mailman3-web.pid # mailman info GNU Mailman 3.2.1 (La Villa Strangiato) Python 3.7.3 (default, Jul 25 2020, 13:03:44) [GCC 8.3.0] config file: /etc/mailman3/mailman.cfg db url: sqlite:////var/lib/mailman3/data/mailman.db devmode: DISABLED REST root url: http://*obscured*:8001/3.1/ REST credentials: *obscured* Any help, as always, is greatly appreciated. It's been a while, my old server died on me a few years back, and I'm finally getting around to getting a new one set up. I'd been looking forward to MM3 for *ages*! I can't wait to play! :-D Thank you in advance! If I forgot any relevant info, I'm happy to provide. Best, --Glenn

2 1

API access to Hyperkitty
by Brian Carpenter 09 Feb '21

09 Feb '21

Is it possible to download Hyperkitty's archives to a remote server via an API? Is there documentation that explains how to accomplish this task? -- Brian Carpenter Harmonylists.com Emwd.com

3 2

Hyperkitty_import.py Error
by Brian Carpenter 09 Feb '21

09 Feb '21

I am trying to import some old archives (going back to 2003) into a Mailman 3 list. The import job is terminating very early in the process with the following error: IndexError: string index out of range 1. Is there a way to fix a mbox file that is generating this type of error? 2. If a message is causing this error, is there a way to import the rest of the mbox file by importing messages after a certain date within the mbox file? I know the --since flag should be able to do that but I am unsure what the date/time format should be. 3. The --no-sync--mailman flag indicates the possibility of doing batch imports. What are batch imports and how do you do them? Thanks! -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Implicit Destination Meaning
by Brian Carpenter 09 Feb '21

09 Feb '21

I just migrated a MM2 list to MM3. The client had no problem sending posts to his list with MM2. However when he posted to his MM3 list, it showed up in the moderation queue: ============ Your mail to 'dogs(a)lists.redacted.org' with the subject mailing list changes Is being held until the list moderator can review it for approval. The message is being held because: Message has implicit destination Either the message will get posted to the list, or you will receive notification of the moderator's decision. =========== Is there a List Setting somewhere that needs to be adjusted to allow this sender to post without moderation? -- Brian Carpenter Harmonylists.com Emwd.com

2 1

Moderator Approval Subscription template
by Brian Carpenter 09 Feb '21

09 Feb '21

Hey all, I am seeing a strange issue with the Moderator Approval Subscription template. 1. First problem is that this template by default does not include a URL to the list admin page of said mailing list. Mailman 2's notifications did. 2. Problem 1 can be solved by editing the template and adding the List Owner (admin) url to moderate the subscription. However in the case of long URLs, the URL is getting cut-off in Thunderbird. Not sure about other email clients. So something like: https://list.redeacted.org/admin/list/oligodendroglioma.list.redacted.org comes through to Thunderbird like: https://list.redacted.org/admin/list/oligodendroglioma.list.redact (<-- This is hyperlinked but leaves out the ed.org portion) ed.org (<--- This is not hyperlinked) -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Postorius upgrade issue
by Ruth Ivimey-Cook 09 Feb '21

09 Feb '21

Folks, I upgraded mailman-web and mailman-core to 3.3.3 in the manner suggested recently (pip install -U) and all seemed well, but have now noticed a strange bug. On the Postorius list admin page (where moderated subscriptions etc can be seen) although the top horizontal menu is present and the links exist, all the links are to that page (i.e. href="#') Is this a known issue, and how can I fix it? Pre upgrade all was well. Regards, Ruth -- Software Manager & Engineer Tel: 01223 414180 Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

3 5