- Mailman-users - lists.mailman3.org

Debian 12: Following docs does not create /opt/mailman/web/xapian_index
by Philip Bondi April 7, 2025

April 7, 2025

Hello to all: Following along: https://docs.mailman3.org/en/latest/install/virtualenv.html#setting-up-full… But Method 1 does not create /opt/mailman/web/xapian_index for me on Debian 12 export XAPIAN_VERSION="1.4.27" curl https://raw.githubusercontent.com/notanumber/xapian-haystack/master/xapian_… -o xapian_wheel_builder.sh bash xapian_wheel_builder.sh $XAPIAN_VERSION (venv) mailman@shackleton12:~$ find /opt/mailman -type d -name '*xapian*' /opt/mailman/venv/lib/python3.11/site-packages/xapian /opt/mailman/venv/lib/python3.11/site-packages/xapian_haystack-3.1.0.dist-info /opt/mailman/venv/lib/python3.11/site-packages/xapian-1.4.27.dist-info (venv) mailman@shackleton12:~$ find /opt/mailman -type f -name '*xapian_index*' (venv) mailman@shackleton12:~$ When I try to search, I get this stack trace by email: Internal Server Error: /archives/search PermissionError at /archives/search [Errno 13] Permission denied: '/opt/mailman/web/xapian_index' Request Method: GET Request URL: http://systemdatabase.ca/archives/search?mlist=ebill%40systemdatabase.ca&q=… Django Version: 4.2.20 Python Executable: /opt/mailman/venv/bin/uwsgi Python Version: 3.11.2 Python Path: ['.', '', '/etc/mailman3', '/usr/lib/python311.zip', '/usr/lib/python3.11', '/usr/lib/python3.11/lib-dynload', '/opt/mailman/venv/lib/python3.11/site-packages'] Server time: Tue, 01 Apr 2025 16:54:49 +0000 Installed Applications: ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'django.contrib.humanize', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount'] Installed Middleware: ('allauth.account.middleware.AccountMiddleware', 'django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner response = get_response(request) ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/hyperkitty/views/search.py", line 54, in search results = EmptySearchQuerySet() ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/haystack/query.py", line 25, in __init__ self._determine_backend() ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/haystack/query.py", line 58, in _determine_backend self.query = connections[backend_alias].get_query() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/haystack/backends/__init__.py", line 1100, in get_query return self.query(using=self.using) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/haystack/backends/__init__.py", line 510, in __init__ self.backend = connections[self._using].get_backend() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/haystack/backends/__init__.py", line 1092, in get_backend self._backend = self.backend(self.using, **self.options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.11/site-packages/xapian_backend.py", line 207, in __init__ os.makedirs(self.path) ^^^^^^^^^^^^^^^^^^^^^^ File "<frozen os>", line 225, in makedirs <source code not available> ^^^^^^^^^^^^^^^^^ Exception Type: PermissionError at /archives/search Exception Value: [Errno 13] Permission denied: '/opt/mailman/web/xapian_index' Raised during: hyperkitty.views.search.search Request information: USER: pjbondi GET: mlist = 'ebill(a)systemdatabase.ca' q = 'cost' POST: No POST data FILES: No FILES data COOKIES: csrftoken = '********************' sessionid = '********************' META: CSRF_COOKIE = '8C2Wu0RN7MyvvyBP89caOkgFalH79NYD' HTTP_ACCEPT = 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7' HTTP_ACCEPT_ENCODING = 'gzip, deflate, br, zstd' HTTP_ACCEPT_LANGUAGE = 'en-US,en;q=0.9' HTTP_CONNECTION = 'Keep-Alive' HTTP_COOKIE = '********************' HTTP_HOST = 'systemdatabase.ca' HTTP_REFERER = 'https://systemdatabase.ca/archives/list/ebill@systemdatabase.ca/latest' HTTP_SEC_CH_UA = '"Chromium";v="134", "Not:A-Brand";v="24", "Google Chrome";v="134"' HTTP_SEC_CH_UA_MOBILE = '?0' HTTP_SEC_CH_UA_PLATFORM = '"Windows"' HTTP_SEC_FETCH_DEST = 'document' HTTP_SEC_FETCH_MODE = 'navigate' HTTP_SEC_FETCH_SITE = 'same-origin' HTTP_SEC_FETCH_USER = '?1' HTTP_UPGRADE_INSECURE_REQUESTS = '1' HTTP_USER_AGENT = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' HTTP_X_FORWARDED_FOR = '192.168.1.1' HTTP_X_FORWARDED_HOST = 'systemdatabase.ca' HTTP_X_FORWARDED_SERVER = 'systemdatabase.ca' PATH_INFO = '/archives/search' QUERY_STRING = 'mlist=ebill%40systemdatabase.ca&q=cost' REMOTE_ADDR = '127.0.0.1' REQUEST_METHOD = 'GET' REQUEST_URI = '/archives/search?mlist=ebill%40systemdatabase.ca&q=cost' SCRIPT_NAME = '' SERVER_NAME = 'shackleton12' SERVER_PORT = '8000' SERVER_PROTOCOL = 'HTTP/1.1' uwsgi.core = 0 uwsgi.node = b'shackleton12' uwsgi.version = b'2.0.28' wsgi.errors = <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'> wsgi.file_wrapper = <built-in function uwsgi_sendfile> wsgi.input = <uwsgi._Input object at 0x7fa484b846b0> wsgi.multiprocess = True wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'http' wsgi.version = '(1, 0)' Settings: Using settings module settings ABSOLUTE_URL_OVERRIDES = {} ACCOUNT_DEFAULT_HTTP_PROTOCOL = 'https' ACCOUNT_LOGIN_METHODS = {'username', 'email'} ACCOUNT_UNIQUE_EMAIL = True ADMINS = "(('Mailman Suite Admin', 'pjbondi(a)systemdatabase.com'),)" ALLOWED_HOSTS = ['localhost', '127.0.0.1', 'systemdatabase.ca', '192.168.1.8'] APPEND_SLASH = True AUTHENTICATION_BACKENDS = "('django.contrib.auth.backends.ModelBackend', 'allauth.account.auth_backends.AuthenticationBackend')" AUTH_PASSWORD_VALIDATORS = '********************' AUTH_USER_MODEL = 'auth.User' BASE_DIR = PosixPath('/opt/mailman/web') CACHES = {'default': {'BACKEND': 'django.core.cache.backends.locmem.LocMemCache'}} CACHE_MIDDLEWARE_ALIAS = 'default' CACHE_MIDDLEWARE_KEY_PREFIX = '********************' CACHE_MIDDLEWARE_SECONDS = 600 COMPRESSORS = {'css': 'compressor.css.CssCompressor', 'js': 'compressor.js.JsCompressor'} COMPRESS_CACHEABLE_PRECOMPILERS = '()' COMPRESS_CACHE_BACKEND = 'default' COMPRESS_CACHE_KEY_FUNCTION = '********************' COMPRESS_CLEAN_CSS_ARGUMENTS = '' COMPRESS_CLEAN_CSS_BINARY = 'cleancss' COMPRESS_CLOSURE_COMPILER_ARGUMENTS = '' COMPRESS_CLOSURE_COMPILER_BINARY = 'java -jar compiler.jar' COMPRESS_CSS_HASHING_METHOD = 'mtime' COMPRESS_DATA_URI_MAX_SIZE = 1024 COMPRESS_DEBUG_TOGGLE = None COMPRESS_ENABLED = True COMPRESS_FILTERS = {'css': ['compressor.filters.css_default.CssAbsoluteFilter', 'compressor.filters.cssmin.rCSSMinFilter'], 'js': ['compressor.filters.jsmin.rJSMinFilter']} COMPRESS_JINJA2_GET_ENVIRONMENT = <function CompressorConf.JINJA2_GET_ENVIRONMENT at 0x7fa480f33f60> COMPRESS_MINT_DELAY = 30 COMPRESS_MTIME_DELAY = 10 COMPRESS_OFFLINE = True COMPRESS_OFFLINE_CONTEXT = {'STATIC_URL': '/static/'} COMPRESS_OFFLINE_MANIFEST = 'manifest.json' COMPRESS_OFFLINE_MANIFEST_STORAGE = 'compressor.storage.OfflineManifestFileStorage' COMPRESS_OFFLINE_MANIFEST_STORAGE_ALIAS = 'compressor-offine' COMPRESS_OFFLINE_TIMEOUT = 31536000 COMPRESS_OUTPUT_DIR = 'CACHE' COMPRESS_PARSER = 'compressor.parser.AutoSelectParser' COMPRESS_PRECOMPILERS = "(('text/x-scss', 'sassc -t compressed {infile} {outfile}'), ('text/x-sass', 'sassc -t compressed {infile} {outfile}'))" COMPRESS_REBUILD_TIMEOUT = 2592000 COMPRESS_ROOT = '/opt/mailman/web/static' COMPRESS_STORAGE = 'compressor.storage.CompressorFileStorage' COMPRESS_STORAGE_ALIAS = 'compressor' COMPRESS_TEMPLATE_FILTER_CONTEXT = {'STATIC_URL': '/static/'} COMPRESS_URL = '/static/' COMPRESS_URL_PLACEHOLDER = '/__compressor_url_placeholder__/' COMPRESS_VERBOSE = False COMPRESS_YUGLIFY_BINARY = 'yuglify' COMPRESS_YUGLIFY_CSS_ARGUMENTS = '--terminal' COMPRESS_YUGLIFY_JS_ARGUMENTS = '--terminal' COMPRESS_YUI_BINARY = 'java -jar yuicompressor.jar' COMPRESS_YUI_CSS_ARGUMENTS = '' COMPRESS_YUI_JS_ARGUMENTS = '' CSRF_COOKIE_AGE = 31449600 CSRF_COOKIE_DOMAIN = None CSRF_COOKIE_HTTPONLY = False CSRF_COOKIE_MASKED = False CSRF_COOKIE_NAME = 'csrftoken' CSRF_COOKIE_PATH = '/' CSRF_COOKIE_SAMESITE = 'Lax' CSRF_COOKIE_SECURE = False CSRF_FAILURE_VIEW = 'django.views.csrf.csrf_failure' CSRF_HEADER_NAME = 'HTTP_X_CSRFTOKEN' CSRF_TRUSTED_ORIGINS = ['https://systemdatabase.ca'] CSRF_USE_SESSIONS = False DATABASES = {'default': {'ENGINE': 'django.db.backends.postgresql_psycopg2', 'NAME': 'mailmanweb', 'USER': 'mailman', 'PASSWORD': '********************', 'HOST': 'localhost', 'PORT': '5432', 'ATOMIC_REQUESTS': False, 'AUTOCOMMIT': True, 'CONN_MAX_AGE': 0, 'CONN_HEALTH_CHECKS': False, 'OPTIONS': {}, 'TIME_ZONE': None, 'TEST': {'CHARSET': None, 'COLLATION': None, 'MIGRATE': True, 'MIRROR': None, 'NAME': None}}} DATABASE_ROUTERS = [] DATA_UPLOAD_MAX_MEMORY_SIZE = 2621440 DATA_UPLOAD_MAX_NUMBER_FIELDS = 1000 DATA_UPLOAD_MAX_NUMBER_FILES = 100 DATETIME_FORMAT = 'N j, Y, P' DATETIME_INPUT_FORMATS = ['%Y-%m-%d %H:%M:%S', '%Y-%m-%d %H:%M:%S.%f', '%Y-%m-%d %H:%M', '%m/%d/%Y %H:%M:%S', '%m/%d/%Y %H:%M:%S.%f', '%m/%d/%Y %H:%M', '%m/%d/%y %H:%M:%S', '%m/%d/%y %H:%M:%S.%f', '%m/%d/%y %H:%M'] DATE_FORMAT = 'N j, Y' DATE_INPUT_FORMATS = ['%Y-%m-%d', '%m/%d/%Y', '%m/%d/%y', '%b %d %Y', '%b %d, %Y', '%d %b %Y', '%d %b, %Y', '%B %d %Y', '%B %d, %Y', '%d %B %Y', '%d %B, %Y'] DEBUG = False DEBUG_PROPAGATE_EXCEPTIONS = False DECIMAL_SEPARATOR = '.' DEFAULT_AUTO_FIELD = 'django.db.models.AutoField' DEFAULT_CHARSET = 'utf-8' DEFAULT_EXCEPTION_REPORTER = 'django.views.debug.ExceptionReporter' DEFAULT_EXCEPTION_REPORTER_FILTER = 'django.views.debug.SafeExceptionReporterFilter' DEFAULT_FILE_STORAGE = 'django.core.files.storage.FileSystemStorage' DEFAULT_FROM_EMAIL = 'pjbondi(a)systemdatabase.com' DEFAULT_INDEX_TABLESPACE = '' DEFAULT_TABLESPACE = '' DISALLOWED_USER_AGENTS = [] EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_HOST_PASSWORD = '********************' EMAIL_HOST_USER = '' EMAIL_PORT = 25 EMAIL_SSL_CERTFILE = None EMAIL_SSL_KEYFILE = '********************' EMAIL_SUBJECT_PREFIX = '[Django] ' EMAIL_TIMEOUT = None EMAIL_USE_LOCALTIME = False EMAIL_USE_SSL = False EMAIL_USE_TLS = False FILE_UPLOAD_DIRECTORY_PERMISSIONS = None FILE_UPLOAD_HANDLERS = ['django.core.files.uploadhandler.MemoryFileUploadHandler', 'django.core.files.uploadhandler.TemporaryFileUploadHandler'] FILE_UPLOAD_MAX_MEMORY_SIZE = 2621440 FILE_UPLOAD_PERMISSIONS = 420 FILE_UPLOAD_TEMP_DIR = None FILTER_VHOST = False FIRST_DAY_OF_WEEK = 0 FIXTURE_DIRS = [] FORCE_SCRIPT_NAME = None FORMAT_MODULE_PATH = None FORM_RENDERER = 'django.forms.renderers.DjangoTemplates' HAYSTACK_CONNECTIONS = {'default': {'PATH': '/opt/mailman/web/xapian_index', 'ENGINE': 'xapian_backend.XapianEngine'}} HYPERKITTY_ENABLE_GRAVATAR = True IGNORABLE_404_URLS = [] INSTALLED_APPS = ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'django.contrib.humanize', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount'] INTERNAL_IPS = [] LANGUAGES = [('af', 'Afrikaans'), ('ar', 'Arabic'), ('ar-dz', 'Algerian Arabic'), ('ast', 'Asturian'), ('az', 'Azerbaijani'), ('bg', 'Bulgarian'), ('be', 'Belarusian'), ('bn', 'Bengali'), ('br', 'Breton'), ('bs', 'Bosnian'), ('ca', 'Catalan'), ('ckb', 'Central Kurdish (Sorani)'), ('cs', 'Czech'), ('cy', 'Welsh'), ('da', 'Danish'), ('de', 'German'), ('dsb', 'Lower Sorbian'), ('el', 'Greek'), ('en', 'English'), ('en-au', 'Australian English'), ('en-gb', 'British English'), ('eo', 'Esperanto'), ('es', 'Spanish'), ('es-ar', 'Argentinian Spanish'), ('es-co', 'Colombian Spanish'), ('es-mx', 'Mexican Spanish'), ('es-ni', 'Nicaraguan Spanish'), ('es-ve', 'Venezuelan Spanish'), ('et', 'Estonian'), ('eu', 'Basque'), ('fa', 'Persian'), ('fi', 'Finnish'), ('fr', 'French'), ('fy', 'Frisian'), ('ga', 'Irish'), ('gd', 'Scottish Gaelic'), ('gl', 'Galician'), ('he', 'Hebrew'), ('hi', 'Hindi'), ('hr', 'Croatian'), ('hsb', 'Upper Sorbian'), ('hu', 'Hungarian'), ('hy', 'Armenian'), ('ia', 'Interlingua'), ('id', 'Indonesian'), ('ig', 'Igbo'), ('io', 'Ido'), ('is', 'Icelandic'), ('it', 'Italian'), ('ja', 'Japanese'), ('ka', 'Georgian'), ('kab', 'Kabyle'), ('kk', 'Kazakh'), ('km', 'Khmer'), ('kn', 'Kannada'), ('ko', 'Korean'), ('ky', 'Kyrgyz'), ('lb', 'Luxembourgish'), ('lt', 'Lithuanian'), ('lv', 'Latvian'), ('mk', 'Macedonian'), ('ml', 'Malayalam'), ('mn', 'Mongolian'), ('mr', 'Marathi'), ('ms', 'Malay'), ('my', 'Burmese'), ('nb', 'Norwegian Bokmål'), ('ne', 'Nepali'), ('nl', 'Dutch'), ('nn', 'Norwegian Nynorsk'), ('os', 'Ossetic'), ('pa', 'Punjabi'), ('pl', 'Polish'), ('pt', 'Portuguese'), ('pt-br', 'Brazilian Portuguese'), ('ro', 'Romanian'), ('ru', 'Russian'), ('sk', 'Slovak'), ('sl', 'Slovenian'), ('sq', 'Albanian'), ('sr', 'Serbian'), ('sr-latn', 'Serbian Latin'), ('sv', 'Swedish'), ('sw', 'Swahili'), ('ta', 'Tamil'), ('te', 'Telugu'), ('tg', 'Tajik'), ('th', 'Thai'), ('tk', 'Turkmen'), ('tr', 'Turkish'), ('tt', 'Tatar'), ('udm', 'Udmurt'), ('uk', 'Ukrainian'), ('ur', 'Urdu'), ('uz', 'Uzbek'), ('vi', 'Vietnamese'), ('zh-hans', 'Simplified Chinese'), ('zh-hant', 'Traditional Chinese')] LANGUAGES_BIDI = ['he', 'ar', 'ar-dz', 'ckb', 'fa', 'ur'] LANGUAGE_CODE = 'en-us' LANGUAGE_COOKIE_AGE = None LANGUAGE_COOKIE_DOMAIN = None LANGUAGE_COOKIE_HTTPONLY = False LANGUAGE_COOKIE_NAME = 'django_language' LANGUAGE_COOKIE_PATH = '/' LANGUAGE_COOKIE_SAMESITE = None LANGUAGE_COOKIE_SECURE = False LOCALE_PATHS = [] LOGGING = {'version': 1, 'disable_existing_loggers': False, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}, 'handlers': {'mail_admins': {'level': 'ERROR', 'filters': ['require_debug_false'], 'class': 'django.utils.log.AdminEmailHandler'}, 'file': {'level': 'INFO', 'class': 'logging.handlers.WatchedFileHandler', 'filename': '/opt/mailman/web/logs/mailmanweb.log', 'formatter': 'verbose'}, 'console': {'class': 'logging.StreamHandler', 'formatter': 'simple'}}, 'loggers': {'django.request': {'handlers': ['mail_admins', 'file'], 'level': 'ERROR', 'propagate': True}, 'django': {'handlers': ['file'], 'level': 'ERROR', 'propagate': True}, 'hyperkitty': {'handlers': ['file'], 'level': 'DEBUG', 'propagate': True}, 'postorius': {'handlers': ['console', 'file'], 'level': 'INFO'}, 'q': {'level': 'WARNING', 'propagate': False, 'handlers': ['console', 'file']}}, 'formatters': {'verbose': {'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s'}, 'simple': {'format': '%(levelname)s %(message)s'}}} LOGGING_CONFIG = 'logging.config.dictConfig' LOGIN_REDIRECT_URL = 'list_index' LOGIN_URL = 'account_login' LOGOUT_REDIRECT_URL = None LOGOUT_URL = 'account_logout' MAILMAN_ARCHIVER_FROM = "('127.0.0.1', '::1')" MAILMAN_ARCHIVER_KEY = '********************' MAILMAN_REST_API_PASS = '********************' MAILMAN_REST_API_URL = '********************' MAILMAN_REST_API_USER = '********************' MANAGERS = [] MEDIA_ROOT = '' MEDIA_URL = '/' MESSAGE_STORAGE = 'django.contrib.messages.storage.fallback.FallbackStorage' MESSAGE_TAGS = {40: 'danger'} MIDDLEWARE = "('allauth.account.middleware.AccountMiddleware', 'django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware')" MIGRATION_MODULES = {} MONTH_DAY_FORMAT = 'F j' NUMBER_GROUPING = 0 PASSWORD_HASHERS = '********************' PASSWORD_RESET_TIMEOUT = '********************' POSTORIUS_TEMPLATE_BASE_URL = 'http://localhost:8000' PREPEND_WWW = False Q_CLUSTER = {'retry': 360, 'timeout': 300, 'save_limit': 100, 'orm': 'default', 'workers': 2} ROOT_URLCONF = 'mailman_web.urls' SECRET_KEY = '********************' SECRET_KEY_FALLBACKS = '********************' SECURE_CONTENT_TYPE_NOSNIFF = True SECURE_CROSS_ORIGIN_OPENER_POLICY = 'same-origin' SECURE_HSTS_INCLUDE_SUBDOMAINS = False SECURE_HSTS_PRELOAD = False SECURE_HSTS_SECONDS = 0 SECURE_PROXY_SSL_HEADER = None SECURE_REDIRECT_EXEMPT = [] SECURE_REFERRER_POLICY = 'same-origin' SECURE_SSL_HOST = None SECURE_SSL_REDIRECT = False SERVER_EMAIL = 'pjbondi(a)systemdatabase.com' SESSION_CACHE_ALIAS = 'default' SESSION_COOKIE_AGE = 1209600 SESSION_COOKIE_DOMAIN = None SESSION_COOKIE_HTTPONLY = True SESSION_COOKIE_NAME = 'sessionid' SESSION_COOKIE_PATH = '/' SESSION_COOKIE_SAMESITE = 'Lax' SESSION_COOKIE_SECURE = False SESSION_ENGINE = 'django.contrib.sessions.backends.db' SESSION_EXPIRE_AT_BROWSER_CLOSE = False SESSION_FILE_PATH = None SESSION_SAVE_EVERY_REQUEST = False SESSION_SERIALIZER = 'django.contrib.sessions.serializers.JSONSerializer' SETTINGS_MODULE = 'settings' SHORT_DATETIME_FORMAT = 'm/d/Y P' SHORT_DATE_FORMAT = 'm/d/Y' SIGNING_BACKEND = 'django.core.signing.TimestampSigner' SILENCED_SYSTEM_CHECKS = [] SITE_ID = 1 SOCIALACCOUNT_PROVIDERS = {'openid': {'SERVERS': [{'id': 'yahoo', 'name': 'Yahoo', 'openid_url': 'http://me.yahoo.com'}]}, 'google': {'SCOPE': ['profile', 'email'], 'AUTH_PARAMS': {'access_type': 'online'}}, 'facebook': {'METHOD': 'oauth2', 'SCOPE': ['email'], 'FIELDS': ['email', 'name', 'first_name', 'last_name', 'locale', 'timezone'], 'VERSION': 'v2.4'}} STATICFILES_DIRS = '()' STATICFILES_FINDERS = "('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder', 'compressor.finders.CompressorFinder')" STATICFILES_STORAGE = 'django.contrib.staticfiles.storage.StaticFilesStorage' STATIC_ROOT = '/opt/mailman/web/static' STATIC_URL = '/static/' STORAGES = {'default': {'BACKEND': 'django.core.files.storage.FileSystemStorage'}, 'staticfiles': {'BACKEND': 'django.contrib.staticfiles.storage.StaticFilesStorage'}} TEMPLATES = [{'BACKEND': 'django.template.backends.django.DjangoTemplates', 'DIRS': [], 'APP_DIRS': True, 'OPTIONS': {'context_processors': ['django.template.context_processors.debug', 'django.template.context_processors.i18n', 'django.template.context_processors.media', 'django.template.context_processors.static', 'django.template.context_processors.tz', 'django.template.context_processors.csrf', 'django.template.context_processors.request', 'django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django_mailman3.context_processors.common', 'hyperkitty.context_processors.common', 'postorius.context_processors.postorius']}}] TEST_NON_SERIALIZED_APPS = [] TEST_RUNNER = 'django.test.runner.DiscoverRunner' THOUSAND_SEPARATOR = ',' TIME_FORMAT = 'P' TIME_INPUT_FORMATS = ['%H:%M:%S', '%H:%M:%S.%f', '%H:%M'] TIME_ZONE = 'UTC' USE_DEPRECATED_PYTZ = False USE_I18N = True USE_L10N = True USE_THOUSAND_SEPARATOR = False USE_TZ = True USE_X_FORWARDED_HOST = False USE_X_FORWARDED_PORT = False WSGI_APPLICATION = 'mailman_web.wsgi.application' X_FRAME_OPTIONS = 'DENY' YEAR_MONTH_FORMAT = 'F Y'

3 6

Errors in MM3
by Odhiambo Washington April 7, 2025

April 7, 2025

I am using uwsgi+APache2. I am suddenly seeing hundreds of errors in my mailmanweb and uwsgi logfiles: 1. mailmanweb.log has hundreds of such lines: [WARNING] [2025-04-07 13:01:50,162] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/YOPKCEWPHX4BV7U5MOTCVCNSWR2J2JOZ/vote [WARNING] [2025-04-07 13:02:30,455] [log] 317562 139768479348416 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/L2X657PY3WAKSCJM2UNA25GKRN2J2VMX/vote [WARNING] [2025-04-07 13:02:35,482] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/2E34EDF6YJH4K4KARA7MEHLD5USXR5E3/vote [WARNING] [2025-04-07 13:02:37,567] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/thread/MICNFIHVLOETVE4PXEDO5MBYWG7SN57H/favorite [WARNING] [2025-04-07 13:02:46,161] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/TB5CV4GPCUGNP7X2YGYVZJQVOPQTGHD7/vote [WARNING] [2025-04-07 13:03:14,478] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/YOPMHB3GR4Y24EP7ZCPO2D7TABK4GSKZ/vote [WARNING] [2025-04-07 13:03:26,857] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/TM4NSQM3TTORRJCJS3KMAFYF4LWU3ZHH/vote [WARNING] [2025-04-07 13:04:02,219] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/EWO4G2AX5PYSBIC4OCQLHWINUWB7VDKV/vote [WARNING] [2025-04-07 13:04:09,255] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/thread/7657MIXEJG2CIO6327OAX45POCZSBN3K/favorite [WARNING] [2025-04-07 13:07:38,150] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/EU3WXXM6TSYOXV4JKBGFEL5EIU52G7XG/vote [WARNING] [2025-04-07 13:08:16,952] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/thread/IXNYG4H4CCVGMMTASEOIUMB5SUHZRCE7/favorite [WARNING] [2025-04-07 13:08:18,448] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/DXHE36JPN7INSTKU5N7W5R6O52AF3S2H/vote [WARNING] [2025-04-07 13:08:23,676] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/JGKERN3UETOSFGUX4QKA6QXFLD47ROW5/vote [WARNING] [2025-04-07 13:08:48,557] [log] 317562 139768548886080 Method Not Allowed (GET): /archives/list/ kictanet@lists.kictanet.or.ke/message/2BOOIT4FXCIMBHHRE5STC7OYLDAY3UTS/vote uwsgi-error.log has hundreds of such lines: --Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/message/KXMZK5NKWQHHPEAM5OGELD5HTISI4R3D/ (47.79.5.207) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/thread/3QYS53EQIZS3WX5BSAX57HTDEUSEZ2T6/ (47.79.1.203) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet@lists.kictanet.or.ke/message/BIVJX3ACXY332PMQ4ON5AHS7YRENUKDY/attachment/2/attachment.html (47.82.11.120) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /accounts/google/login/?next=/archives/list/ users@exim4u.org/message/JRWZKRUM6MLRYC6U5GV4OCQ7TN7JJHVQ/&process=login (52.1.157.90) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/thread/BSWHEQ3UBN266F3EYL7ROPMIDN5IH4DU/ (47.79.122.22) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/thread/F44UL7CUV2EJXEABMZRVUFUBWMK327TS/ (47.79.1.223) OSError: write error Mon Apr 7 14:02:23 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/thread/HXODIXNXW6HILG2OLT3J2Q3AEUAQKRXP/ (47.79.7.122) OSError: write error Mon Apr 7 14:02:24 2025 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /archives/list/ kictanet(a)lists.kictanet.or.ke/message/C6VTIVNOIOXXWZPBZ7VAJFEFNPHLO326/ (47.82.11.47) OSError: write error Any clues as to what needs to be done to mitigate the above? __ Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

2 1

Mailman3 OOM and high CPU usage
by Prasanth Nair April 7, 2025

April 7, 2025

Hi team, Our Mailman3 server crashes with OOM and high CPU usage. As soon as we start the mailmanweb service (uwsgi process), the system crashes. It was working fine, but this issue started recently. We haven't changed any recently. Any idea how to fix this? or any suggestions? Look forward to hearing from you soon. Kind regards, Prasanth Nair

2 2

bypassing rules on an individual basis
by dlb-ml＠anl.gov April 4, 2025

April 4, 2025

I have a mailing list that, due to specific circumstances, has a requirement to allow messages from a user that sends messages with no subject. I've added the address to the "Accept these non-members" collection, but messages from that address still get held for moderation, due to the no-subect rule. https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rules/docs… https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rules/docs… I went through the list's interface, and I wasn't able to find a mechanism to disable the rule, aside from editing the code itself. I also added header filters to immediately accept the message, but they still get held. Specifically, the rules I defined are: Header, Pattern, Action subject, ^Subject:\s*([[{(]?no[_ ]subject[]})]?)?\s*$, Accept Immediately subject, ^Subject:, Accept Immediately subject, ^, Accept Immediately Did I configure this correctly and/or is this the right course of action? Is there a better way to bypass this rule? Thanks

4 6

Change delivery_status in bulk
by Hitashi mancho April 4, 2025

April 4, 2025

Dear All, We have a Mailman3 instance with around 500 mailing lists. Most of the mailing lists have 5000 subscribers. Because of some misconfiguration in the postfix, posting for 1000 users has been bounced. Until we realized what happened, the mailman had set delivery_status to "disabled_by_bounces." for many subscribers. Now, I am unable to locate any command or an API call through which I can change the delivery_status back to enabled for 1000+ users. Can you please guide me on how I can do this programmatically using cli (I will write a bash script) or using an API call? Regards, Hitachi.

2 2

compatibility of mailman 3.3.10 with mariadb 11.4 LTS
by Chandrakant Pandey April 2, 2025

April 2, 2025

Whether mailman 3.3.10 is compatible with mariadb 11.4 LTS

3 3

Regarding nested mailing lists in mailman 3
by Chandrakant Pandey April 2, 2025

April 2, 2025

Hi, I want to know whether we can setup nested mailing lists in mailman 3 which we used to do in mailman 2. like ep2021@iitb.ac.in,ep2022@iitb.ac.in,ep2023@iitb.ac.in mailing lists exist and we add all this mailing lists as member in ep(a)iitb.ac.in. Whether this kind of nested mailing lists work ? --chandrakant

3 2

mailman3 on new Debian 12 installation, got ssl apache working on all URLs except /mailman3
by Philip Bondi April 1, 2025

April 1, 2025

Hello to all: Giant thank you to the community, Mark, Stephen, everyone. I have a lot of follow-up tasks in previous posts. Blazing forward on critical path flaws, first. I require a Debian 12 VM that supports: - Subversion - Let's Encrypt and required challenges - IMAP server - mailman3 - DKIM server I found this post helpful. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… I think I've noticed that posters avoid less than sign and express as html. I hacked it into this, which I tried to anonymize. My alias /static/ had to point to different location for my installation. I have ssl working for Subversion and my Let's Encrypt challenges. And 6 of those ProxyPass seem to work through ssl, except for /mailman3. That fails. Surfing to example.com/mailman3 gets. Service Unavailable The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later. <IfModule mod_ssl.c> <VirtualHost *:80> ServerName example.com Redirect permanent / https://example.com/ DocumentRoot /var/www/html/example.com/ </VirtualHost> <VirtualHost *:443> SSLEngine on ServerAdmin pjbondi(a)systemdatabase.com ServerName example.com ServerAlias www.example.com DocumentRoot /var/www/html/example.com/ ErrorLog ${APACHE_LOG_DIR}/example.com_error.log CustomLog ${APACHE_LOG_DIR}/example.com_access.log combined Include /etc/letsencrypt/options-ssl-apache.conf SSLCertificateFile /etc/letsencrypt/live/example.com-0001/fullchain.pem SSLCertificateKeyFile /etc/letsencrypt/live/example.com-0001/privkey.pem Alias /static/ /opt/mailman/web/static/ <Directory "/opt/mailman/web/static/"> Require all granted </Directory> <IfModule mod_headers.c> RequestHeader unset X-Forwarded-Proto <If "%{HTTPS} =~ /on/"> RequestHeader set X-Forwarded-Proto "https" </If> </IfModule> <IfModule mod_proxy.c> ProxyPreserveHost On ProxyPass "/postorius" "http://127.0.0.1:8000/postorius" ProxyPass "/hyperkitty" "http://127.0.0.1:8000/hyperkitty" ProxyPass "/accounts" "http://127.0.0.1:8000/accounts" ProxyPass "/admin" "http://127.0.0.1:8000/admin" ProxyPass "/user-profile" "http://127.0.0.1:8000/user-profile" ProxyPass "/mailman3" "http://127.0.0.1:8000/mailman3" ProxyPass "/archives" "http://127.0.0.1:8000/archives" # https://github.com/maxking/docker-mailman/issues/525 #ProxyPass / unix:/run/mailman3-web/uwsgi.sock|uwsgi://localhost/ #ProxyPassReverse / unix:/run/mailman3-web/uwsgi.sock|uwsgi://localhost/ #ProxyPassMatch "^/$" "http://127.0.0.1:8000/mailman3" </IfModule> </VirtualHost> </IfModule> I was noticing that there's no mailman3 sub-dir, here. I tried changing to http://127.0.0.1:8000/django-mailman3, but that didn't work. (venv) mailman@shackleton12:~$ ls -alF /opt/mailman/web/static/ total 40 drwxr-xr-x 10 mailman mailman 4096 Mar 24 16:03 ./ drwxr-xr-x 4 root root 4096 Mar 24 16:01 ../ drwxr-xr-x 3 mailman mailman 4096 Mar 24 16:03 account/ drwxr-xr-x 5 mailman mailman 4096 Mar 24 16:03 admin/ drwxr-xr-x 4 mailman mailman 4096 Mar 25 08:07 CACHE/ drwxr-xr-x 5 mailman mailman 4096 Mar 24 16:03 django_extensions/ drwxr-xr-x 5 mailman mailman 4096 Mar 24 16:03 django-mailman3/ drwxr-xr-x 6 mailman mailman 4096 Mar 24 16:03 hyperkitty/ drwxr-xr-x 6 mailman mailman 4096 Mar 24 16:03 postorius/ drwxr-xr-x 7 mailman mailman 4096 Mar 24 16:03 rest_framework/ Any ideas? What log file should I share? I've looked at apache and uwsgi logs, but I don't know what's relevant. I cannot seem to find an error in logs around mailman3 URL

4 10

Install Mailman 3.x Core on Alma Linux 9 / CloudLinux
by pineyscripter＠gmail.com March 30, 2025

March 30, 2025

Has anyone actually done this ? Want to use Exim and MariaDB

3 3

"Something went wrong" HTTP Error 500: {"title": "500 Internal Server Error"}
by zachr＠mta.ca March 27, 2025

March 27, 2025

Thanks for any help in advance! server: Used this guide: https://docs.mailman3.org/en/latest/install/virtualenv.html#nginx-configura… ubuntu 24.04 Django UWSGI Gunicorn Nginx SQLite DB Ive had a look at historical posts and I think this might be related to this issue: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… but Im not exactly sure. I only have one list on the server and I am encountering this issue. All other pages work fine. This is is the output of the mailman log: ----------------------------------------------------------------------------------------------------------------- 2025-03-21 16:49:30 [FALCON] [ERROR] GET /3.1/lists/csdopstest.test.com/archivers => Traceback (most recent call last): File "falcon/app.py", line 440, in falcon.app.App.__call__ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/rest/lists.py", line 425, in on_get archiver_set = IListArchiverSet(self._mlist) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/zope/component/_api.py", line 167, in adapter_hook return sitemanager.queryAdapter(object, interface, name, default) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/zope/interface/registry.py", line 363, in queryAdapter return self.adapters.queryAdapter(object, interface, name, default) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/mailinglist.py", line 647, in __init__ for archiver in config.archivers: File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/config/config.py", line 284, in archivers archiver = call_name(class_path) ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/utilities/modules.py", line 70, in call_name return named_callable(*args, **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 60, in __init__ self._load_conf() File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 87, in _load_conf self._conf["api_key"] = archiver_config.get("general", "api_key") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/configparser.py", line 777, in get return self._interpolation.before_get(self, section, option, value, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/configparser.py", line 367, in before_get self._interpolate_some(parser, option, L, value, section, defaults, 1) File "/usr/lib/python3.12/configparser.py", line 414, in _interpolate_some raise InterpolationSyntaxError( configparser.InterpolationSyntaxError: '%' must be followed by '%' or '(', found: '%#$%sfdgs' ----------------------------------------------------------------------------------------------------------------- Should I try the fix in the post mentioned above or is this a different issue? Cheers

3 4